# Eval Post Processing

> Aggregates TraceLens analysis repeatability CSVs into unit and e2e metric tables, classifies failure

Aggregates TraceLens analysis repeatability CSVs into unit and e2e metric tables, classifies failures using report_section_rules.yaml, writes pr_report.md and fix_ticket_report.md, and packages reproducer tar.gz archives. Use when the user runs eval post processing after run_repeatability_parallel.sh, asks to aggregate repeatability results, or requests automated eval reports from a results_root or report_dir.

- Page: https://ss33.ai/skills/amd/eval-post-processing-75431584144
- Publisher: amd
- Category: [Software Development](https://ss33.ai/skills/category/software-development-t44z8z) › [Testing & QA](https://ss33.ai/skills/category/software-development-t44z8z/testing-and-qa-g56s6z)
- License: MIT
- Source: https://github.com/amd/skills/blob/1ca218bef15c128c877c70a8ddc267e601ad8b2e/skills/tracelens-analysis-orchestrator/evals/skills/eval-post-processing/SKILL.md

## Skill

SKILL.md: https://ss33.ai/api/v1/ss33/download/amd/eval-post-processing-75431584144

<!--
Copyright (c) 2026 Advanced Micro Devices, Inc. All rights reserved.

See LICENSE for license information.
-->

---
name: eval-post-processing
description: >-
  Aggregates TraceLens analysis repeatability CSVs, classifies failures using
  report_section_rules.yaml, writes PR and fix-ticket markdown reports, and builds
  reproducer tarballs. Use when the user runs eval post processing, aggregates
  repeatability results after the harness, or asks for automated eval reports from
  results_root / report_dir parameters.
---

# Eval post processing

Run **after** `run_repeatability_parallel.sh` (or manually on an existing results tree): aggregate per-run eval data, split **unit** vs **e2e** metrics, classify failures, emit `pr_report.md` and `fix_ticket_report.md`, package reproducers, then copy the report tree to `TraceLens/Agent/Analysis/skills/analysis-orchestrator/evals/eval_reports/latest/`.

## Full procedure

Follow **[reference.md](reference.md)** for key=value inputs, exact report templates, reproducer layout, path sanitization, and the final summary block.

## Step index

```
4. Aggregate — aggregate_repeatability.py → report_dir/aggregates/*.csv
5. Read and classify — YAML rules + per-split metrics
6. Write reports — pr_report.md, fix_ticket_report.md
7. Build reproducer packages — per issue_summary, tar.gz
8. Save and summarize — copy to eval_reports/latest/, print paths
```

## Skill location

Bundled at `TraceLens/Agent/Analysis/skills/analysis-orchestrator/evals/skills/eval-post-processing/` (`SKILL.md`, `reference.md`). For Cursor auto-discovery, symlink or copy this folder under `.cursor/skills/` in a workspace that includes this repo.
