You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The HTML report we generate (via HtmlReportWriter, rendered by the React app under TypeScript/components) has picked up a lot of features over time: metric cards, chat history,
search, trending, tags, and the layout has gotten busier but not more convenient. Once you have a decent number of
scenarios and metrics it's harder than it should be to scan results and drill into a specific
metric or conveniently compare cases/runs/metrics.
I've got a mockup of a cleaner design (screenshots below) using FluentUI 2 design system, and wanted to agree on direction before
I sink time into implementation. The work is a visual refresh only — no data or API changes:
Agree on the design direction (mockup attached).
Rebuild the layout in the existing components, still reading the same Dataset / ScenarioRunResult / EvaluationMetric data via ReportContext.
Keep what already works: scenario tree, run history, search, markdown, pass/fail bars,
metric and diagnostics drill-downs.
Keep the build/output identical: single self-contained file, the ##DATASETS## placeholder HtmlReportWriter relies on, and the existing CSP.
Mostly visual-regression risk in the shared components, the same React app drives both the
standalone report and the AzDevOps extension, so both need verifying. No API or data-shape
changes.
Background and motivation
The HTML report we generate (via HtmlReportWriter, rendered by the React app under TypeScript/components) has picked up a lot of features over time: metric cards, chat history,
search, trending, tags, and the layout has gotten busier but not more convenient. Once you have a decent number of
scenarios and metrics it's harder than it should be to scan results and drill into a specific
metric or conveniently compare cases/runs/metrics.
I've got a mockup of a cleaner design (screenshots below) using FluentUI 2 design system, and wanted to agree on direction before
I sink time into implementation. The work is a visual refresh only — no data or API changes:
Dataset/ScenarioRunResult/EvaluationMetricdata viaReportContext.metric and diagnostics drill-downs.
##DATASETS##placeholderHtmlReportWriterrelies on, and the existing CSP.Screenshots
Overview tab
Cases tab
History tab
Comparison tab
Standalone mockup to play with
AI Evaluation Report v3.1 (standalone).html
Risks
Mostly visual-regression risk in the shared components, the same React app drives both the
standalone report and the AzDevOps extension, so both need verifying. No API or data-shape
changes.