AI Reliability Console

Monitor behavior, manage risk, and ship confidently

Evaluation Studio / Run

Concierge Agent - Weekly Regression

Concierge Agent · gpt-4o · run_223

Back to RunsDecision WorkspacePublish Report
Decision
Ship
Confidence
83%
Overall Score
89
Regression
1.6%

Result Variance %

RegressionQuality DiagnosisDisagreement 7.2%

Resolution confidence improved without policy drift; no critical blockers detected.

Derived metrics

Helpfulness: 88Information Density: 85Format Adherence: 96Coherence: 89

Decision metrics by intent

Regression

Regression %: 0.9%

Result Variance %: 1.6%

Pass Rate: 93.6%

Quality Diagnosis

Overall Score: 89

Pass Rate: 93.6%

Judge Agreement: 91%

Policy pack: Regulated Support v4Evaluator versions lockedResidency: US-EastAudit evidence chain: active
Run Metric Timeline
Quality and risk evolution during execution.
Judge Score Breakdown
Per-metric score spread across evaluators.