AI Reliability Console

Monitor behavior, manage risk, and ship confidently

Evaluation Studio / Run

Concierge Agent - Baseline Snapshot

Concierge Agent · gpt-4o · run_219

Back to RunsDecision WorkspacePublish Report
Decision
Ship
Confidence
77%
Overall Score
85
Regression
2.3%

Result Variance %

RegressionQuality DiagnosisDisagreement 10.1%

Baseline quality is acceptable but weaker than current candidate on policy edge-cases.

Derived metrics

Helpfulness: 83Information Density: 80Format Adherence: 94Coherence: 84

Decision metrics by intent

Regression

Regression %: 1.4%

Result Variance %: 2.3%

Pass Rate: 90.8%

Quality Diagnosis

Overall Score: 85

Pass Rate: 90.8%

Judge Agreement: 86%

Policy pack: Regulated Support v4Evaluator versions lockedResidency: US-EastAudit evidence chain: active
Run Metric Timeline
Quality and risk evolution during execution.
Judge Score Breakdown
Per-metric score spread across evaluators.