AI Reliability Console

Monitor behavior, manage risk, and ship confidently

Evaluators

Create LLM Evaluator

Configure provider, endpoint, file delivery, and prompt mapping for custom evaluator registration.

Step 1: Provider and Basic Info

Step 2: Connection

Step 3: File Delivery and Modalities

Step 4: Prompt and Response Mapping

Files placeholder resolved from delivery mode: {{signed_urls}}

Complete required fields and pass all relevant tests before activation.