Starter: Measure models against your data
Run your real prompts against every major model. Quality, cost, and latency side by side. Find the right model for your use case in your first session.
Simple, transparent pricing
Starter gets you the comparison data you need. Upgrade when your use case grows.
Recommended
Starter
$49/mo
Live comparisons for individuals
- ✓ $12/mo before top-up
- ✓ Up to 5 models per run
- ✓ Gold standard + diagnostic scoring
- ✓ REST API access (1 developer key)
- ✓ 90-day history
Pro
$129/mo
Power users and small teams
- ✓ $45/mo before top-up
- ✓ Up to 8 models per run
- ✓ Rubric evaluation + daily benchmarks
- ✓ REST API + MCP (5 developer keys)
- ✓ 1 RAG store + 1 BYOE endpoint
- ✓ Agent analysis: evaluate whole agent workflows
Pro Plus
$199/mo
Teams with serious evaluation needs
- ✓ $73/mo before top-up
- ✓ Up to 10 models per run
- ✓ Compliance scoring + 4x daily benchmarks
- ✓ REST API + MCP (10 developer keys)
- ✓ 5 RAG stores + 5 BYOE endpoints
- ✓ Agent analysis: evaluate whole agent workflows
Enterprise
$499/mo
Full platform, unlimited scale
- ✓ $150/mo before top-up
- ✓ Up to 20 models per run
- ✓ Hourly benchmarks + webhook alerts
- ✓ REST API + MCP (50 developer keys)
- ✓ Unlimited RAG, history, system prompts
- ✓ Agent analysis: evaluate whole agent workflows
REST API access
Fire comparisons from any script. 1 developer key included on Starter. Same async pattern as the dashboard – POST to start, poll for the job, retrieve the full result.
Rubric scores per criterion: support reply task
Upgrade to Pro: scheduled benchmarks
One run tells you who wins today. A benchmark tells you who you can rely on. Schedule daily runs, set alert thresholds, and catch model drift before your users do. Pro also adds agent analysis, which checks the trace of a Kiro or Claude Code workflow (agent evaluation).
Pass rate · quality threshold 95 · 12 scheduled runs (RAG pipeline)
Stop guessing. Start measuring.
Your first comparison takes less than a minute. $49/mo, cancel any time.