Introducing Hospital-bench: the most comprehensive hospital operations simulation built to evaluate AI agents.
Behind every hospital visit are hours of administrative work: insurance verification, prior authorizations, claims, billing, patient records, and paperwork spread across dozens of workflows.
We built Hospital-bench to test whether AI agents can handle this complexity in a realistic hospital environment.
Here are the results ↓
Which models performed best overall?
📷 GPT-6.2 Astra led with a 62.4% score at $2.72 per task. It failed 13.3% of safety checks, but no tasks were zeroed due to harm.
📷 Gemini 4 Neon scored 59.8% at $2.17 per task, fully passing 15/48 tasks with zero tasks zeroed due to harm.
📷 GPT-6.2 Sol offered the best cost efficiency, scoring 57.6% at just $0.81 per task, though 3 tasks were zeroed due to harm.
Read the full research for an in-depth look at how we built Hospital-bench, curated the data, designed and graded the tasks, and evaluated frontier AI models.
Full benchmark, methodology, and results ↓
zavo.ai/research/hospital-be…
11
536
Which models performed best overall?
1️⃣ GPT-6.2 Astra led with a 62.4% score at $2.72 per task. It failed 13.3% of safety checks, but no tasks were zeroed due to harm.
2️⃣ Gemini 4 Neon scored 59.8% at $2.17 per task, fully passing 15/48 tasks with zero tasks zeroed due to harm.
3️⃣ GPT-6.2 Sol offered the best cost efficiency, scoring 57.6% at just $0.81 per task, though 3 tasks were zeroed due to harm.
1
6
Read the full research for an in-depth look at how we built Hospital-bench, curated the data, designed and graded the tasks, and evaluated frontier AI models.
Full benchmark, methodology, and results ↓
zavo.ai/hospital-bench
3








