HealthBench-Psych: A Mental Health Subset of OpenAI's HealthBench
General-purpose health benchmarks increasingly anchor claims about LLM medical performance, but they are not always resolved by clinical specialty, making domain-specific performance hard to isolate. Mental health is of acute public-health concern as millions of people turn to LLMs for psychological support, and most existing evaluations are bespoke academic benchmarks that are difficult to integrate into developer workflows. We introduce HealthBench-Psych and HealthBench-Psych-Hard. We screened HealthBench's 5,000 physician-rubric conversations for mental-health relevance with a transparent LLM-applied rubric, then validated the subset through two rounds of blinded clinician review with ...
| Authors | Matthew Flathers, Phuong Anh Nguyen, Jill Noorily et al. |
|---|---|
| Primary category | cs.CL |
| Published | 25 August 2026 |
| Last updated at source | 25 August 2026 |
Connected in the knowledge graph
- mindbench-ai/healthbench-psychDataset · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.