AutoMedBench: Towards Medical AutoResearch with Agentic AI Models
Autonomous agents are increasingly expected to support end-to-end medical-AI research workflows, moving beyond isolated prediction tasks or short-form clinical question answering. However, existing medical agent benchmarks primarily evaluate final outputs, providing limited visibility into agent behavior within the research process. To address this gap, we present AutoMedBench, a workflow-aware benchmark for autonomous medical-AI research across diverse medical imaging and multimodal inference tasks, organizing agent execution into a unified five-stage workflow (S1-S5): Plan, Setup, Validate, Inference, and Submit. It comprises long-horizon tasks with each run averaging 33 agent turns, sp...
| Authors | Junqi Liu, Selena Song, Yuhan Wang et al. |
|---|---|
| Primary category | cs.AI |
| Published | 1 June 2026 |
| Last updated at source | 3 June 2026 |
Connected in the knowledge graph
- MitakaKuma/AutoMedBench-Full-releaseDataset · cited by
- MitakaKuma/AutoMedBench-Lite-releaseDataset · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.