Beyond English benchmarks: clinical llm evaluation in Brazilian Portuguese
Large Language Models are transforming the support for clinical decision and their application in real scenarios. Yet, most benchmarks are conducted in English, and cross-lingual evaluation is needed to tackle the language gaps in global access. We introduce ClinicalBr, the first bilingual benchmark for clinical decision built from real Brazilian case reports. The corpus contains 2,892 cases drawn from 28 SciELO medical journals, spanning 18 specialties, and is structured as parallel Portuguese-English pairs. Each case supports four evaluation tasks: diagnosis retrieval, differential diagnosis, exam recommendation, and treatment planning. We evaluate four models: MedGemma-27B, Sabiá-4, De...
| Authors | Giordano de Pinho Souza, Glaucia Melo, Josefino Cabral Melo Lima et al. |
|---|---|
| Primary category | cs.CL |
| Published | 5 June 2026 |
| Last updated at source | 5 June 2026 |
Connected in the knowledge graph
- Giordanopsouza/clinicalbrDataset · cited by
Models and datasets referencing this paper
- Giordanopsouza/clinicalbrDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.