Dataset · Hugging Face

calnugget/adversemed-500

Name: adversemed-500
Creator: calnugget
License: cc-by-4.0
Keywords: task_categories:question-answering, task_categories:text-classification, task_ids:multiple-choice-qa, annotations_creators:other, language_creators:machine-generated, multilinguality:monolingual, source_datasets:extended|med_qa, language:en, license:cc-by-4.0, size_categories:n<1K, format:json, modality:text, library:datasets, library:pandas, library:polars

AdverseMed-500 AdverseMed-500 is a hand-verified false-premise medical multiple-choice benchmark for measuring miscalibration in medical language models. All 500 items embed a false clinical premise, and the correct action is to abstain / flag the premise, not to choose an A–D answer. Paper: AdverseMed-500: A Hand-Verified False-Premise Benchmark for Measuring Miscalibration in Medical Language Models. Vallamsetty (2026). Preregistration: OSF osf.io/mehu4 Repo (code +… See the full description on the dataset page: https://huggingface.co/datasets/calnugget/adversemed-500.

View on Hugging FaceReport an issue

Author / organization	calnugget
License (as declared)	cc-by-4.0
Downloads	140 (as reported by Hugging Face)
Likes	0
Created	22 August 2026
Last updated at source	1 October 2026

medicalclinical-safetycalibrationmiscalibrationfalse-premiseabstentionLLM-safetyadverse-medicationbenchmarkadversarial

Embed this entry

<iframe src="https://silytics.si/embed/item/cb5106f3-be5c-492f-859e-75b214b03522" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

140 now (-2 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.