Sign inGet started
Dataset Β· Hugging Face

DataScience-UIBK/PopMCQ

🎯 PopMCQ Does your model pick the famous answer or the correct one? πŸ“Œ Overview PopMCQ renders the same question six ways. The question and the correct answer never change β€” only how popular the three distractors are. That makes option popularity an independent variable, so an accuracy swing across S1–S6 is attributable to popularity rather than to question difficulty. The swings are large. Under the hardest setting (S2), models pick a popular-but-wrong… See the full description on the dataset page: https://huggingface.co/datasets/DataScience-UIBK/PopMCQ.

Author / organizationDataScience-UIBK
License (as declared)cc-by-sa-4.0
Downloads146 (as reported by Hugging Face)
Likes1
Created24 August 2026
Last updated at source10 September 2026
popularity-biasevaluationllm-evaluationbiasmultiple-choice
Embed this entry
<iframe src="https://silytics.si/embed/item/ac64566e-dc2f-48c7-a3c4-99dbe514645e" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from DataScience-UIBK

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.