Dataset · Hugging Face

tasksource/mmlu

Name: mmlu
Creator: tasksource
License: apache-2.0
Keywords: task_categories:text-classification, task_categories:multiple-choice, task_categories:question-answering, task_ids:multiple-choice-qa, task_ids:open-domain-qa, task_ids:closed-domain-qa, language:en, license:apache-2.0, size_categories:10K<n<100K, format:parquet, modality:text, library:datasets, library:pandas, library:mlcroissant, library:polars

MMLU (hendrycks_test on huggingface) without auxiliary train. It is much lighter (7MB vs 162MB) and faster than the original implementation, in which auxiliary train is loaded (+ duplicated!) by default for all the configs in the original version, making it quite heavy. We use this version in tasksource. Reference to original dataset: Measuring Massive Multitask Language Understanding - https://github.com/hendrycks/test @article{hendryckstest2021, title={Measuring Massive Multitask Language… See the full description on the dataset page: https://huggingface.co/datasets/tasksource/mmlu.

View on Hugging FaceReport an issue

Author / organization	tasksource
License (as declared)	apache-2.0
Downloads	42.7K (as reported by Hugging Face)
Likes	37
Created	1 February 2023
Last updated at source	18 July 2025

multi-taskmultitaskmmluhendrycks_test

Embed this entry

<iframe src="https://silytics.si/embed/item/2c8033b5-f0f7-4292-86b2-587165ade688" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from tasksource

tasksource/bigbenchDataset
tasksource/reclorDataset
tasksource/tasksource-jev-typed-decisionsDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 14 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.