Dataset · Hugging Face

hazyresearch/MMLU_with_Llama_3.1_8B_Instruct_v1

Name: MMLU_with_Llama_3.1_8B_Instruct_v1
Creator: hazyresearch
License: mit
Keywords: license:mit, size_categories:n<1K, format:parquet, modality:text, library:datasets, library:pandas, library:mlcroissant, library:polars, arxiv:2506.18203, region:us

MMLU with Llama-3.1-8B-Instruct This dataset contains multiple-choice questions from the MMLU benchmark with 100 candidate responses generated by Llama-3.1-8B-Instruct for each problem. Each response has been evaluated for correctness using a mixture of GPT-4o-mini and procedural Python code to robustly parse different answer formats, and scored by multiple reward models (scalar values) and LM judges (boolean verdicts). Dataset Structure Split: Single split named… See the full description on the dataset page: https://huggingface.co/datasets/hazyresearch/MMLU_with_Llama_3.1_8B_Instruct_v1.

View on Hugging FaceReport an issue

Author / organization	hazyresearch
License (as declared)	mit
Downloads	211 (as reported by Hugging Face)
Likes	0
Created	29 May 2025
Last updated at source	24 June 2025

Embed this entry

<iframe src="https://silytics.si/embed/item/9472e9a8-cbdc-4f60-8bf2-86fd7c3c59e6" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 5 days

211 now (+33 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Recent changes

16 Oct 2026 Description: MMLU with Llama-3.1-8B-Instruct This dataset contains multiple-choice questions from the MMLU benchmark with 100 candidate responses generated by Llama-3.1-8B-Instruct for each problem. Each response has been evaluated for correctness using → MMLU with Llama-3.1-8B-Instruct This dataset contains multiple-choice questions from the MMLU benchmark with 100 candidate responses generated by Llama-3.1-8B-Instruct for each problem. Each response has been evaluated for correctness using

Changes detected by Silytics between refreshes of the source.

More from hazyresearch

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.