Building a European Multilingual Evaluation Dataset: The MMLU Localisation Project within the EMT Network
This paper reports on a collaboration between the Directorate-General for Translation (DGT) and the European Master's in Translation (EMT) to localise the MMLU dataset into 11 European languages. Beyond creating a more inclusive benchmark for LLM evaluation, the project offers master's students authentic, project-based professional training in translation, revision, project management, and multilingual coordination, while highlighting key methodological, administrative, and workflow challenges.
| Authors | Pilar Sánchez-Gijón, Susana Valdez, Sofía Calvo Del Barrio et al. |
|---|---|
| Primary category | cs.CL |
| Published | 20 July 2026 |
| Last updated at source | 20 July 2026 |
Connected in the knowledge graph
- EC-DGT-AI/EU-MMLUDataset · cited by
Models and datasets referencing this paper
- EC-DGT-AI/EU-MMLUDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.