krutrim-ai-labs/MUTANT
MUTANT This repository contains the dataset for multilingual tokenizer evaluation MUTANT, introduced in “MUTANT: A Recipe for Multilingual Tokenizer Design”🔗 arXiv:2511.03237🏛️ Accepted at ACL 2026 To assess tokenizer behavior in Indic use cases, we construct an evaluation set spanning 22 Indic languages, English, and code. Using the data You can read JSON directly, or use datasets. Example: from datasets import load_dataset # Load the MUTANT dataset… See the full description on the dataset page: https://huggingface.co/datasets/krutrim-ai-labs/MUTANT.
| Author / organization | krutrim-ai-labs |
|---|---|
| Downloads | 241 (as reported by Hugging Face) |
| Likes | 2 |
| Created | 26 April 2026 |
| Last updated at source | 26 April 2026 |
Popularity, last 3 days
241 now (+2 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 17 Oct 2026 Description: MUTANT This repository contains the dataset for multilingual tokenizer evaluation MUTANT, introduced in “MUTANT: A Recipe for Multilingual Tokenizer Design”🔗 arXiv:2511.03237🏛️ Accepted at ACL 2026 To assess tokenizer behavior in Indic us → MUTANT This repository contains the dataset for multilingual tokenizer evaluation MUTANT, introduced in “MUTANT: A Recipe for Multilingual Tokenizer Design”🔗 arXiv:2511.03237🏛️ Accepted at ACL 2026 To assess tokenizer behavior in Indic us
Changes detected by Silytics between refreshes of the source.
More from krutrim-ai-labs
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.