Dataset · Hugging Face

Similoluwa/african-multilingual-tokenizer-challenge

Name: african-multilingual-tokenizer-challenge
Creator: Similoluwa
License: cc-by-sa-3.0
Keywords: task_categories:text-generation, language:en, language:fr, language:ha, language:sw, language:yo, language:am, license:cc-by-sa-3.0, license:gfdl, size_categories:100K<n<1M, format:parquet, modality:text, library:datasets, library:dask, library:polars

African Multilingual Tokenizer Challenge dataset The frozen public corpus for the African Multilingual Tokenizer Challenge. It contains one balanced multilingual train split and one balanced validation split. Split Per language Total Train 40,000 240,000 Validation 4,000 24,000 Languages are English (en), French (fr), Hausa (ha), Swahili (sw), Yoruba (yo) and Amharic (am). Official public-test and private-test text are deliberately absent from this repository.… See the full description on the dataset page: https://huggingface.co/datasets/Similoluwa/african-multilingual-tokenizer-challenge.

View on Hugging FaceReport an issue

Author / organization	Similoluwa
License (as declared)	cc-by-sa-3.0
Downloads	296 (as reported by Hugging Face)
Likes	0
Created	1 September 2026
Last updated at source	1 September 2026

Embed this entry

<iframe src="https://silytics.si/embed/item/966c7f17-55df-4c20-9185-9c1a948e18ab" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 2 days

296 now (+4 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from Similoluwa

Similoluwa/capstone-datasetsDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.