Dataset · Hugging Face

Benjamin-png/swahili-pretraining-corpus

Name: swahili-pretraining-corpus
Creator: Benjamin-png
License: cc-by-4.0
Keywords: task_categories:text-generation, language:sw, license:cc-by-4.0, size_categories:1B<n<10B, region:us, swahili, kiswahili, pretraining, language-modeling, african-languages, low-resource

Swahili Pretraining Corpus (tokenized) The pre-training corpus used to train Benjamin-png/swahili-gpt-71m from scratch — ~2.15 billion tokens of real Swahili text, already tokenized and ready for language-model training. Contents File What it is train.bin Training tokens — a flat uint16 array of token IDs (~2.15B tokens, ~4.3 GB) val.bin Held-out validation tokens (same format) swahili_tokenizer.model The SentencePiece tokenizer (32k vocab… See the full description on the dataset page: https://huggingface.co/datasets/Benjamin-png/swahili-pretraining-corpus.

View on Hugging FaceReport an issue

Author / organization	Benjamin-png
License (as declared)	cc-by-4.0
Downloads	208 (as reported by Hugging Face)
Likes	0
Created	28 June 2026
Last updated at source	28 June 2026

swahilikiswahilipretraininglanguage-modelingafrican-languageslow-resource

Embed this entry

<iframe src="https://silytics.si/embed/item/91982814-e3f3-450c-a82e-8552b6112fbe" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

208 now. Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.