uctnlp/mzansi-text-deduplicated

MzansiText — deduplicated release This is a conservatively deduplicated release of MzansiText, a multilingual pretraining corpus for all eleven official South African languages. Use the original release to reproduce the paper and its trained models. Use this release for new experiments where cross-source duplicate documents should be removed. Dataset details Splits: 3,744,654 train rows, 19,940 validation rows, and 19,784 test rows Total: 3,784,378 rows lang… See the full description on the dataset page: https://huggingface.co/datasets/uctnlp/mzansi-text-deduplicated.

<iframe src="https://silytics.si/embed/item/4593c1d2-2735-4fa1-9b79-667b0760da90" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.