jhu-clsp/mmBERT-decay-data
MMBERT Decay Phase Data Phase 3 of 3: Annealed language learning decay phase (100B tokens) with massive multilingual expansion to 1833 languages. ๐ Data Composition NOTE: there are multiple decay data mixtures: this mixture described below is the Decay-Cont mixture. However, the data in this repository is the Decay-Eng. If you are interested in the others, please let me know so I can prioritize it. Data Source Tokens (B) Percentage Description FineWeb2โฆ See the full description on the dataset page: https://huggingface.co/datasets/jhu-clsp/mmBERT-decay-data.
| Author / organization | jhu-clsp |
|---|---|
| License (as declared) | mit |
| Downloads | 29K (as reported by Hugging Face) |
| Likes | 6 |
| Created | 11 August 2025 |
| Last updated at source | 11 December 2025 |
More from jhu-clsp
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.