DATA-MASK/FineWeb-Mask
FineWeb-Mask π DATAMASK Paper | π» GitHub Repository | π¦ Fineweb-Mask Dataset π Introduction FineWeb-Mask is a 1.5 trillion token, high-efficiency pre-training dataset curated using the DATAMASK framework. Developed by the ByteDance Seed team, DATAMASK addresses the fundamental tension in large-scale data selection: the trade-off between high quality and high diversity. By modeling data selection as a Mask Learning problem, we provide a derivative of theβ¦ See the full description on the dataset page: https://huggingface.co/datasets/DATA-MASK/FineWeb-Mask.
| Author / organization | DATA-MASK |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 1.2K (as reported by Hugging Face) |
| Likes | 6 |
| Created | 29 December 2025 |
| Last updated at source | 19 January 2026 |
Recent changes
- 16 Oct 2026 Description: FineWeb-Mask π DATAMASK Paper | π» GitHub Repository | π¦ Fineweb-Mask Dataset π Introduction FineWeb-Mask is a 1.5 trillion token, high-efficiency pre-training dataset curated using the DATAMASK framework. Developed by the ByteDance Seed β FineWeb-Mask π DATAMASK Paper | π» GitHub Repository | π¦ Fineweb-Mask Dataset π Introduction FineWeb-Mask is a 1.5 trillion token, high-efficiency pre-training dataset curated using the DATAMASK framework. Developed by the ByteDance Seed
Changes detected by Silytics between refreshes of the source.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.