airtrain-ai/fineweb-edu-fortified
Fineweb-Edu-Fortified The composition of fineweb-edu-fortified, produced by automatically clustering a 500k row sample in Airtrain What is it? Fineweb-Edu-Fortified is a dataset derived from Fineweb-Edu by applying exact-match deduplication across the whole dataset and producing an embedding for each row. The number of times the text from each row appears is also included as a count column. The embeddings were produced using TaylorAI/bge-micro Fineweb and… See the full description on the dataset page: https://huggingface.co/datasets/airtrain-ai/fineweb-edu-fortified.
| Author / organization | airtrain-ai |
|---|---|
| License (as declared) | odc-by |
| Downloads | 65.4K (as reported by Hugging Face) |
| Likes | 69 |
| Created | 22 July 2024 |
| Last updated at source | 8 August 2024 |
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.