fineweb-retrieval/fineweb-edu-emb

This file contains the embeddings for the full fineweb-edu dataset. The dataset has been deduplicated (using only exact deduplication). The emb folder contains for each parquet file a new_{parquet_name}.npy and old_{parquet}.npy file. The old refers to text that has been seen in the smaller 10B/100B/350B data samples. Cohere embed-multilingual-v3.0 model has been used. The index of the dataset can be found here: https://huggingface.co/datasets/Cohere/fineweb-edu-index The corpus can be found… See the full description on the dataset page: https://huggingface.co/datasets/fineweb-retrieval/finewe

<iframe src="https://silytics.si/embed/item/d5ffd78d-0663-448e-b304-0ce78f939565" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.