Dataset · Hugging Face

epfml/FineWeb2-embedded

Name: FineWeb2-embedded
Creator: epfml
License: odc-by
Keywords: task_categories:text-generation, language:ru, language:zh, language:de, language:ja, language:es, language:fr, language:it, language:pt, language:pl, language:nl, language:id, language:tr, language:cs, language:vi

FineWeb2-embedded Dataset summary FineWeb2-embedded is an extension of the FineWeb2 dataset, annotated with document-level XLM-RoBERTa embeddings for 20 languages, making the dataset useful for a variety of tasks, including document clustering, filtering, and other multilingual research. Since XLM-RoBERTa has a sequence length limit of 512 tokens, each document's embeddings are obtained by mean-pooling 512 token chunks of the XLM-RoBERTa output. Therefore, longer… See the full description on the dataset page: https://huggingface.co/datasets/epfml/FineWeb2-embedded.

View on Hugging FaceReport an issue

Author / organization	epfml
License (as declared)	odc-by
Downloads	1.3K (as reported by Hugging Face)
Likes	6
Created	17 February 2025
Last updated at source	19 February 2025

Embed this entry

<iframe src="https://silytics.si/embed/item/a4f98927-575c-404e-bdd1-f74ee5137f3b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Recent changes

16 Oct 2026 Description: FineWeb2-embedded Dataset summary FineWeb2-embedded is an extension of the FineWeb2 dataset, annotated with document-level XLM-RoBERTa embeddings for 20 languages, making the dataset useful for a variety of tasks, including document cluster → FineWeb2-embedded Dataset summary FineWeb2-embedded is an extension of the FineWeb2 dataset, annotated with document-level XLM-RoBERTa embeddings for 20 languages, making the dataset useful for a variety of tasks, including document cluster

Changes detected by Silytics between refreshes of the source.

More from epfml

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.