Dataset · Hugging Face

EleutherAI/dclm-dedup-25B

Name: dclm-dedup-25B
Creator: EleutherAI
Keywords: size_categories:10M<n<100M, format:parquet, modality:tabular, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, region:us

The first 25,000,003,108 tokens of Zyphra/dclm-dedup. Tokenized using the NeoX tokenizer (EleutherAI/gpt-neox-20b).

View on Hugging FaceReport an issue

Author / organization	EleutherAI
Downloads	368 (as reported by Hugging Face)
Likes	2
Created	6 February 2025
Last updated at source	6 February 2025

Embed this entry

<iframe src="https://silytics.si/embed/item/d380ac20-1a15-4433-b497-21e5816032cc" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

368 now (-54 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from EleutherAI

EleutherAI/hendrycks_mathDataset
EleutherAI/lambada_openaiDataset
EleutherAI/wikitext_document_levelDataset
EleutherAI/headqaDataset
EleutherAI/proof-pile-2Dataset
EleutherAI/asdivDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.