Sign inGet started
Dataset · Hugging Face

allegrolab/dclm-baseline-500b_toks

DCLM Baseline 500B Tokens (Decontaminated) Dataset Description This dataset is a decontaminated subset of the DCLM-Baseline corpus, specifically prepared for the Hubble memorization research project. The dataset has been carefully processed to remove overlap with memorization evaluation data and subsampled around 500 billion tokens of English text. This corpus serves as the foundational training data for all Hubble models, providing a clean baseline for studying… See the full description on the dataset page: https://huggingface.co/datasets/allegrolab/dclm-baseline-500b_toks.

Author / organizationallegrolab
License (as declared)cc-by-4.0
Downloads1.1K (as reported by Hugging Face)
Likes0
Created13 August 2025
Last updated at source23 October 2025
language-modelingpretrainingmemorization-researchhubble
Embed this entry
<iframe src="https://silytics.si/embed/item/13a2489d-794a-4e4e-b0bb-72c74aa0dbb7" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

1,078 now (-36 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Connected in the knowledge graph

Explore this entry in the graph

More from allegrolab

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.