Sign inGet started
Dataset · Hugging Face

ralovets/cl32k-python-english-50b-v2

cl32k Python + English 50B 50 billion tokens, pretokenized with cl32k, split by source family into training, validation and test. This is a Megatron indexed binary dataset, not a raw-text dataset for datasets.load_dataset(). The .bin files are uncompressed and ready to load after downloading. The viewer is disabled because the Parquet files contain provenance, not training examples. Split Tokens Documents Token files Train 49,749,849,599 61,304,861 32 Validation 200… See the full description on the dataset page: https://huggingface.co/datasets/ralovets/cl32k-python-english-50b-v2.

Author / organizationralovets
Downloads215 (as reported by Hugging Face)
Likes0
Created14 September 2026
Last updated at source14 September 2026
pythoncodepretrainingtokenizedmegatron
Embed this entry
<iframe src="https://silytics.si/embed/item/847c55cc-f107-413a-a491-2f43714c951c" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

215 now (-6 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.