glouriousgautam/lilm1-pretrain-mix-32b
LiLM Experiment 3 pretraining corpus Private research corpus with 32,000,010,072 globally exact-deduplicated train tokens plus 328,933,246 held-out tokens. Data are stored as EOS-delimited little-endian uint16 binaries with aligned Parquet provenance. This repository combines ODC-By FinePDFs-Edu, CC-BY-4.0 DCLM, ODC-By SmolLM/FineMath sources, Apache-2.0 UltraX subject to its upstream terms, per-file permissively licensed Stack-Edu code subject to The Stack v2 terms, StarCoder2… See the full description on the dataset page: https://huggingface.co/datasets/glouriousgautam/lilm1-pretrain-mix-32b
| Author / organization | glouriousgautam |
|---|---|
| License (as declared) | other |
| Downloads | 585 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 31 July 2026 |
| Last updated at source | 1 August 2026 |
Popularity, last 2 days
585 now (+30 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from glouriousgautam
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.