AmanPriyanshu/stratified-kmeans-diverse-pretraining-100K-1M
Stratified K-Means Diverse Pre-Training Dataset (100K-1M) A carefully balanced subset combining FineWeb-Edu and Proof-Pile-2, featuring embedding-based k-means sampling to ensure diverse representation across educational and mathematical/scientific content at multiple scales. 👥 Follow the Authors Aman Priyanshu Supriti Vijay Overview This dataset provides stratified subsets at 50k, 100k, 250k, 500k, and 1M scales, combining… See the full description on the dataset page: https://huggingface.co/datasets/AmanPriyanshu/stratified-kmeans-diverse-pretraining-100K-1M.
| Author / organization | AmanPriyanshu |
|---|---|
| Downloads | 146 (as reported by Hugging Face) |
| Likes | 1 |
| Created | 3 October 2025 |
| Last updated at source | 4 October 2025 |
More from AmanPriyanshu
- AmanPriyanshu/OR-Corpus-CopyDataset
- AmanPriyanshu/FSD-PT-PleIAs-SYNTH-15M-EN-NonMem-MemDataset
- AmanPriyanshu/tool-reasoning-sft-RESEARCH-openresearcher-dataset-sft-deep-research-agent-data-cleanedDataset
- AmanPriyanshu/rlvr-guru-raw-data-extendedDataset
- AmanPriyanshu/random-small-github-repositoriesDataset
- AmanPriyanshu/random-python-github-repositoriesDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.