Dataset · Hugging Face

shreyansh12183/shreyansh-1B-SLM-pretrain-stem-english

Name: shreyansh-1B-SLM-pretrain-stem-english
Creator: shreyansh12183
License: cc-by-nc-4.0
Keywords: task_categories:text-generation, language:en, license:cc-by-nc-4.0, size_categories:10M<n<100M, format:parquet, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, region:us, pretraining, continual-pretraining, cpt-healing, slm

📚 Vigyan Pretrain Corpus: 13GB Web-Scale Scientific & Technical Text (CPT Healing Corpus) The Vigyan Pretrain Corpus is a web-scale, curated raw text pre-training dataset comprising 13.14 GB of high-density STEM literature, textbooks, open-access research papers, and technical documentation across 2,400+ partitioned Parquet shards. 🔬 Architectural Role in Continual Pre-Training (CPT) Healing This corpus served as the foundational Continual Pre-Training (CPT)… See the full description on the dataset page: https://huggingface.co/datasets/shreyansh12183/shreyansh-1B-SLM-pretrain-stem-english.

View on Hugging FaceReport an issue

Author / organization	shreyansh12183
License (as declared)	cc-by-nc-4.0
Downloads	420 (as reported by Hugging Face)
Likes	0
Created	1 September 2026
Last updated at source	6 October 2026

pretrainingcontinual-pretrainingcpt-healingslmstemphysicschemistrymathematicscomputer-science

Embed this entry

<iframe src="https://silytics.si/embed/item/fd6a3406-ae36-4485-bc48-08a38871d0aa" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 2 days

420 now. Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.