Dataset · Hugging Face

Kiy-K/pretraining-corpus

Name: pretraining-corpus
Creator: Kiy-K
License: apache-2.0
Keywords: task_categories:text-generation, language:en, license:apache-2.0, size_categories:10K<n<100K, format:parquet, format:optimized-parquet, modality:tabular, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, doi:10.57967/hf/7147, region:us, synthetic

🧠 Kiy-K Synthetic Pretraining Corpus Author: Khoi K. (@Kiy-K)License: Apache 2.0Last Updated: 2025-10-30 📘 Overview The Kiy-K Synthetic Pretraining Corpus is a large-scale collection of synthetically generated English text designed for language model pretraining and instruction-tuning research. All data is synthetic, created using open-source large language models such as GPT-OSS, NVIDIA Nemotron, and DeepSeek, under full control of the author.No real user… See the full description on the dataset page: https://huggingface.co/datasets/Kiy-K/pretraining-corpus.

View on Hugging FaceReport an issue

Author / organization	Kiy-K
License (as declared)	apache-2.0
Downloads	236 (as reported by Hugging Face)
Likes	3
Created	30 October 2025
Last updated at source	5 December 2025

syntheticainlppretrainingdatasettextopen-source

Embed this entry

<iframe src="https://silytics.si/embed/item/71f55216-9117-4a9d-9683-5941e5d800d8" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 2 days

236 now (-9 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.