Dataset · Hugging Face

ASTERIZER/LUNA_PreTrain

Name: LUNA_PreTrain
Creator: ASTERIZER
License: cc-by-nc-nd-4.0
Keywords: language:en, license:cc-by-nc-nd-4.0, size_categories:100K<n<1M, format:json, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, pretraining, english, web-text, wikipedia, fineweb

Dataset Card for LUNA Pretraining Corpus A deduplicated, English-only, tokenized pretraining corpus — ~4.5B tokens in 270 ready-to-train litdata chunks — built for the LUNA-100M causal language model. This repository is the pretraining data engine for the LUNA model family. It ships the final training corpus (litdata_pretrain_final/, tokenized, deduplicated, directly consumable by a litdata TokensLoader), the human-readable intermediate corpus (english_1b_clean/), its tokenized… See the full description on the dataset page: https://huggingface.co/datasets/ASTERIZER/LUNA_PreTrain.

View on Hugging FaceReport an issue

Author / organization	ASTERIZER
License (as declared)	cc-by-nc-nd-4.0
Downloads	541 (as reported by Hugging Face)
Likes	0
Created	1 April 2026
Last updated at source	28 August 2026

pretrainingenglishweb-textwikipediafineweblitdatacausal-lm

Embed this entry

<iframe src="https://silytics.si/embed/item/52d424a9-d537-4754-8b47-baa4c9893444" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

541 now (+11 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from ASTERIZER

ASTERIZER/Ezaris-Training-SetsDataset
ASTERIZER/Ezaris-TokenizerDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.