Dataset · Hugging Face

nirmalendu01/abir177m-pretrain-balanced20-ezhijaru

Name: abir177m-pretrain-balanced20-ezhijaru
Creator: nirmalendu01
License: apache-2.0
Keywords: language:en, language:zh, language:hi, language:ja, language:ru, license:apache-2.0, size_categories:1M<n<10M, format:parquet, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, region:us, pretraining

abir177m pretrain mix — balanced20 en/zh/hi/ja/ru Frozen packed-token shards for reproducible abir177m GPT-2–style pretraining. Languages: 20% each en, zh, hi, ja, ru Source streams: FineWeb (en) + FineWeb-2 (zh/hi/ja/ru) Tokenizer: mistralai/Mistral-Nemo-Base-2407 Packing: 2048-token causal LM blocks (input_ids, labels identical) Target budget: 3.55B tokens (1,733k sequences) See meta.json for exact mixture + dataset map + seed.

View on Hugging FaceReport an issue

Author / organization	nirmalendu01
License (as declared)	apache-2.0
Downloads	174 (as reported by Hugging Face)
Likes	0
Created	22 August 2026
Last updated at source	23 August 2026

pretrainingcausal-lmfineweb

Embed this entry

<iframe src="https://silytics.si/embed/item/c4149afb-5b19-424c-94e1-26bf8992fda4" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

174 now (+27 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from nirmalendu01

nirmalendu01/animal_dataset_activationsDataset
nirmalendu01/hateXplain_filteredDataset
nirmalendu01/counterfactual_cultureDataset
nirmalendu01/amazon-reviews-2023-cf-pairs-multilingualDataset
nirmalendu01/visual_genomeDataset
nirmalendu01/noun-attributesDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.