Dataset · Hugging Face

ashtok897/indic-hplt-v2

Name: indic-hplt-v2
Creator: ashtok897
License: cc0-1.0
Keywords: task_categories:text-generation, task_categories:fill-mask, source_datasets:hplt-project/hplt_monolingual_v3, language:hi, language:bn, language:ta, language:te, language:mr, language:gu, language:kn, language:ml, language:pa, language:ur, language:ne, language:or

Indic HPLT v2 A multilingual pretraining corpus of 34,605,630 documents (~25.5B estimated tokens, ~218 GB raw JSONL) across 13 Indic languages and English, built from HPLT Monolingual v3 high-quality web crawl data. This is the larger successor to Indic HPLT v1 (9.8M docs, 11 languages). Compared to v1, this release adds 3 new Indic languages (Nepali, Odia, Assamese) and ~3.5× more documents overall. Quick Start from datasets import load_dataset # Full training… See the full description on the dataset page: https://huggingface.co/datasets/ashtok897/indic-hplt-v2.

View on Hugging FaceReport an issue

Author / organization	ashtok897
License (as declared)	cc0-1.0
Downloads	1.1K (as reported by Hugging Face)
Likes	3
Created	19 May 2026
Last updated at source	9 June 2026

indicmultilingualpretraininghplt

Embed this entry

<iframe src="https://silytics.si/embed/item/f0a9b8cf-4796-4855-94f4-7cd36e8c446b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

1,105 now (-23 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from ashtok897

ashtok897/indic-hplt-v1Dataset
ashtok897/european-hplt-v1Dataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.