Dataset · Hugging Face

wayu-ai/thai-commoncrawl-index

Name: thai-commoncrawl-index
Creator: wayu-ai
License: odc-by
Keywords: language:th, license:odc-by, size_categories:100M<n<1B, format:parquet, modality:tabular, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, region:us, common-crawl, thai, web, index

Thai Common Crawl Index (2019–2026) An index of every page Common Crawl detected as Thai across 70 monthly crawls, from January 2019 (CC-MAIN-2019-04) to August 2026 (CC-MAIN-2026-30). 932,874,727 page captures · 450,971,497 unique URLs · 6,997,185 hosts · 6,674,969 domains Each row records where the page lives inside Common Crawl's WARC archives — file name, byte offset, and record length — so you can fetch exactly the pages you want with HTTP range requests, without scanning… See the full description on the dataset page: https://huggingface.co/datasets/wayu-ai/thai-commoncrawl-index.

View on Hugging FaceReport an issue

Author / organization	wayu-ai
License (as declared)	odc-by
Downloads	5.4K (as reported by Hugging Face)
Likes	1
Created	23 August 2026
Last updated at source	23 August 2026

common-crawlthaiwebindexmetadatacorpus-construction

Embed this entry

<iframe src="https://silytics.si/embed/item/72f45153-bb43-4689-93a9-d93f79fdd540" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 4 days

5,429 now (+2,720 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from wayu-ai

wayu-ai/thai-aligner-benchDataset
wayu-ai/thai-contextasr-benchDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.