Dataset · Hugging Face

PatrickHaller/cc-html-tokens-qwen3

Name: cc-html-tokens-qwen3
Creator: PatrickHaller
License: cc-by-4.0
Keywords: task_categories:text-generation, language:en, license:cc-by-4.0, size_categories:n<1K, format:json, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us

CommonCrawl HTML, tokenised Packed token ids for language-model pretraining on raw web markup (not extracted text). tokens 15.18B shards 77 tokenizer Qwen/Qwen3-0.6B dtype uint32, flat, no header document separator EOS token id preprocessing light HTML clean (scripts/styles stripped), capped at 32,768 tokens/page Shards are not uniform in size: 00000-00047 hold ~92M tokens each (8k pages per source WARC file), 00048 onward hold ~370M each (29k pages… See the full description on the dataset page: https://huggingface.co/datasets/PatrickHaller/cc-html-tokens-qwen3.

View on Hugging FaceReport an issue

Author / organization	PatrickHaller
License (as declared)	cc-by-4.0
Downloads	141 (as reported by Hugging Face)
Likes	0
Created	29 September 2026
Last updated at source	29 September 2026

Embed this entry

<iframe src="https://silytics.si/embed/item/0ed10b08-3579-4918-912b-e62116d1325a" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 4 days

141 now. Counts as reported by the source, snapshotted daily by Silytics.

More from PatrickHaller

PatrickHaller/fineweb-5BDataset
PatrickHaller/fineweb-10BDataset
PatrickHaller/the-stack-python-1MDataset
PatrickHaller/fineweb-edu-3BDataset
PatrickHaller/fineweb-edu-plusDataset
PatrickHaller/peccDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.