Dataset · Hugging Face

l1997i/website_crawl_0924

Name: website_crawl_0924
Creator: l1997i
License: other
Keywords: license:other, region:us, web-crawl, common-crawl, html, images

website_crawl_0924 Pages and images of 61 catalog websites (40 topic categories), collected live from the sites' public origins. Candidate URLs are the sites' complete Common Crawl URL inventories (all 128 collections, legacy index_all selection) plus links discovered on saved pages. Every saved page has: raw/<key>.origin.html.gz — the HTML exactly as served (gzip). pages/<key>.html.gz — a passive, cleaned HTML rendition (no scripts, styles or forms; ordered media), with the… See the full description on the dataset page: https://huggingface.co/datasets/l1997i/website_crawl_0924.

View on Hugging FaceReport an issue

Author / organization	l1997i
License (as declared)	other
Downloads	4.5K (as reported by Hugging Face)
Likes	0
Created	26 September 2026
Last updated at source	5 October 2026

web-crawlcommon-crawlhtmlimages

Embed this entry

<iframe src="https://silytics.si/embed/item/f838c05e-194f-40f8-aae7-5dbd7832fb55" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

4,486 now (+15 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from l1997i

l1997i/DurLAR_SDataset
l1997i/DurLARDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.