Sign inGet started
Dataset · Hugging Face

ks48/url-atlas

URL Atlas 257,548,097,528 URLs from 105 web corpora, each kept as its own separately-loadable config, plus the raw source dumps two of them were extracted from. 4.35 TiB across 52,244 files. This is the input side of a URL-compression corpus: every source reduced to its URL column and nothing else. It is deliberately not deduplicated or merged — sources are kept intact and overlapping so you can measure what each one contributes, pick the subset you want, and dedup on your own… See the full description on the dataset page: https://huggingface.co/datasets/ks48/url-atlas.

Author / organizationks48
License (as declared)other
Downloads3.1K (as reported by Hugging Face)
Likes0
Created21 August 2026
Last updated at source22 August 2026
urlswebcommon-crawlwikipediareddithacker-newssurt
Embed this entry
<iframe src="https://silytics.si/embed/item/6c776ea6-5a88-4b33-afe2-3df891c58d70" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

3,066 now (+4 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.