EssentialAI/essential-web-v1.0
π Essential-Web: Complete 24-Trillion Token Dataset π Website | π₯οΈ Code | π Paper | βοΈ AWS π Dataset Description Essential-Web is a 24-trillion-token web dataset with document-level metadata designed for flexible dataset curation. The dataset provides metadata including subject matter classification, web page type, content complexity, and document quality scores for each of the 23.6 billion documents. Researchers can filter and curate specialized datasetsβ¦ See the full description on the dataset page: https://huggingface.co/datasets/EssentialAI/essential-web-v1.0.
| Author / organization | EssentialAI |
|---|---|
| License (as declared) | odc-by |
| Downloads | 141.7K (as reported by Hugging Face) |
| Likes | 250 |
| Created | 17 June 2025 |
| Last updated at source | 2 October 2025 |
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 14 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.