nikolina-p/gutenberg_flat
Dataset Card for Project Gutenberg (Cleaned English Subset, Tokenized) Dataset A cleaned and tokenized English-language subset of the Project Gutenberg dataset containing 38,026 books. Non-English texts, duplicates, and boilerplate license sections were removed for clarity and usability. The dataset was tokenized using the OpenAI's tiktoken tokenizer, and structured for efficient streaming and distributed (DDP) training — the number of shards per split is divisible by 8, each… See the full description on the dataset page: https://huggingface.co/datasets/nikolina-p/gutenberg_flat.
| Author / organization | nikolina-p |
|---|---|
| Downloads | 256 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 17 October 2025 |
| Last updated at source | 20 October 2025 |
More from nikolina-p
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.