Birchlabs/c4-t5-ragged
C4, T5 tokenized, in ragged array format Processed distribution of Google's C4 dataset: a colossal, cleaned version of Common Crawl's web crawl corpus. Uses the text data from allenai/c4. Includes en subset only. T5 tokenizer was applied to the text.Distributed as a ragged array. Converted via json_to_ragged.py. Download size of all shards: Split Data+Lengths Size Divided across n Shards Typical shard size: data.npy Typical shard size: len.npy Train 293G 1024 344M… See the full description on the dataset page: https://huggingface.co/datasets/Birchlabs/c4-t5-ragged.
| Author / organization | Birchlabs |
|---|---|
| License (as declared) | odc-by |
| Downloads | 317 (as reported by Hugging Face) |
| Likes | 2 |
| Created | 14 February 2024 |
| Last updated at source | 16 February 2024 |
Popularity, last 3 days
317 now (-77 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: C4, T5 tokenized, in ragged array format Processed distribution of Google's C4 dataset: a colossal, cleaned version of Common Crawl's web crawl corpus. Uses the text data from allenai/c4. Includes en subset only. T5 tokenizer was applied to → C4, T5 tokenized, in ragged array format Processed distribution of Google's C4 dataset: a colossal, cleaned version of Common Crawl's web crawl corpus. Uses the text data from allenai/c4. Includes en subset only. T5 tokenizer was applied to
Changes detected by Silytics between refreshes of the source.
More from Birchlabs
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.