ZhuofengLi/fineweb-edu-pretokenized-llama3-100b
FineWeb-Edu Pretokenized with Llama 3.1 (100B) This repository contains the sample/100BT subset of FineWeb-Edu, pretokenized for Megatron-LM-style training with meta-llama/Meta-Llama-3.1-8B. It is a derived, pretokenized version of the upstream data, not an official Hugging Face FineWeb release. Dataset summary 140 indexed shards 97,270,686 non-empty documents 97,458,793,013 tokens English web text from FineWeb-Edu sample/100BT Source dataset revision:… See the full description on the dataset page: https://huggingface.co/datasets/ZhuofengLi/fineweb-edu-pretokenized-llama3-100b.
| Author / organization | ZhuofengLi |
|---|---|
| License (as declared) | odc-by |
| Downloads | 504 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 21 July 2026 |
| Last updated at source | 21 July 2026 |
Popularity, last 4 days
504 now (+62 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from ZhuofengLi
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.