alexkstern/fineweb-nanochatbpe-100M
fineweb-nanochatbpe-100M FineWeb-Edu (from karpathy/fineweb-edu-100b-shuffle), pre-tokenized with the nanochatbpe tokenizer (vocab 65,536) and packaged as flat uint16 token-id .bin files for fast memmap training. This is a 100-million-token slice for data-constrained experiments. The train.bin is the byte-exact first 100,000,000 tokens (bytes [0, 200000000)) of the parent alexkstern/fineweb-nanochatbpe-20B train.bin. The val.bin is byte-identical to the parent's val.bin.… See the full description on the dataset page: https://huggingface.co/datasets/alexkstern/fineweb-nanochatbpe-100M.
| Author / organization | alexkstern |
|---|---|
| Downloads | 213 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 3 July 2026 |
| Last updated at source | 3 July 2026 |
Popularity, last 3 days
213 now. Counts as reported by the source, snapshotted daily by Silytics.
More from alexkstern
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.