Dataset · Hugging Face

sinatras/fineweb10B-llama3

Name: fineweb10B-llama3
Creator: sinatras
License: mit
Keywords: task_categories:text-generation, license:mit, size_categories:10M<n<100M, region:us

FineWeb Dataset tokenized with LLaMA-3.2-1B tokenizer This dataset contains the FineWeb dataset preprocessed and tokenized using the LLaMA-3.2-1B tokenizer. Each .bin file contains: A header of 256 int32 values Token data as uint32 values File format version: 2 Dataset structure: fineweb_train_*.bin: Training shards fineweb_val_*.bin: Validation shard

View on Hugging FaceReport an issue

Author / organization	sinatras
License (as declared)	mit
Downloads	123 (as reported by Hugging Face)
Likes	0
Created	30 November 2024
Last updated at source	30 November 2024

Embed this entry

<iframe src="https://silytics.si/embed/item/8a1c704e-2210-4a39-b4e0-070796a9ee59" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.