Dataset · Hugging Face

yangwang92/dolma3_mix-150B-1025-merged-gemma4

Name: dolma3_mix-150B-1025-merged-gemma4
Creator: yangwang92
Keywords: size_categories:100B<n<1T, region:us, dolma, megatron, gemma4, pretraining

dolma3_mix-150B-1025-merged (Gemma4) Tokenized copy of the Dolma3 150B mix (dolma3_mix-150B-1025-merged) using the Gemma4 tokenizer. Format Megatron-LM indexed binaries: paired *_text_document.bin and *_text_document.idx files (448 files total, ~616 GiB). These are not Hugging Face datasets Arrow/Parquet shards. Load them with Megatron / Megatron-LM indexed dataset readers. Source name Local / blob name: dolma3_mix-150B-1025-merged-gemma4

View on Hugging FaceReport an issue

Author / organization	yangwang92
Downloads	499 (as reported by Hugging Face)
Likes	0
Created	13 August 2026
Last updated at source	13 August 2026

dolmamegatrongemma4pretraining

Embed this entry

<iframe src="https://silytics.si/embed/item/219b3d4b-0136-43cb-956a-81704fc4c460" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

499 now (+51 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from yangwang92

yangwang92/dolma3-500B-cleanDataset
yangwang92/dolma3_mix-150B-1025-merged-olmo3Dataset
yangwang92/dolma3-2TDataset
yangwang92/Dolci-Think-SFT-7B-q35instructDataset
yangwang92/dolma3_longmino_mix-100B-1125-q35baseDataset
yangwang92/dolma3_dolmino_mix-100B-1125-ingredient1-q35baseDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.