andersonbcdefg/PD-3M-Tokenized-Cosmos-Tokenizer-DI8x8

I can't get the dataset viewer to work, sorry. There's about 3M images and captions from Spawning/PD3M. They are resized and center-cropped to 512x512, and then tokenized into discrete tokens with NVIDIA Cosmos-Tokenizer-DI8x8, which reduces the spatial dimension by a factor of 8, resulting in 64 x 64 = 4096 discrete tokens per image. You can use these tokenized images to train an auto-regressive image model, or a MaskGIT. Or probably other things I don't know about. :) License is the same… See the full description on the dataset page: https://huggingface.co/datasets/andersonbcdefg/PD-3M-Token

<iframe src="https://silytics.si/embed/item/e86ccd7f-8a60-483a-8a8c-c0e641fcd796" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.