sunnysetia/locus-pretrain-documents-public

Locus pretraining: documents public Setup only. No corpus release has been published and no canary has been run for this format. This repository will hold versioned indexed token artifacts. Tokens are little-endian int32 binary arrays; signed int64 offsets identify complete documents or unpadded pieces. Loss masks are bit-packed, with Parquet indexes and provenance sidecars. Training packs pieces using RSDB. Only a complete, verified manifest pinned to an immutable commit… See the full description on the dataset page: https://huggingface.co/datasets/sunnysetia/locus-pretrain-documents-public.

<iframe src="https://silytics.si/embed/item/38726cbe-bdf2-4576-b976-6c0fd05f0804" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 7 November 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.