BlackwoodAI/pretrain-shards
Pretrain shards Pre-tokenized shards for pretraining. License: CC BY-NC 4.0 — non-commercial only. Format *.bin: uint32 little-endian token IDs *.json: per-shard sidecar with doc_lengths[] and stats Layout code/ shard_NNNNNN.bin + .json text/ shard_NNNNNN.bin + .json math/ shard_NNNNNN.bin + .json Usage from huggingface_hub import snapshot_download path = snapshot_download( repo_id="BlackwoodAI/pretrain-shards"… See the full description on the dataset page: https://huggingface.co/datasets/BlackwoodAI/pretrain-shards.
| Author / organization | BlackwoodAI |
|---|---|
| License (as declared) | cc-by-nc-4.0 |
| Downloads | 184 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 7 May 2026 |
| Last updated at source | 12 May 2026 |
Popularity, last 3 days
184 now. Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: Pretrain shards Pre-tokenized shards for pretraining. License: CC BY-NC 4.0 — non-commercial only. Format *.bin: uint32 little-endian token IDs *.json: per-shard sidecar with doc_lengths[] and stats Layout code/ shard_NNNNNN.bin + .json tex → Pretrain shards Pre-tokenized shards for pretraining. License: CC BY-NC 4.0 — non-commercial only. Format *.bin: uint32 little-endian token IDs *.json: per-shard sidecar with doc_lengths[] and stats Layout code/ shard_NNNNNN.bin + .json tex
Changes detected by Silytics between refreshes of the source.
More from BlackwoodAI
- BlackwoodAI/cybergymDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.