abhiram98/paramgolf-mix-8b
paramgolf-mix-8b An 8B-token, cross-source-deduplicated pretraining mixture for OpenAI's Parameter Golf tiny-LM challenge. Built to test whether adding code + math to a FineWeb-edu base moves Δbpb on the official FineWeb validation split at the ~30M-param / 8B-token regime. Shards are in the trainer's native .bin format (256×int32 header [magic=20240520, version=1, num_tokens] + uint16 LE tokens, 10^8 tokens/shard), directly consumable by the reference train_gpt.py.… See the full description on the dataset page: https://huggingface.co/datasets/abhiram98/paramgolf-mix-8b.
| Author / organization | abhiram98 |
|---|---|
| License (as declared) | other |
| Downloads | 643 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 19 June 2026 |
| Last updated at source | 22 June 2026 |
Popularity, last 3 days
643 now (-1 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.