marin-community/grug-moe-mix-swarm
Grug-MoE Data-Mix Experiments The default config contains the original 840-run Fisher-DSP swarm. The harrier_18t75_d768 config contains the Harrier experiments described below. Fisher-DSP swarm (default) 840 MoE pretraining runs from the Grug-MoE Fisher-DSP data-mixing swarm (d512, TPU / us-central2). Each run trains on a distinct data mixture over 168 datakit buckets; the swarm is used to regress mixture weights → eval loss and predict an optimized pretraining… See the full description on the dataset page: https://huggingface.co/datasets/marin-community/grug-moe-mix-swarm.
| Author / organization | marin-community |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 274 (as reported by Hugging Face) |
| Likes | 1 |
| Created | 10 July 2026 |
| Last updated at source | 12 September 2026 |
Popularity, last 4 days
274 now (-33 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from marin-community
- marin-community/swe-rebench-v2-CodeWorldModelingDataset
- marin-community/fineweb-edu-pretokenized-10KDataset
- marin-community/open-thoughts-4-30k-math-qwen3-32b-annotated-32768-tokens-n8-reformatted-selfconsistencyDataset
- marin-community/ar5iv-no-problem-markdownDataset
- marin-community/stackexchange-markdownDataset
- marin-community/mcp-atlas-easyDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.