CMU-FLAME/FLAME-MoE-Traces
FLAME-MoE Routing Traces Routing traces captured during pretraining of FLAME-MoE Mixture-of-Experts language models. For each token processed by the model, these traces record which experts the router selected (top-k expert IDs) and the corresponding gating probabilities (router softmax scores). Architecture Model Params (Active/Total) Transformer Layers MoE Layers Routed Experts Shared Experts Top-k FLAME-MoE-290M 290M / 1.3B 9 8 (layers 2-9) 64 2 6 FLAME-MoE-721M… See the full description on the dataset page: https://huggingface.co/datasets/CMU-FLAME/FLAME-MoE-Traces.
| Author / organization | CMU-FLAME |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 827 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 9 October 2025 |
| Last updated at source | 30 March 2026 |
Recent changes
- 16 Oct 2026 Description: FLAME-MoE Routing Traces Routing traces captured during pretraining of FLAME-MoE Mixture-of-Experts language models. For each token processed by the model, these traces record which experts the router selected (top-k expert IDs) and the cor → FLAME-MoE Routing Traces Routing traces captured during pretraining of FLAME-MoE Mixture-of-Experts language models. For each token processed by the model, these traces record which experts the router selected (top-k expert IDs) and the cor
Changes detected by Silytics between refreshes of the source.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.