Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatory
AlltoAll dispatch is the dominant bottleneck of MoE expert parallelism, and the interconnect community has responded with four families of mitigations: predictive sample placement, adaptive expert relayout, hierarchical collectives, and EP-aware topology. All four rest on two assumptions about the workload: that routing imbalance is correctable by the system layer, and that the mock-token benchmarks evaluating them faithfully represent production routing. We introduce DODOCO to test both, instrumenting five open MoE checkpoints that span today's sequence-mixer designs (MHA, MLA, GQA, Gated DeltaNet and Mamba-2 SSM) under a factorial grid of six data conditions and a matched expert-paralle...
| Authors | Bole Ma, Jan Eitzinger, Harald Koestler et al. |
|---|---|
| Primary category | cs.DC |
| Published | 20 May 2026 |
| Last updated at source | 17 July 2026 |
Connected in the knowledge graph
- bahnland/dodoco-routing-matricesDataset · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.