Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence
Despite the recent promise in robot control, video generative models suffer from a domain mismatch due to their primary focus on content creation. For example, their design inherently prioritizes visual fidelity and creativity over computational efficiency and physical realism. In this work, we present LingBot-Video, a DiT-based video pretraining paradigm specifically tailored for embodied intelligence. From the architecture perspective, we adopt the Mixture-of-Experts (MoE), instead of dense, framework to achieve a better trade-off between modeling capacity and inference efficiency, and manage to scale it up from scratch. From the data perspective, we construct a data profiling engine th...
| Authors | Shuailei Ma, Jiaqi Liao, Xinyang Wang et al. |
|---|---|
| Primary category | cs.CV |
| Published | 8 July 2026 |
| Last updated at source | 8 July 2026 |
Popularity, last 2 days
0 now. Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- cy0307/awesome-egocentric-atlasDataset · cited by
- introvoyz042/awesome-egocentric-atlasDataset · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.