ScaleNav: Scalable Internet Video Pretraining for Language-Conditioned Local Navigation
We study language-conditioned local navigation, where a robot must navigate to a text-specified target visible in its initial observation and stop at the described location. End-to-end navigation policies require diverse training data to generalize across scenes, yet real-robot data is costly to collect and simulated data leaves a sim-to-real gap. Internet egocentric videos offer a scalable source of real-world navigation experience. Our key insight is to learn goal-directed visual dynamics from Internet egocentric videos, and use these dynamics to support robot action generation. To this end, we propose ScaleNav, a unified world-action framework with three-stage training. We first perform i
| Authors | Yihui Yang, Yuanhong Yu, Jiawei Wang et al. |
|---|---|
| Primary category | |
| Published | 19 October 2026 |
| Last updated at source | — |
Connected in the knowledge graph
- Yangyihui/ScaleNav-DataDataset · cited by
Models and datasets referencing this paper
- Yangyihui/ScaleNav-DataDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.