RoboTalk: Learning Multi-Robot Communication and Coordination from Multimodal Demonstrations
Multi-robot collaboration could enable more efficient and scalable solutions to complex robotic tasks, but collaboration under partial observability remains challenging. Natural-language communication offers a promising approach to coordinating robots under partial observability. However, in decentralized manipulation, jointly learning explicit inter-robot communication and skill-level action selection from multimodal demonstrations remains underexplored for small vision-language models (VLMs) intended for on-device deployment. To address this gap, we introduce RoboTalk, a synthetic data-generation pipeline and dataset of 7,950 multimodal trajectories spanning 53 mobile-manipulation kitch...
| Authors | Dorian Benhamou Goldfajn, Mason Nakamura, Saaduddin Mahmud et al. |
|---|---|
| Primary category | cs.RO |
| Published | 21 September 2026 |
| Last updated at source | 8 October 2026 |
Connected in the knowledge graph
- DorianAtSchool/RoboTalkDataset · cited by
Models and datasets referencing this paper
- DorianAtSchool/RoboTalkDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.