Multiplayer Interactive World Models with Representation Autoencoders
We introduce the first multiplayer world model for highly dynamic environments governed by complex physical interactions. Whereas single-player world models treat the other agents as part of the environment, ours conditions on the action streams of multiple agents, learning to attribute changes in the scene to the correct player and to stay coherent under arbitrary combinations of their actions. We study this problem in the game of Rocket League, where players compete and cooperate under fast, tightly coupled dynamics. Trained on 10,000 hours of gameplay collected with publicly available bots, our 5-billion-parameter latent diffusion model generates four-player matches in real time, produ...
| Authors | Anthony Hu, Václav Volhejn, Adrien Ramanana Rahary et al. |
|---|---|
| Primary category | cs.CV |
| Published | 6 July 2026 |
| Last updated at source | 7 July 2026 |
Connected in the knowledge graph
- kyutai/rocket-scienceDataset · cited by
Models and datasets referencing this paper
- kyutai/rocket-scienceDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.