Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States
We propose Puffin-World, a unified multimodal architecture that integrates physical understanding, spatial simulation, and 3D world generation and reconstruction without relying on external offline modules. To reliably construct and interact with 3D worlds, our framework jointly models three native world states: physics (gravity field and latitude), geometry (depth), and appearance (image), together with a unified Omni-Camera representation that supports diverse tasks and flexible motions. Beyond modeling these states, we introduce a strategy for propagating physical dynamics across future frames. By grounding absolute camera properties in the real world, Puffin-World enables physically c...
| Authors | Kang Liao, Yihang Luo, Xiao-Ming Wu et al. |
|---|---|
| Primary category | cs.CV |
| Published | 3 September 2026 |
| Last updated at source | 3 September 2026 |
Connected in the knowledge graph
- KangLiao/Objects365-CameraDataset · cited by
- KangLiao/EgoObjects-CameraDataset · cited by
- KangLiao/RealEstate10K-Absolute-CameraDataset · cited by
- KangLiao/Open-Images-CameraDataset · cited by
- ACERobotics/Puffin-16MDataset · cited by
- KangLiao/ImageNet-1K-CameraDataset · cited by
- KangLiao/InteriorVerse-CameraDataset · cited by
- KangLiao/CC12M-CameraDataset · cited by
- KangLiao/IRS-CameraDataset · cited by
- KangLiao/COCO-CameraDataset · cited by
- KangLiao/ScanNet-Absolute-CameraDataset · cited by
- KangLiao/Rexverse-2M-CameraDataset · cited by
- KangLiao/MVS-Synth-Absolute-CameraDataset · cited by
- KangLiao/GPIC-CameraDataset · cited by
- KangLiao/HyperSim-Absolute-CameraDataset · cited by
- KangLiao/Megalith-10M-CameraDataset · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.