Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?
Video generation models have made impressive strides in synthesizing visually compelling content, yet their outputs remain confined to the virtual domain. A natural question follows: how well do these models reflect the physical world when their generated videos leave the screen and enter reality? We propose robotic manipulation as a concrete, measurable window onto this question: if a model has truly internalized physical laws, the motion it depicts should translate into executable robot behavior. We introduce Dream$.$exe, an evaluation framework that operationalizes this criterion through a video-to-execution pipeline. Given a scene image and a task description, Dream$.$exe synthesizes ...
| Authors | Rui Zhao, Kaiming Yang, Jifeng Zhu et al. |
|---|---|
| Primary category | cs.CV |
| Published | 3 June 2026 |
| Last updated at source | 4 June 2026 |
Connected in the knowledge graph
- kaimingyang/Dream.exeDataset · cited by
Models and datasets referencing this paper
- kaimingyang/Dream.exeDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.