UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating
Generating a coherent multi-shot video requires structured cross-shot memory. Subject appearance, scene context, and speaker identity must persist across cuts. Existing approaches either train end-to-end over fixed-length sequences and cannot scale, generate shot-by-shot with memory banks that grow linearly, or orchestrate pretrained generators under an LLM planner without a multi-shot-aware backbone. We present UnityShots, a memory-driven multi-shot audio-video generation system built on LTX-2.3, trained on annotated cinematic and music-video shots. The video stream maintains two fixed-size slots, a long-term memory (LTM) slot anchored to the opening shot and a short-term memory (STM) sl...
| Authors | Jiehui Huang, Yuechen Zhang, Bin Xia et al. |
|---|---|
| Primary category | cs.CV |
| Published | 19 June 2026 |
| Last updated at source | 19 June 2026 |
Connected in the knowledge graph
- zxc0135/UnityShotsBenchDataset · cited by
- KlingTeam/UnityShotsBenchDataset · cited by
Models and datasets referencing this paper
- KlingTeam/UnityShotsBenchDataset
- zxc0135/UnityShotsBenchDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.