InstructAV2AV: Instruction-Guided Audio-Video Joint Editing
Recent diffusion-based methods have achieved impressive progress in video content manipulation. However, they typically ignore the accompanying audio, leaving the audio disjointed from the edited results. In this paper, we propose InstructAV2AV, the first end-to-end framework for instruction-guided audio-video joint editing. We first develop a scalable data synthesis pipeline and construct InsAVE-80K, the first large-scale audio-video editing dataset with high-quality source-to-target pairs. With this data foundation, we adapt an audio-video generation backbone to leverage its robust priors. We concatenate the audio-video input with noisy latent codes to anchor the source context, propose...
| Authors | Haojie Zheng, Yixin Yang, Siqi Yang et al. |
|---|---|
| Primary category | cs.CV |
| Published | 18 May 2026 |
| Last updated at source | 18 May 2026 |
Connected in the knowledge graph
- suimu/InsAVE-80KDataset · cited by
Models and datasets referencing this paper
- suimu/InsAVE-80KDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.