Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos
We present Audio-Visual Flamingo (AV-Flamingo), a fully open state-of-the-art audio-visual large language model (AV-LLM) for joint understanding and reasoning over audio, images, and long-form videos. Unlike prior AV-LLMs that primarily focus on short clips, AV-Flamingo is designed for understanding and reasoning over long and complex real-world (audio-visual) videos. To support this, we make three key contributions: (i) Audio-Visual-Skills, a large-scale collection of real-world videos with ~7M caption and question-answer training instances designed to emphasize temporal, compositional, and cross-modal audio-visual reasoning; (ii) a novel three-stage curriculum that progressively trains ...
| Authors | Sreyan Ghosh, Arushi Goel, Kaousheik Jayakumar et al. |
|---|---|
| Primary category | eess.AS |
| Published | 17 July 2026 |
| Last updated at source | 17 July 2026 |
Connected in the knowledge graph
- nvidia/av-skillsDataset · cited by
- nvidia/nemotron-labs-audio-visual-flamingo-hfModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.