SVHalluc: Benchmarking Speech-Vision Hallucination in Audio-Visual Large Language Models
Despite the success of audio-visual large-language models (LLMs), they can produce plausible but ungrounded outputs, termed hallucination. Existing benchmarks focus on environmental sounds (e.g., dog barking) to indicate event occurrence. In contrast, human speech carries fundamentally different, rich semantics and temporal structures, yet it remains unexplored whether current models can accurately align speech content with corresponding visual signals. In this work, we show that speech content can induce hallucinations in audio-visual LLMs. To systematically study this, we introduce SVHalluc, the first comprehensive benchmark for evaluating speech-vision hallucination in audio-visual LLM...
| Authors | Chenshuang Zhang, Kyeong Seon Kim, Chengxin Liu et al. |
|---|---|
| Primary category | eess.AS |
| Published | 31 May 2026 |
| Last updated at source | 31 May 2026 |
Connected in the knowledge graph
- zcs15/SVHallucDataset · cited by
Models and datasets referencing this paper
- zcs15/SVHallucDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.