VocalGrad: Evaluating Acoustic Perception in Audio Language Models
Reveals fundamental limitations in current audio AI architectures that researchers need to address.
AI Summary
Researchers introduce VocalGrad showing audio language models perform near chance levels on acoustic perception tasks where humans excel.
Excerpt
Recent large audio language models (LALMs) have extended their capabilities beyond lexical speech understanding to tasks requiring paralinguistic and non-linguistic audio understanding, such as emotion recognition. However, these models still struggle to reliably utilize acoustic information, particularly when it co-occurs with spoken linguistic content. Existing benchmarks do not clearly distinguish acoustic perception from higher-level reasoning, making it difficult to identify the source of t
