Benchmark
MMSU
An audio understanding benchmark that evaluates a model's ability to select the correct answer from multiple options, assessing comprehension of audio content across varied tasks through multiple-choice evaluation.
Timeline (last 90 days)
Oct 16
Qwen-Audio-Jev achieves a CHOICE accuracy of 84.06% on MMSU.
Unverified50%