Unverified50% confidenceFactExact time
Cross-modal misalignment refers to the model incorrectly binding audio information to visual information, for example A is speaking in the picture but it is B who is vocalizing in the audio, yet the model describes A as speaking.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedExperiments spanning vision models and speech models yield a consistent conclusion: when an image or audio recording is placed after conflicting text, the model's answer shifts noticeably toward the image/speech content.71% similarUnverifiedAccents, background noise, and ambiguous expressions in voicemails can affect transcription quality and in turn lead to inaccurate AI summaries.69% similarUnverified端到端音频模型可能在音频层面产生幻觉，即生成训练数据中存在但与当前语境无关的音频片段69% similarVerifiedFor voice agents, multimodal large models must support not only voice, images, text, and video as inputs, but also voice as output.68% similarUnverified本地化语音识别需要在模型体积与识别精度之间做取舍，WER数字需结合具体场景解读，真实场景中的口语化表达、噪音、口音、领域术语会拉大不同模型的性能差距68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1012776API
curl https://kongchang.com/api/v1/knowledge/claims/1012776MCP
get_claim(id=1012776)