Unverified50% confidenceFactExact time
Voxtral uses a 3-billion-parameter text model as its backbone and converts audio into continuous embeddings via an audio encoder that are fed directly into the decoder, which differs from Whisper's approach of feeding into the decoder via cross-attention.
1
Sources
50%
Confidence
Long-term
Relevance
10/3/2026
First Seen
Sources
Related Entities
Related Claims
Unverified声音克隆通过说话人编码器将声音映射为高维嵌入向量，说话人编码器训练通常采用对比学习或三元组损失77% similarUnverifiedWhisper audio is first converted into an 80-dimensional mel spectrogram, downsampled by convolutional layers, fed into the encoder to generate a feature sequence, and then decoded by the decoder to output text token by token in an autoregressive manner77% similarUnverifiedNative audio architectures perform self-attention computation directly on mel spectrograms or quantized audio encodings (such as the discrete audio tokens produced by EnCodec), thereby capturing prosody, emotion, and speaker identity information absent from text representations.76% similarVerifiedWhisper基于Transformer编码器-解码器架构，在68万小时的多语言标注音频数据上进行弱监督训练76% similarUnverified2022年OpenAI发布的Whisper证明了单一神经网络可以直接将音频映射为文字，绕开手工设计声学模型的传统路径76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/969741API
curl https://kongchang.com/api/v1/knowledge/claims/969741MCP
get_claim(id=969741)