Cross-Attention
An attention mechanism that operates between two different sequences, where queries come from one sequence and keys and values come from another. It was originally designed for encoder-decoder translation tasks.
Timeline (last 90 days)
Cross-Attention occurs between two different sequences, where queries come from one sequence and keys and values come from another, and it was originally designed for encoder-decoder translation tasks.
The cross-attention mechanism originates from the Transformer architecture, allowing the queries of one sequence to retrieve the key-value pairs of another sequence, making it suitable for dual-source fusion scenarios.
In the Transformer architecture, cross-attention is the standard mechanism for fusing multi-source information, with current examination features serving as queries and historical examination features serving as keys and values.
Cross-attention fusion tends to outperform simple concatenation because it preserves flexible cross-modal interaction capabilities.
现代VLM通常采用对比学习或交叉注意力机制来建立视觉token和文本token之间的对应关系
All Facts (5)
Cross-Attention occurs between two different sequences, where queries come from one sequence and keys and values come from another, and it was originally designed for encoder-decoder translation tasks.
50%UnverifiedThe cross-attention mechanism originates from the Transformer architecture, allowing the queries of one sequence to retrieve the key-value pairs of another sequence, making it suitable for dual-source fusion scenarios.
50%UnverifiedIn the Transformer architecture, cross-attention is the standard mechanism for fusing multi-source information, with current examination features serving as queries and historical examination features serving as keys and values.
50%UnverifiedCross-attention fusion tends to outperform simple concatenation because it preserves flexible cross-modal interaction capabilities.
50%Unverified现代VLM通常采用对比学习或交叉注意力机制来建立视觉token和文本token之间的对应关系
50%