Verified70% confidenceFactExact time
Cross-encoders are more accurate than bi-encoders because they concatenate [query, doc] and feed it into a Transformer, letting the attention mechanism compare directly at the word level, but they cannot pre-build an index and can only be used for fine ranking.
4
Sources
70%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe decoder adds two mechanisms on top of the encoder: masked self-attention and cross-attention; masked self-attention ensures that during generation only previously produced tokens can be seen, while cross-attention allows the decoder to query the encoder's output.80% similarVerifiedRerankers are typically implemented using cross-encoders, which concatenate the query and document and feed them jointly into a Transformer model, achieving significantly higher ranking precision than the initial retrieval stage80% similarUnverifiedA cross-encoder concatenates two texts as input to a Transformer and captures precise matching signals through self-attention, but its computational cost is hundreds of times that of a bi-encoder.77% similarUnverified自注意力本身对顺序不敏感，打乱词语顺序注意力权重计算结果相同，因此需要引入位置编码；原始Transformer论文使用正余弦函数编码77% similarVerifiedA Cross-Encoder concatenates a query with each candidate document and feeds them jointly into the same model, capturing word-level interactions through the attention mechanism; its ranking precision is superior to vector similarity, but latency grows linearly with the size of the candidate set.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1011859API
curl https://kongchang.com/api/v1/knowledge/claims/1011859MCP
get_claim(id=1011859)