Unverified50% confidenceFactExact time
The performance decline caused by 'lost in the middle' follows a U-shaped curve rather than linear decay; its mechanism may be related to Transformer attention allocation and positional encoding.
1
Sources
50%
Confidence
Long-term
Relevance
10/17/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe attention mechanism of the Transformer architecture significantly reduces its focus on early content when processing very long sequences, causing the model to forget earlier settings79% similarUnverifiedThe computational cost of the Transformer self-attention mechanism grows quadratically with context length, and the "Lost in the Middle" effect causes the model to extract information from the middle of the window less effectively than from the beginning and end.77% similarUnverifiedTransformer模型存在位置偏差，对中间位置信息的检索能力尤其薄弱，即lost in the middle问题75% similarUnverifiedTransformer 中任意两个位置之间的信息传递路径长度恒为1，从根本上克服了 RNN 在长序列上因梯度消失导致的遗忘问题73% similarUnverifiedTransformer models exhibit a "Lost in the Middle" phenomenon, where attention to content located in the middle of the context and far from the current generation position systematically decreases.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1052237API
curl https://kongchang.com/api/v1/knowledge/claims/1052237MCP
get_claim(id=1052237)