Unverified50% confidenceFactExact time
当前主流LLM采用Transformer架构，随着上下文长度增加会出现对早期信息的注意力衰减现象
1
Sources
50%
Confidence
Long-term
Relevance
7/17/2026
First Seen
Sources
Related Claims
UnverifiedLLM在长序列生成中因注意力稀释而遗忘之前约束的现象被称为「长上下文遗忘（Lost in the Middle）」，是当前Transformer架构的固有局限81% similarVerifiedThe attention mechanism of the Transformer architecture significantly reduces its focus on early content when processing very long sequences, causing the model to forget earlier settings79% similarUnverifiedLLMs maintain higher sensitivity to information at the beginning and end of the context, while exhibiting an 'attention decay' phenomenon for information in the middle positions73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/545009API
curl https://kongchang.com/api/v1/knowledge/claims/545009MCP
get_claim(id=545009)