Expired50% confidenceFactExact time
The quality of long-context understanding in small models degrades rapidly with length, typically deteriorating after exceeding a 4K–8K token window.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/16/2026
First Seen
Valid until: 10/14/2026(expired)
Sources
Related Claims
Unverified早期模型上下文窗口较小（4K–8K Token），长任务中较早的指令和中间状态会被挤出窗口导致遗忘77% similarUnverifiedEven for large models that support 128K tokens, attention decay is a practical concern in actual use—the model's attention to information in the middle of the window is significantly lower than at the beginning and end.75% similarUnverifiedLow-end AI models have smaller context windows, potentially only 8K–32K tokens, which prevents them from fully understanding the complete logic of existing features when modifying new ones, resulting in regression defects.74% similarUnverified研究发现位于上下文首尾的信息被模型召回的概率远高于中间位置，衰减在上下文长度超过4K token后急剧加速72% similarUnverified研究发现Lost in the Middle衰减在上下文长度超过4K token后急剧加速66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/530577API
curl https://kongchang.com/api/v1/knowledge/claims/530577MCP
get_claim(id=530577)