Unverified50% confidenceFactExact time
Prompt drift refers to the phenomenon in which model behavior gradually deviates from the original intent of instructions during long conversations or complex tasks, and is related to the dilution of Transformer attention weights as sequence length increases.
1
Sources
50%
Confidence
Long-term
Relevance
7/19/2026
First Seen
Sources
Related Claims
UnverifiedMassachusetts Institute of Technology researchers found that the behavior pattern of the Transformer attention mechanism when processing few-shot examples is similar to that of a gradient descent optimizer76% similarUnverifiedDecision Transformer通过自注意力机制直接建模跨越大时间跨度的因果关系，处理超长时序依赖75% similarVerifiedThe attention mechanism of Transformers lacks an error-correction loop that dynamically iterates over time, which is the fundamental divide between it and biological attention mechanisms.72% similarUnverifiedThe Transformer architecture has a "Lost in the Middle" effect, where the model retains content from the beginning and end of a conversation well, but tends to lose the middle portion.72% similarVerifiedIn the Transformer architecture, the tokens of system instructions are placed at the very front of the attention mechanism, exerting a continuous constraining influence on all subsequently generated content.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/561651API
curl https://kongchang.com/api/v1/knowledge/claims/561651MCP
get_claim(id=561651)