Unverified50% confidenceFactExact time
The attention score of key evidence has an upper bound, while the maximum score among all effective distractors grows as the number of distractors increases.
1
Sources
50%
Confidence
Long-term
Relevance
9/22/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTALON's performance further improves as the number of available prior examinations increases.73% similarUnverifiedAs the number of model layers increases, the parameter share of Attention and FFN rises significantly while the share of Embedding gradually decreases71% similarUnverifiedThe paper abstracts the context degradation phenomenon as a problem of extreme-value interference in attention.69% similarUnverifiedPlacing the question before the context causes the attention mechanism to assign higher weights to relevant tokens, allowing attention-score-based KV eviction strategies to easily identify important tokens, but in real inference scenarios the question is often given only after the context has been processed.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/940095API
curl https://kongchang.com/api/v1/knowledge/claims/940095MCP
get_claim(id=940095)