Unverified50% confidenceFactExact time
Anchor sampling causes each sample to actually involve a different context range, so the attention computation cost exhibits nonlinear, sample-dependent fluctuations.
1
Sources
50%
Confidence
Long-term
Relevance
11/5/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedBatch effect refers to the way other cases the judge sees in the same batch indirectly affect the log-probability distribution of the current case through the attention mechanism.75% similarVerifiedIn needle-in-a-haystack tests, models' ability to retrieve information at middle positions is notably weaker than at the beginning and end positions, a phenomenon referred to as attention sinking.75% similarUnverifiedAttention mechanism-based biasing methods are flexible but have computational costs that grow linearly with vocabulary size.74% similarVerifiedSome models carry the risk of over-optimization toward test sets, causing leaderboard scores to deviate from real-world performance (benchmark saturation).72% similarUnverifiedLeaderboard scores and real-world usage experience are not always consistent: a model may adjust its output distribution to score high on specific question types, leading to verbosity, evasion, or over-formatting in open-ended tasks.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1138033API
curl https://kongchang.com/api/v1/knowledge/claims/1138033MCP
get_claim(id=1138033)