Unverified50% confidenceFactExact time
BigBird theoretically proved that sparse attention can be Turing complete.
1
Sources
50%
Confidence
Long-term
Relevance
8/31/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedDilated convolution can exponentially expand the receptive field without increasing the number of parameters.57% similarUnverified上下文窗口大小不等于有效上下文长度，超出有效注意力范围会导致遗忘漂移现象57% similarUnverifiedWhen prompts are too long, large models experience an 'attention explosion' phenomenon, where excessively long inputs cause effective information to be lost.55% similarUnverifiedAn "lost in the middle" effect exists in ultra-long contexts, meaning the model has stronger memory for content at the beginning and end of a sequence while attention to middle passages decreases; this phenomenon was named by Stanford researchers.55% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/828092API
curl https://kongchang.com/api/v1/knowledge/claims/828092MCP
get_claim(id=828092)