Unverified50% confidenceBenchmarkExact time
On the validation-set average NLL metric, Continuum Attention reduces by 0.0200 nats/byte compared to ordinary softmax attention.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedUnder fixed compute, single-head attention scores 0.9 points lower than the optimal setting, and quality actually decreases when there are too many heads.70% similarUnverifiedAt moderate noise levels and the middle layers of the model, 2 learnable null slots absorbed approximately 90% of the cross-attention mass, while the EOS token's share dropped sharply to approximately 4%.64% similarUnverifiedAfter applying DA, Gemma-4-31B reduced attention tokens by 52.0%, with an accuracy drop of only 1.27 percentage points.63% similarUnverifiedIn the final round of experiments, the composite evaluation score improved by 0.0903, and zero-score conversations decreased by 40%.62% similarUnverifiedResearch shows that when humans continuously perform high-attention monitoring tasks, their detection accuracy significantly declines after approximately 20–30 minutes.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1037967API
curl https://kongchang.com/api/v1/knowledge/claims/1037967MCP
get_claim(id=1037967)