Unverified50% confidenceFactExact time
DeltaNet belongs to the linear attention mechanism family, designed to reduce the computational complexity of attention from O(n²) to O(n).
1
Sources
50%
Confidence
Long-term
Relevance
9/6/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe self-attention mechanism allows the model to simultaneously see the information of all other tokens in the input sequence when processing each token, and the computational complexity of the attention matrix is O(n²)67% similarVerifiedInformer reduces the self-attention computation complexity from O(n²) to O(n log n) through ProbSparse sparse attention.65% similarUnverified滑动窗口注意力（SWA）由 Mistral AI 广泛采用，将注意力复杂度从 O(N²) 降至 O(N×W)64% similarVerifiedStandard self-attention has a computational complexity of O(n²); SSA reduces complexity by having each token attend only to the most relevant subset, theoretically compressible to O(n·log n) or even O(n) level.64% similarUnverifiedKimi K3 adopts the Kimi Delta Attention hybrid linear attention mechanism, which reduces attention computation complexity from O(N²) to O(N) through kernel function approximation.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/866945API
curl https://kongchang.com/api/v1/knowledge/claims/866945MCP
get_claim(id=866945)