Unverified50% confidenceFactExact time
GDN (Gated DeltaNet) introduces a gating mechanism and the Delta rule on top of linear attention; the gating controls the forgetting rate of historical information, and the Delta rule makes the state update approximate a gradient step in online learning.
1
Sources
50%
Confidence
Long-term
Relevance
10/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedKDA (Kernelized Delta Attention) kernels the Delta rule, attempting to find a smoother interpolation between the recursive state and attention.72% similarUnverifiedDeltaNet belongs to linear attention/state space models, replacing the full-history KV storage in standard attention with an updatable recurrent state matrix, so computation and storage grow linearly rather than quadratically with sequence length.68% similarUnverifiedGated DeltaNet updates its memory state based on the delta rule and is a modernized implementation of linear attention; Mamba-2 is a representative of state space models (SSM).67% similarUnverifiedDeltaNet is a variant of linear attention that replaces softmax attention with a delta update rule, reducing sequence processing complexity from O(n²) to O(n).65% similarUnverifiedGated DeltaNet makes memory usage during inference independent of context length by maintaining a fixed-size hidden state matrix.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1114520API
curl https://kongchang.com/api/v1/knowledge/claims/1114520MCP
get_claim(id=1114520)