Unverified50% confidenceFactExact time
Gated DeltaNet updates its memory state based on the delta rule and is a modernized implementation of linear attention; Mamba-2 is a representative of state space models (SSM).
1
Sources
50%
Confidence
Long-term
Relevance
10/28/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedMamba-2, Gated DeltaNet and KDA are three new state update mechanisms used to replace some attention layers, achieving efficient state memory through a recursive structure with linear complexity.79% similarUnverifiedMost SSM and linear attention models use a linear attention mechanism at the bottom layer, with Mamba-2 implemented through the SSD structure and xLSTM implemented through covariance updates.74% similarUnverifiedState Space Models (SSMs) pull the direction back toward fixed-size recurrent memory, but use a different state structure and update rules.72% similarUnverifiedDeltaNet belongs to linear attention/state space models, replacing the full-history KV storage in standard attention with an updatable recurrent state matrix, so computation and storage grow linearly rather than quadratically with sequence length.71% similarVerifiedState space models (SSMs) such as Mamba abandon the attention mechanism and use recurrent structures to achieve linear time complexity sequence modeling.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1105936API
curl https://kongchang.com/api/v1/knowledge/claims/1105936MCP
get_claim(id=1105936)