Unverified50% confidenceFactExact time
H2O is a dynamic sparse method based on Top-k selection, SnapKV is a method based on cumulative attention scores, and MInference is a structured sparse method with block sparsity.
1
Sources
50%
Confidence
Long-term
Relevance
8/31/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedRing Attention, sparse activation architectures based on MoE, and improved positional encoding schemes are key technologies for achieving ultra-long context.63% similarUnverifiedFor a model with L layers, H attention heads, and per-head dimension d, caching n tokens requires VRAM of 2 × L × H × d × n × (precision bytes).62% similarVerifiedMulti-Head Latent Attention (MLA) is an attention mechanism proposed by DeepSeek-V2.62% similarUnverifiedUltra-large context windows are typically implemented relying on sparse attention mechanisms, RoPE positional encoding extrapolation, and hierarchical caching technology.61% similarUnverified滑动窗口注意力（SWA）由 Mistral AI 广泛采用，将注意力复杂度从 O(N²) 降至 O(N×W)61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/831552API
curl https://kongchang.com/api/v1/knowledge/claims/831552MCP
get_claim(id=831552)