Unverified50% confidenceFactExact time
Hy4 adopts a DeepSeek-style sparse attention mechanism.
1
Sources
50%
Confidence
Long-term
Relevance
9/5/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedDeepSeek V4 adopts a proprietary hierarchical compressed attention strategy, featuring two alternating attention modes: CSA (Compressed Sink Attention) and HCA (Heavy Compressed Attention).75% similarUnverifiedDeepSeek-V2 proposes MLA (Multi-head Latent Attention), which compresses KV Cache to approximately 5% of MHA through low-rank compression.68% similarVerifiedMLA (Multi-head Latent Attention) was first proposed by the DeepSeek team in DeepSeek-V2, and significantly reduces KV Cache memory usage by compressing Key-Value pairs into a low-dimensional latent space.68% similarUnverifiedDeepSeek-V3.2-Exp首次引入自研的DeepSeek Sparse Attention（DSA）稀疏注意力技术68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/860614API
curl https://kongchang.com/api/v1/knowledge/claims/860614MCP
get_claim(id=860614)