[KongchangAI]
Concept

CSA2

A KV cache sharing and compression technique proposed by DeepSeek. It enables different layers of a neural network to share memory rather than maintaining independent KV caches, and combines an encoder-decoder structure to achieve extreme KV cache compression.

Core Facts

Timeline (last 90 days)

Sep 22

V4.1 Flash uses CSA2 (Compressed Sparse Attention 2) technology combined with FP4 format for caching data, compressing the global KV Cache footprint to only 890 bytes per token.

Unverified50%
Sep 16

DeepSeek V4.1 Flash simplifies the complex compression-absorption engine of previous versions, retaining only CSA2.

Unverified50%
Sep 16

DeepSeek-V4.1-Flash's KV cache is compressed to 890 bytes per token, only one-quarter that of V4 Flash.

Verified65%

All Facts (3)

Source Articles