Unverified50% confidenceFactExact time
KV缓存随上下文长度增加，显存占用可达总显存的60%以上
1
Sources
50%
Confidence
Long-term
Relevance
7/7/2026
First Seen
Sources
DeepSeek开源DiSpark：不换显卡让AI推理提速85%
bilibili枫叶边城7/4/2026
Related Claims
Unverified随着上下文长度增加，KV缓存的显存占用可达总显存的60%以上84% similarUnverifiedKV缓存将已计算的Key-Value矩阵存储在显存中实现增量计算，代价是显存占用随序列长度线性增长77% similarUnverifiedKV Cache内存共享机制在束搜索等场景下可节省高达55%的显存75% similarVerifiedKV Cache的显存占用随序列长度线性增长，700亿参数采用GQA的模型处理10万Token时KV Cache占用可能高达数十GB74% similarVerifiedKV Cache占用的显存随序列长度线性增长74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/207271API
curl https://kongchang.com/api/v1/knowledge/claims/207271MCP
get_claim(id=207271)