Unverified50% confidenceFactExact time
As context length increases and concurrent requests grow, the GPU memory occupied by KV-Cache expands rapidly.
1
Sources
50%
Confidence
Long-term
Relevance
9/12/2026
First Seen
Sources
Related Entities
Related Claims
Unverified长文档处理中，KV Cache机制导致显存占用随上下文长度近似平方级增长69% similarUnverified自回归模型随序列长度增加，KV Cache占用线性增长，显存带宽成为制约速度的硬件瓶颈67% similarUnverifiedThe KV cache VRAM usage of ultra-long context windows grows linearly with context length, causing inference latency and costs to rise significantly.67% similarUnverifiedThe KV Cache, which grows dynamically during inference, continuously occupies VRAM and may suddenly trigger an OOM crash during long conversations.66% similarUnverified随着对话轮次增加，每轮需携带完整历史上下文，输入token数量持续膨胀，导致推理时间呈现非线性增长65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/917169API
curl https://kongchang.com/api/v1/knowledge/claims/917169MCP
get_claim(id=917169)