Unverified50% confidenceDecision RuleExact time
The way to distinguish KV pool growth from scheduling preemption is to measure both the cross-round RSS slope and TTFT p95: monotonically rising RSS with p95 following it means KV pool growth, while rising p95 with flat RSS means a placement or preemption problem.
1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedKV cache size grows linearly with context length, and attention computation grows quadratically with context length.70% similarUnverifiedKVarN在量化前对每个通道进行方差归一化（除以标准差），使各通道数值落入相似范围后再进行均匀量化，反量化时乘回标准差恢复62% similarUnverifiedKV cache optimization has four main technical approaches: quantization, sparse attention, low-rank approximation, and multi-query/grouped-query attention (MQA/GQA).61% similarVerifiedThe KV cache grows linearly with context length, increasing the memory read volume per step in the decoding phase, which is the fundamental reason decoding speed decreases as context grows.61% similarUnverifiedFor multi-turn conversations or long-document question answering, if the KV of the entire context is recomputed on every request, the compute overhead grows quadratically with context length.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1063647API
curl https://kongchang.com/api/v1/knowledge/claims/1063647MCP
get_claim(id=1063647)