Unverified50% confidenceSolutionExact time
将所有请求路由到同一个服务商可命中温热缓存,若请求被负载均衡到不同GPU节点则缓存命中率会大幅下降,因各节点的KV Cache相互独立
1
Sources
50%
Confidence
Long-term
Relevance
8/12/2026
First Seen
Sources
Related Claims
Cite This Claim
Stable URI
https://kongchang.com/claim/736883API
curl https://kongchang.com/api/v1/knowledge/claims/736883MCP
get_claim(id=736883)