Unverified50% confidenceFactExact time
The cached input mechanism skips repeated inference computation by reusing the KV cache for identical prefix content, with cache-hit tokens billed at a lower price.
1
Sources
50%
Confidence
Long-term
Relevance
10/8/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe semantic caching mechanism vectorizes and stores historical responses to similar requests, and when semantic similarity exceeds a threshold, it directly returns cached results to reduce upstream API call frequency and costs79% similarUnverifiedPrompt 缓存依赖于前缀的精确匹配，一旦技能定义的顺序或内容发生微小变化，缓存即失效75% similarUnverifiedPrompt缓存必须从前缀开始严格匹配，一旦中间某个token变化，其后所有token的注意力计算都会改变，已缓存的KV对随之失效75% similarVerifiedIn the KV Cache mechanism, reusing cached KV values is a cache hit, while context changes that invalidate the cache and require recomputation are a cache miss.74% similarUnverifiedPrompt caching requires an exact token sequence match as a prerequisite; any change at any position in the prefix invalidates the cache, and all tokens from that changed position onward must be recomputed.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/988859API
curl https://kongchang.com/api/v1/knowledge/claims/988859MCP
get_claim(id=988859)