Unverified50% confidenceFactExact time
Context compression reduces the number of tokens passed to the model per request through summarization, retrieval, or discarding redundant history, thereby directly lowering compute costs; caching, by contrast, stores the responses to common questions or high-frequency conversations to avoid repeated inference.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSemantic Cache can reduce third-party large model API call costs by reusing historical answers for similar questions.78% similarVerifiedThe semantic caching mechanism vectorizes and stores historical responses to similar requests, and when semantic similarity exceeds a threshold, it directly returns cached results to reduce upstream API call frequency and costs75% similarUnverifiedThe cached input mechanism skips repeated inference computation by reusing the KV cache for identical prefix content, with cache-hit tokens billed at a lower price.75% similarUnverifiedContext compression shortens history by summarizing or discarding old tokens, at the cost that information may be irreversibly lost.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1036591API
curl https://kongchang.com/api/v1/knowledge/claims/1036591MCP
get_claim(id=1036591)