Unverified50% confidenceFactExact time
Cache hit is a billing optimization mechanism in large language model APIs, with rates typically only 1/4 or even lower than that of regular input tokens.
1
Sources
50%
Confidence
Long-term
Relevance
9/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe API cache hit mechanism allows input tokens that have already been sent to enjoy discounted pricing on repeated calls, typically at 10%–50% of the original price.74% similarUnverifiedMany large language models apply different rates for input tokens and output tokens, with input rates being lower and output rates being higher.72% similarUnverified对于按Token计费的大语言模型，Markdown比HTML节省大量Token，直接降低推理成本72% similarVerifiedThe Prompt Caching mechanism can reuse the KV Cache of identical prefix contexts, typically reducing input token costs by 50%–90%.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/932472API
curl https://kongchang.com/api/v1/knowledge/claims/932472MCP
get_claim(id=932472)