Unverified50% confidenceTradeoffExact time
For agent or chat products that resend long system prompts and history on every turn, cache prices may have a greater impact on the bill than input prices.
1
Sources
50%
Confidence
Long-term
Relevance
10/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedToken billing is calculated based on the total volume of input and output; the longer a conversation, the more each call pays for an increasingly bloated history.77% similarUnverifiedIncluding large amounts of conversation history or background documents (long context) in each request causes costs to accumulate in a non-linear manner.74% similarUnverifiedThe higher the cache hit rate, the closer the actual billing is to the cache price rather than the full input price, which can reduce costs by an order of magnitude.72% similarUnverifiedUnder the cache-hit billing mechanism, the portion that hits the cache is billed at a lower price; in Agent scenarios the cache hit rate is often as high as 90% or above, and the cache price has a far greater impact on the actual costs of heavy Agent users than the nominal input unit price.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1000010API
curl https://kongchang.com/api/v1/knowledge/claims/1000010MCP
get_claim(id=1000010)