Unverified50% confidenceBenchmarkExact time
WhaleLife has made caching optimizations for context; over a chat of more than 100,000 tokens the cache hit rate can reach above 98%, and the cost of a single chat is only a little over three li of a yuan.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
11/13/2026
First Seen
Valid until: 11/27/2026
Sources
WhaleLife Open-Sourced: Giving AI an Independent Body
bilibili紫杉樹11/13/2026
Related Entities
Related Claims
UnverifiedSharing cached prompts across four models produced cost savings of 78–80%.65% similarUnverifiedThe actual extent of cache savings depends on the hit rate; if 80% of input hits the cache, the actual input cost is approximately 0.8 × cache price + 0.2 × regular price.64% similarVerifiedToken billing is calculated based on the total volume of input and output; the longer a conversation, the more each call pays for an increasingly bloated history.63% similarUnverifiedIn a call with about ninety-seven thousand-plus input tokens, only the newest one thousand eight hundred-plus tokens were not cached; without caching the input cost was about 0.1 yuan, and with caching it was less than 0.004 yuan, 26 times cheaper.63% similarUnverifiedAccording to community benchmarks, in complex sessions where the context has not been cleared, a single task investigation can consume up to 500,000 tokens, generating 4–6 times the overhead compared to short sessions used out of the box.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1166408API
curl https://kongchang.com/api/v1/knowledge/claims/1166408MCP
get_claim(id=1166408)