Other
Anthropic API
Timeline (last 90 days)
Oct 14
Prompt caching is a capability of the Anthropic API: when the prefix portion of a request is exactly identical to the previous request, the server can reuse the already-computed intermediate state and skip redundant prefill computation.
Unverified50%