[KongchangAI]
Conceptimplicit prompt caching

Implicit Prefix Caching

A prompt caching mechanism in which the server automatically identifies request prefixes and applies cache discounts, without requiring developers to create cache objects explicitly, but requiring the prefix to be exactly identical token by token.

Source Articles