Concept缓存键 / cache key
Cache Key Design
The design of keys used to uniquely identify requests when caching model adjudication results; the key must cover all inputs that affect the output, such as the model identifier, template hash and diff hash.
Timeline (last 90 days)
Oct 16
In a program, when the original question text is used as the key, subtle differences such as spaces, line breaks, and full-width versus half-width punctuation are all treated as different questions, causing the cache hit rate to drop or duplicate processing
Unverified50%