Unverified50% confidenceOpinionExact time
Seemingly small changes such as a cache hit rate dropping from 98% to 95% are directly reflected in p50 and tail latency under the high-frequency random access workload of vector retrieval.
1
Sources
50%
Confidence
Long-term
Relevance
11/4/2026
First Seen
Sources
Related Entities
Related Claims
Unverifiedp95 means that 95% of all measured request latencies fall below that value, reflecting the upper bound of latency experienced by the worst 5% of users.77% similarUnverifiedp95 creation time refers to the 95th percentile value, meaning that 95% of instance creations are faster than this time and only 5% of requests are slower than it.75% similarUnverifiedP50 latency refers to the 50th percentile (median) end-to-end response time, meaning half of requests are faster than that value.72% similarUnverifiedp99 (99th percentile latency) means that 99% of all requests have a response time below a certain value.71% similarUnverifiedp95 refers to the value at the 95th percentile after sorting all observations, meaning 95% of calls do not exceed it; compared with the average, p95 is not dragged down by a few very small values nor dominated by extreme outliers, and more faithfully reflects how large a prompt is sent in the vast majority of cases.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1136968API
curl https://kongchang.com/api/v1/knowledge/claims/1136968MCP
get_claim(id=1136968)