Unverified50% confidenceBenchmarkExact time
At a context length of 1000, the FLOP estimate with caching is about 1000 times smaller, but single-token latency drops only from 29.69 ms to 4.95 ms, about a 6x improvement.
1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAt a scale of 1 million vectors, PRISM achieves 99% recall and 15 milliseconds median latency on a 2GB c8g.medium; HNSW on a 4GB c8g.large is 392 milliseconds, with building taking about 21.7 hours and exhibiting memory thrashing.72% similarUnverified纯内存操作的延迟通常比向量数据库方案低1-2个数量级，Redis等内存数据库的P99延迟可控制在1ms以内，而远程向量检索往往需要10-100ms71% similarUnverifiedThe performance data provided by Logic42 shows that when the number of files per partition increases from 4 (512 MB/file) to 18,500 (120 KB/file), Trino planning latency rises from 45 ms to 38,000 ms, and end-to-end query time goes from 480 ms to timeout (OOM).69% similarUnverifiedIn a same-configuration comparison, single-request throughput at 38K improved from 69.38 tokens per second to 86.07, and 8-way total throughput at approximately 4K improved from 400.16 tokens per second to 464.15.68% similarUnverifiedAfter switching to the new architecture, Legion's average cached volume dropped from 6.48M to 3.48M (-46%), and average uncached volume dropped from 1.71M to 1.03M (-40%).68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1060684API
curl https://kongchang.com/api/v1/knowledge/claims/1060684MCP
get_claim(id=1060684)