Unverified50% confidenceFactExact time
RPC requires serialization, network protocol stack processing, deserialization and other steps, and even on the same host the latency is in the microsecond to millisecond range.
1
Sources
50%
Confidence
Long-term
Relevance
10/29/2026
First Seen
Sources
Related Entities
Related Claims
Unverified纯内存操作的延迟通常比向量数据库方案低1-2个数量级，Redis等内存数据库的P99延迟可控制在1ms以内，而远程向量检索往往需要10-100ms68% similarUnverifiedAfter NVMe SSDs became fast enough to respond at the microsecond level, the storage industry adopted polling instead of interrupts, having the CPU actively and frequently check the completion queue, sacrificing idle-time energy efficiency for determinism and throughput at low latency.68% similarUnverifiedIn disaggregated inference, the KV cache generated by prefill nodes must be transferred to decode nodes in real time, and for long-context or large-batch requests a single transfer may reach several GB.67% similarUnverifiedRDMA allows nodes to directly read and write each other's memory, compressing network latency to the microsecond level67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1110386API
curl https://kongchang.com/api/v1/knowledge/claims/1110386MCP
get_claim(id=1110386)