Unverified50% confidenceFactExact time
vLLM's KV Connector interface defines standard methods such as send_kv_caches_and_hidden_states and recv_kv_caches_and_hidden_states, enabling connectors to insert cache routing logic without modifying the core inference logic.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/1/2026
First Seen
Valid until: 12/30/2026
Sources
Related Entities
Related Claims
UnverifiedStarting from version 0.6.x, vLLM introduced the standardized KV Connector plugin interface KVConnectorBase, allowing third-party implementations to offload KV cache to external storage.77% similarUnverifiedvLLM、TensorRT-LLM等LLM推理服务通过KV Cache机制在单次请求内缓存中间注意力计算结果，但该缓存是请求级别的，HTTP连接关闭后即被释放71% similarVerifiedvllm-proto is most likely an independently extracted package for standardizing vLLM's internal/external interfaces, and its core content is possibly a collection of interface definition files for cross-language, cross-process communication.69% similarUnverifiedThe proto used by vLLM is typically based on Protocol Buffers (protobuf) and is commonly used in conjunction with the gRPC framework.67% similarUnverifiedIn vLLM, NIXL is commonly used to implement cross-node KV cache transfer under a Prefill/Decode disaggregated architecture66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/966069API
curl https://kongchang.com/api/v1/knowledge/claims/966069MCP
get_claim(id=966069)