Unverified50% confidenceFactExact time
真正的物理显存分配发生在vLLM的Worker侧,而逻辑层面的block pool与block table由调度侧建立
1
Sources
50%
Confidence
Long-term
Relevance
9/10/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedvLLM采用调度-执行分离架构,调度侧负责请求管理、序列调度和逻辑资源分配,执行侧负责实际的模型推理和物理显存管理66% similarUnverified在vLLM中,每多一张卡就会多一个TP Worker,负责多卡之间的调度协调而非实际运算60% similarUnverifiedvLLM在单机场景下使用ZeroMQ(zmq)作为RPC框架,在分布式场景下借助Ray框架来管理多节点的Worker59% similarUnverified两阶段级联架构(快速检测器+VLM协同)是解决VLM实时性问题的工程化方案,通过减少VLM需处理的帧数和区域数使整体管线可用58% similarUnverifiedControlNet技术可实现结构引导,如保持平面图的墙体位置不变58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/887211API
curl https://kongchang.com/api/v1/knowledge/claims/887211MCP
get_claim(id=887211)