Unverified50% confidenceCautionExact time
Hedged requests should be sent to a different inference instance or GPU from the original request; otherwise, if the latency is caused by a local issue on that instance, the hedged request will be equally affected.
1
Sources
50%
Confidence
Long-term
Relevance
8/29/2026
First Seen
Sources
Related Entities
Related Claims
Unverified在高并发下，底层大模型推理服务（如vLLM、TGI、Ollama）可能因GPU显存不足或请求队列溢出而截断响应或拒绝请求68% similarUnverified数据在服务器端进行推理时必然处于明文状态，GPU显存中的激活值、KV缓存以及批处理队列中的请求数据都可能成为侧信道攻击目标65% similarUnverifiedPerforming a global search on suspicious parameters to distinguish whether they are returned by the server or generated by the frontend, and prioritizing by the order of "server-issued parameters reuse directly, frontend-generated parameters need reverse engineering" can systematically reduce invalid workload58% similarUnverified当API限流时会返回429状态码（Too Many Requests），通常附带Retry-After响应头指示等待时间57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/820771API
curl https://kongchang.com/api/v1/knowledge/claims/820771MCP
get_claim(id=820771)