Unverified50% confidenceFactExact time
在高并发下，底层大模型推理服务（如vLLM、TGI、Ollama）可能因GPU显存不足或请求队列溢出而截断响应或拒绝请求
1
Sources
50%
Confidence
Long-term
Relevance
8/7/2026
First Seen
Sources
Related Claims
Unverified数据在服务器端进行推理时必然处于明文状态，GPU显存中的激活值、KV缓存以及批处理队列中的请求数据都可能成为侧信道攻击目标68% similarUnverifiedMeta's open-sourced Llama Guard series is fine-tuned based on the Llama architecture, optimized specifically for harmful content classification tasks, with parameter counts far smaller than full generative models.61% similarUnverifiedPerforming a global search on suspicious parameters to distinguish whether they are returned by the server or generated by the frontend, and prioritizing by the order of "server-issued parameters reuse directly, frontend-generated parameters need reverse engineering" can systematically reduce invalid workload60% similarUnverifiedOnce a platform strengthens parameter validation on the back end, this type of bypass method that constructs non-standard request parameters will immediately become ineffective.59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/700683API
curl https://kongchang.com/api/v1/knowledge/claims/700683MCP
get_claim(id=700683)