Unverified50% confidenceCautionExact time
AirLLM 处理长上下文时需在系统内存中维护完整的 KV Cache，通常建议配备 64GB 以上的 RAM
1
Sources
50%
Confidence
Long-term
Relevance
7/19/2026
First Seen
Sources
Related Claims
UnverifiedThe KV Cache of a 70B-parameter model with 128K context support can require hundreds of gigabytes of VRAM at full load, exceeding the 80GB VRAM capacity of a single H100.68% similarUnverifiedModel weights cannot fill up VRAM entirely, as space must be reserved for the KV cache and inference processes; the KV cache required for a 128K context can reach as high as several GB or even exceed the model weights themselves.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/563156API
curl https://kongchang.com/api/v1/knowledge/claims/563156MCP
get_claim(id=563156)