Unverified50% confidenceFactExact time
The 2-bit quantized DeepSeek 763B model takes up about 175GB of memory, can run on a 256GB machine and leaves room for the KV cache.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/17/2026
First Seen
Valid until: 1/15/2027
Sources
Related Entities
Related Claims
VerifiedModel weights cannot fill up VRAM entirely, as space must be reserved for the KV cache and inference processes; the KV cache required for a 128K context can reach as high as several GB or even exceed the model weights themselves.79% similarUnverifiedDeepSeek-R1 1.5B模型约需2-3GB显存，普通集成显卡或CPU即可运行77% similarVerifiedThe size of the KV cache grows linearly with context length; the KV cache for Qwen 2.5 32B at a 64K context may consume several additional gigabytes of memory.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1054802API
curl https://kongchang.com/api/v1/knowledge/claims/1054802MCP
get_claim(id=1054802)