Verified80% confidenceFactExact time
Using float16 precision as a baseline, each parameter occupies approximately 2 bytes, meaning a 7B model requires approximately 14GB of VRAM/memory, and a 70B model requires approximately 140GB.
4
Sources
80%
Confidence
Long-term
Relevance
7/22/2026
First Seen
Sources
Ollama+Dify+DeepSeek本地企业级知识库搭建全指南
Related Claims
UnverifiedThe model weights alone of a 175-billion-parameter model (in BF16 precision) require 350 GB of storage, and the Adam optimizer must maintain two sets of states—first-order moments and second-order moments—totaling more than 1 TB.82% similarUnverifiedFP16格式下，大模型显存需求的估算公式为：参数量 × 2 = 所需显存（GB），即每个参数以16位（2字节）浮点数存储79% similarUnverifiedCurrent mainstream mobile devices typically have 6–16GB of memory (with approximately 3–8GB available for models), and models that can run smoothly on-device typically range from 1B to 8B parameters, requiring approximately 2–5GB of memory after 4-bit quantization.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/592778API
curl https://kongchang.com/api/v1/knowledge/claims/592778MCP
get_claim(id=592778)