Unverified50% confidenceFactExact time
The open-source project claims that the 125B model quantized with IQ3 can run on consumer-grade hardware consisting of a 12GB VRAM GPU plus 32GB or more of CPU memory.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/3/2026
First Seen
Valid until: 1/1/2027
Sources
Related Entities
Related Claims
Unverified消费级硬件（如16GB内存的笔记本电脑）可以通过Ollama流畅运行7B-13B参数规模的开源模型73% similarUnverifiedThis solution allows a GPU with 16GB of VRAM to run a 27B-class model with a 192K context and vision capability, but the speed ceiling is constrained by hardware bandwidth.72% similarUnverifiedRunning a 27B model on 8GB of VRAM relies on low-bit quantization and partial parameter offloading strategies, which may limit inference speed; users prioritizing speed are advised to choose a version with 16GB or more of VRAM.69% similarUnverifiedIQ2_XS can compress a model to close to 2 bits/weight, enabling a 70B model that would otherwise require 48 GB of VRAM to fit into a 24 GB consumer-grade GPU68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/970279API
curl https://kongchang.com/api/v1/knowledge/claims/970279MCP
get_claim(id=970279)