Unverified50% confidenceFactExact time
The GGUF Q4_K_M quantized version of the gemma4:26b model occupies about 20,072 MiB of VRAM, and Ollama's default context window is 32,768 tokens
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/13/2026
First Seen
Valid until: 1/11/2027
Sources
Related Entities
Related Claims
UnverifiedOn NVIDIA L4, the bf16 model (6.32 GiB) has a theoretical memory-bandwidth ceiling of about 47 tokens/s, while the int4 model (2.85 GiB) has a theoretical ceiling of about 105 tokens/s, with measured peak reaching 131.9 tokens/s.71% similarUnverifiedIn a fair 4-bit comparison, MLX with D-Flash 2 speculative decoding ran at 16.6 tokens/s, versus Ollama Q4's 5.7 tokens/s.69% similarUnverifiedRunning gemma4:26b (GGUF Q4_K_M) via Ollama on a Colab A100 instance achieves a generation speed of 179.42 tok/s, taking 2.16 seconds for 369 tokens69% similarUnverifiedThe GGUF quantized version Q4_K_M of MiniCPM 2B has a model size of only 1.56G and can run smoothly on devices with 4G VRAM.69% similarVerifiedRunning Muse Glimmer at full precision requires 55 GB of VRAM, which is compressed to under 20 GB via 4-bit quantization, allowing it to run on consumer-grade GPUs with 24 GB of VRAM.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1016385API
curl https://kongchang.com/api/v1/knowledge/claims/1016385MCP
get_claim(id=1016385)