Unverified50% confidenceTradeoffExact time
On PC platforms, when VRAM is insufficient, part of the model can be offloaded to system memory, reducing speed but still allowing it to run; on Mac, when unified memory is insufficient, the model immediately reports an error and exits.
1
Sources
50%
Confidence
Long-term
Relevance
10/5/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedWhen a model file exceeds the GPU's VRAM, the overflow portion falls back to system memory for processing, causing a significant drop in speed.76% similarUnverifiedThe CPU offloading strategy keeps the weights of inactive experts resident in system memory and only temporarily loads them into GPU VRAM when selected by the router, at the cost of introducing PCIe bus transfer latency.72% similarUnverifiedMemory-bound typically refers to insufficient GPU memory capacity, which requires offloading or model parallelism to address.72% similarUnverifiedIf a model is too large for the memory, the Mac will swap data to the SSD, causing generation speed to drop to less than one word per second and causing severe long-term SSD wear.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/977810API
curl https://kongchang.com/api/v1/knowledge/claims/977810MCP
get_claim(id=977810)