Parameter Count
The number of trainable weights inside a large language model, usually measured in billions (B). It determines the upper bound of model capacity, but is not the sole determinant of performance; the quality of training data and the training strategy are equally critical.
Timeline (last 90 days)
The estimation formula for model parameter storage and the minimum VRAM is: parameter count × bit width ÷ 8 = bytes.
A severely overspecified model parameter count will cause an OOM (out-of-memory) error and prevent startup, while a slightly overspecified count will borrow regular memory and cause a significant drop in speed
The number after a model name (e.g., 4B, 8B) represents the parameter count; the larger the number, the stronger the capability but the higher the hardware requirements.
All Facts (3)
The estimation formula for model parameter storage and the minimum VRAM is: parameter count × bit width ÷ 8 = bytes.
50%UnverifiedA severely overspecified model parameter count will cause an OOM (out-of-memory) error and prevent startup, while a slightly overspecified count will borrow regular memory and cause a significant drop in speed
50%UnverifiedThe number after a model name (e.g., 4B, 8B) represents the parameter count; the larger the number, the stronger the capability but the higher the hardware requirements.
50%