[KongchangAI]
Conceptparameter count

Parameter Scale

The total number of trainable weights in a model, a basic measure of model capacity and complexity that is generally related to model capability and generalization performance.

Core Facts

Timeline (last 90 days)

Nov 19

Parameter scale refers to the number of trainable weights in a model and is a rough indicator of model capacity.

Unverified50%
Nov 19

Generally speaking, models with more parameters can extract more general representations from the same data, and thus are more likely to generalize hidden skills from unrelated data.

Unverified50%
Oct 22

Parameter scale and problem-setting ability exhibit a non-monotonic relationship.

Unverified50%
Oct 20

Parameter scale mainly affects a model's capacity and knowledge density, but engineering deployment capability depends more on the training data mix, post-training (instruction fine-tuning, RLHF), and context management at inference time.

Unverified50%
Oct 16

In video-language models, parameter scale and proactive capability are not simply positively correlated: larger models are usually stronger at perception and commonsense reasoning, but 'when to respond' is a temporal decision-making problem that is often influenced more by training objectives and data distribution.

Unverified50%
Sep 16

The parameter scale of a model is expressed in B (billions); for example, 7B represents 7 billion parameters.

Verified75%

All Facts (6)

Source Articles