Conceptactivated parameters
Activated Parameter Count
The number of parameters that actually participate in computation during a single forward pass of a model, decoupled from the total parameter count and determining the computational cost per token.
Timeline (last 90 days)
Oct 13
When evaluating architectures like reViT, one must distinguish three metrics: total parameter count, activated parameter count, and inference FLOPs, otherwise it is easy to reach misleading conclusions.
Unverified50%