Unverified50% confidenceFactExact time
Sparse scaling through conditional computation makes 'total parameter count' and 'active parameter count' two independent dimensions, where the former determines the upper bound of model expressiveness and the latter determines inference cost; PixelMoE leverages this decoupling to expand total capacity under a fixed active parameter count.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTotal parameter count reflects the upper limit of a model's knowledge capacity and expressive power, while activated parameter count determines the computational cost and latency during inference.73% similarUnverifiedThe number of model parameters and computing power requirements are roughly linearly related, while the context length at inference time further amplifies VRAM pressure.71% similarVerifiedThe scaling laws established by Kaplan et al. in 2020 indicate that model performance follows a power-law relationship with parameter count, data volume, and compute.69% similarVerifiedDense架构中模型所有参数在每次推理时都参与计算，计算成本随参数规模线性增长，以Llama系列为代表68% similarUnverifiedOperator surrogate models are a class of finitely parameterized mappings used to approximate complex (usually nonlinear) operators between infinite-dimensional function spaces.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1026720API
curl https://kongchang.com/api/v1/knowledge/claims/1026720MCP
get_claim(id=1026720)