Unverified50% confidenceFactExact time
The rule of thumb given by the Chinchilla scaling law is that the number of training tokens should be approximately 20 times the number of parameters
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedChinchilla研究发现在固定计算预算下参数量和训练token数应按大致1:20比例匹配75% similarUnverifiedThe research team measured inference and training speed improvements of more than 20% on a billion-parameter-scale sparse LLM.74% similarUnverifiedChinchilla, trained with 70 billion parameters and 1.4 trillion tokens of training data, surpassed Gopher—a model with four times its parameter count—on multiple benchmarks.70% similarUnverifiedChinchilla定律大致按每个参数分配20倍token的比例来安排算力67% similarUnverified2022年Hoffman等人的Chinchilla论文重新校准了算力最优的参数-数据比例,指出此前许多大模型训练不充分65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/904280API
curl https://kongchang.com/api/v1/knowledge/claims/904280MCP
get_claim(id=904280)