Unverified50% confidenceFactExact time
Chinchilla论文修正了预训练中计算与数据的最优比例关系
1
Sources
50%
Confidence
Long-term
Relevance
8/25/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedDeepMind的Chinchilla研究(2022)指出最优训练应让数据量与参数量保持大致1:1的比例增长77% similarUnverifiedChinchilla定律指出在固定计算预算下,适当缩小模型规模并增加训练数据量往往能获得更好的性能75% similarUnverifiedChinchilla缩放定律指出最优训练token数应与模型参数量成正比,参数翻倍时训练数据和计算成本至少翻倍73% similarVerified2022年DeepMind的Chinchilla论文指出同等算力预算下应均衡增大模型尺寸与训练数据量73% similarUnverified根据Chinchilla定律及其后续研究,模型性能与训练计算量之间存在幂律关系71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/799918API
curl https://kongchang.com/api/v1/knowledge/claims/799918MCP
get_claim(id=799918)