Unverified50% confidenceFactExact time
340M and 1.3B are parameter scales, and 4K context means a training/evaluation sequence length of 4096 tokens.
1
Sources
50%
Confidence
Long-term
Relevance
10/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe actual benchmark result of running a 17GB model on an M5 Max is approximately 31 tokens/second.69% similarUnverifiedThe full 340M model trains 4.9 times faster.69% similarUnverifiedAccording to the Chinchilla scaling law, the optimal training data volume for a 30B model is approximately 600B–1T tokens.67% similarUnverified2.4万亿参数模型在BF16精度下考虑KV Cache和激活值后实际约需1.4-1.5TB显存67% similarUnverifiedGPT-3 has 175B parameters and was trained on 300B tokens; Gopher has 280B parameters and was trained on 300B tokens — both are in an over-parameterized and under-trained state.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1114901API
curl https://kongchang.com/api/v1/knowledge/claims/1114901MCP
get_claim(id=1114901)