Unverified60% confidenceFactExact time
Model parameter scale has grown from 340 million in BERT to an estimated over one trillion in GPT-4.
2
Sources
60%
Confidence
Long-term
Relevance
7/17/2026
First Seen
Sources
Related Claims
VerifiedFrom GPT-2 to GPT-3, the parameter count increased from 1.5 billion to 175 billion, and OpenAI's 2020 paper demonstrated that scaling up parameter size can bring about qualitative emergent capabilities.79% similarVerifiedGPT-4采用混合专家（MoE）架构，估计总参数量达1.8万亿，每次推理实际激活参数约为总量的1/877% similarVerifiedGPT-4 was launched in 2023 with an estimated parameter scale exceeding one trillion.77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/538976API
curl https://kongchang.com/api/v1/knowledge/claims/538976MCP
get_claim(id=538976)