Unverified50% confidenceFactExact time
Only about 5% of the world's population speaks English at home, but about 63.7% of online text is in English, and models trained on this distribution perform noticeably worse on non-English prompts.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedEnglish data accounts for an overwhelming proportion of mainstream large language model training corpora; taking public datasets such as Common Crawl as an example, English content typically constitutes 40%–60% of the total, while languages such as Vietnamese and Chinese often account for less than 5%.74% similarUnverified英语约占互联网文本的50%以上，而斯瓦希里语、泰米尔语等语言的数字化语料极为稀缺71% similarUnverifiedEnglish content in mainstream large language model training corpora typically exceeds 50%, leading to significant performance gaps for non-English languages.71% similarUnverifiedMeta Llama 2的2万亿token训练数据中英语占比约89.7%，欧洲语言合计约8%，其余所有语言共享约2%69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1040837API
curl https://kongchang.com/api/v1/knowledge/claims/1040837MCP
get_claim(id=1040837)