Verified80% confidenceFactTime unknown
The code generation capabilities of large language models such as GPT-4 and Claude stem from the fact that their training data includes hundreds of millions of open-source code repositories on GitHub.
12
Sources
80%
Confidence
Long-term
Relevance
5/31/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe pre-training corpora of mainstream large models such as GPT and Claude contain large amounts of GitHub repositories, technical documentation, and Wikipedia content formatted in Markdown.80% similarUnverifiedLarge language models such as GPT, Claude, and DeepSeek are pre-trained on tens of trillions of tokens of multilingual, multi-domain text, covering data sources including code repositories, academic papers, books, and web pages.79% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/5470API
curl https://kongchang.com/api/v1/knowledge/claims/5470MCP
get_claim(id=5470)