Unverified50% confidenceOpinionExact time
Most code samples encountered during large language model training come from platforms such as GitHub and are predominantly UTF-8 without BOM in Unix environments, so models tend toward this as their default.
1
Sources
50%
Confidence
Long-term
Relevance
8/7/2026
First Seen
Sources
Cursor总写错UTF编码又自我修复？Token浪费的隐藏陷阱
Related Claims
VerifiedLarge language models learn the syntax rules of programming languages and the mapping between natural language and code by pre-training on billions of lines of open-source code on platforms such as GitHub.75% similarUnverified现代大语言模型的预训练数据集通常包含数万亿 token，涵盖 GitHub 代码仓库、Stack Overflow、Linux 文档等72% similarUnverifiedGit的diff格式是大模型在训练中高度熟悉的语言，因此基于diff的编码修正过程精准且高效71% similarUnverified大模型在预训练阶段接触了海量GitHub上的diff格式数据，对该格式有极高的理解与生成能力71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/702355API
curl https://kongchang.com/api/v1/knowledge/claims/702355MCP
get_claim(id=702355)