Unverified50% confidenceFactExact time
Tiny-MoE在80亿（8B）token上从零训练，使用FineWeb-Edu、Cosmopedia v2和OpenWebMath数据集
1
Sources
50%
Confidence
Long-term
Relevance
7/13/2026
First Seen
Sources
15岁少年从零训练200M MoE语言模型：完整架构与实战拆解
redditr/learnmachinelearning7/12/2026
Related Claims
UnverifiedEnterprise users of the OpenAI official API can apply for a Zero Data Retention agreement under which data is not used for model training.62% similarUnverifiedOpenAI uses the identifier 'GPTBot' for its training data crawler.59% similarUnverifiedAn open-source project with 72.7k stars provides a localized interface, supports one-click model running and fine-tuning, can run on low VRAM, and can accelerate training.59% similarUnverifiedCosmopedia v2由Mixtral-8x7B等模型批量生成合成数据，OpenWebMath专注从Common Crawl提取数学内容57% similarUnverifiedEleutherAI的Pythia系列和BLOOM是达到真正开源标准（包括训练数据、训练代码、模型架构和权重全面公开）的少数AI项目代表57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/502529API
curl https://kongchang.com/api/v1/knowledge/claims/502529MCP
get_claim(id=502529)