Unverified50% confidenceFactExact time
Cosmopedia v2 是由 Mixtral-8x7B 等模型批量生成的合成数据集
1
Sources
50%
Confidence
Long-term
Relevance
7/14/2026
First Seen
Sources
15岁少年从零训练200M MoE语言模型：完整架构与实战拆解
redditr/learnmachinelearning7/12/2026
Related Claims
UnverifiedMixtral 8x7B每次前向传播仅激活2个专家59% similarUnverifiedOmniMerge V4 is a model formed by fusing three to four 27B models through weight merging.53% similarUnverifiedMixtral 8x7B, released by Mistral AI, is the first mainstream open-weight MoE model, with 46.7B total parameters and 12.9B active parameters.52% similarUnverifiedThis paper adopts an INT8+bf16 mixed-precision strategy: the original model weights use INT8 quantization (via the LLM.int8() method from the bitsandbytes library), while the LoRA components use bf16 with fp32 master weights.52% similarUnverified腾讯自身研发大模型混元51% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/503166API
curl https://kongchang.com/api/v1/knowledge/claims/503166MCP
get_claim(id=503166)