Unverified50% confidenceFactExact time
开发者最终选择KL散度为0.028的变体作为最优解
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/20/2026
First Seen
Valid until: 10/18/2026
Sources
Related Claims
Unverified开发者最终选择KL散度最低(0.028)的变体,GSM8K下降1.83%,MMLU保持不变,HarmBench合规率从30.8%提升至100%74% similarUnverifiedK2.7-Code总质量得分为153.5分,K2.6总质量得分为79分,K2.7-Code领先74.5分69% similarUnverifiedTop-K SAE在编码过程中只保留激活值最高的K个特征,其余强制置零,从而强制模型学习稀疏表示67% similarUnverifiedK2.6的稀疏度约为97%(1T总参数对应32B激活参数),与Google Switch Transformer、Mistral Mixtral系列和DeepSeek-V3的设计理念一致65% similarUnverifiedTop-K SAE的K值选择通常在32-256之间,取决于模型规模和分析粒度需求61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/568115API
curl https://kongchang.com/api/v1/knowledge/claims/568115MCP
get_claim(id=568115)