Unverified50% confidenceFactExact time
Collapse模型仅包含四类可学习参数：每个token的256维向量、起始状态、拉力强度标量、读出温度标量
1
Sources
50%
Confidence
Long-term
Relevance
7/12/2026
First Seen
Sources
No MLP or Attention Required: How Point-Attractor Dynamics Learn Word Embeddings
redditr/learnmachinelearning7/10/2026
Related Claims
Unverified在27B混合架构、4B稠密模型、36B MoE三类模型上以8k上下文测试，Prefill阶段性能无变化，Decode阶段打补丁后快约1.4%59% similarVerifiedQ4量化将每个权重参数从16位压缩到4位，理论上可将模型体积缩小约75%58% similarUnverifiedCollapse模型在SimLex-999名词子集上取得Spearman ρ = 0.3616的相似度相关性，覆盖662/666的名词对58% similarUnverifiedINT4量化将原本由65536个不同值（FP16）表示的权重压缩到仅16个离散级别58% similarVerifiedThe larger the number of model parameters, the greater the robustness to quantization, allowing 70B-level models to maintain performance close to FP16 after 4-bit quantization.57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/491356API
curl https://kongchang.com/api/v1/knowledge/claims/491356MCP
get_claim(id=491356)