Unverified50% confidenceConceptExact time
嵌入坍缩是指训练过程中模型学到的词嵌入或隐藏表示逐渐挤压到嵌入空间的狭小区域内，导致不同词汇的向量表示高度相似、难以区分
1
Sources
50%
Confidence
Long-term
Relevance
7/7/2026
First Seen
Sources
分散损失：破解小语言模型嵌入坍缩的关键技术
hackernewshackernews7/3/2026
Related Claims
UnverifiedIn chunking strategies, chunks that are too large cause semantic focus to blur, while chunks that are too small cause context fragmentation; fixed-window, sentence-level, and semantic-boundary recursive chunking each involve trade-offs in different scenarios, with no universally optimal solution.68% similarUnverified表示坍缩指模型将所有输入映射到同一点或低维流形，使损失趋近于零但毫无意义，是自监督学习的核心挑战65% similarUnverifiedFeature Creep refers to a product continuously adding new features during iteration, ultimately diluting the core experience.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/189244API
curl https://kongchang.com/api/v1/knowledge/claims/189244MCP
get_claim(id=189244)