[KongchangAI]
ConceptSemantic Collapse

semantic collapse

The phenomenon in which text loses semantic information once separated from its context. It refers to the loss of structural information (such as headings and hierarchy) during text splitting, causing embedding vectors to collapse and semantic coordinates to converge toward a common attractor.

Timeline (last 90 days)

Oct 13

Once text is divorced from its original structural context, its semantics collapse, manifesting as text that should be distinguishable obtaining nearly identical vectors in the embedding space

Unverified50%
Oct 13

Semantic collapse occurs before the text is encoded into vectors, so switching to a stronger embedding model usually cannot fix this kind of retrieval bug caused by loss of context

Unverified50%

All Facts (2)

Source Articles