[KongchangAI]
Conceptoverlaps

Overlap

An order parameter in learning theory enabled by statistical physics, used to quantify the degree of alignment between features learned by a network and target features, typically defined as the normalized inner product of a weight vector with a target feature direction.

Timeline (last 90 days)

Oct 17

Overlap between chunks protects adjacent context and prevents key information from being split at boundaries, but it cannot recover, across long distances, related information scattered in different places.

Unverified50%

All Facts (1)

Source Articles