ConceptPositional Realizability Theory
Position Realizability Theory
A theoretical framework concerning length generalization that analyzes the behavior of position kernels on longer grids via a simulated transition operator, explaining how positional encoding schemes affect length generalization.
Timeline (last 90 days)
Nov 2
The paper proposes a "position realizability theory" to explain the dependence of length generalization on positional encoding and derives widely documented empirical patterns.
Unverified50%