Kronecker Delta Rule
A memory revision rule that constrains memory updates to a rank-one (outer product) structure, so that the memory matrix changes along only a single direction, thereby minimizing interference with prior knowledge. It possesses theoretical properties including convergence of the Markov chain and boundedness of the expected norm.
Timeline (last 90 days)
KronLSTM provides an update mechanism for associative matrix memory by introducing the Kronecker Delta Rule, improving long-context performance while keeping memory dynamics stable.
The Kronecker Delta Rule constrains the update to a rank-one structure (outer-product form); compared with the multi-rank updates that the standard Delta Rule may produce, a rank-one correction inherently has a single direction.
The Kronecker Delta rule extends the memory revision mechanism of the xLSTM family.
All Facts (3)
KronLSTM provides an update mechanism for associative matrix memory by introducing the Kronecker Delta Rule, improving long-context performance while keeping memory dynamics stable.
50%UnverifiedThe Kronecker Delta Rule constrains the update to a rank-one structure (outer-product form); compared with the multi-rank updates that the standard Delta Rule may produce, a rank-one correction inherently has a single direction.
50%UnverifiedThe Kronecker Delta rule extends the memory revision mechanism of the xLSTM family.
50%