Long-Range Memory State Complexity Paper

A theoretical paper studying the cost of long-range memory in sequence models. It provides precise mathematical characterizations of state complexity, context length, and dynamic criticality from a predictive risk perspective, and proves a squared-logarithmic state complexity law for algebraically decaying memory.