Modern Hopfield networks introduce higher-order interaction terms to raise storage capacity to an exponential level, allowing an exponentially larger number of patterns to be stored at the same parameter scale.