First-Order Phase Transition
A type of phase transition in which the order parameter of a system jumps discontinuously at a critical point, accompanied by latent heat and hysteresis, with the coexistence of ice and water as a typical example. In attention systems it means that when a control parameter crosses a critical threshold, the system abruptly jumps from one free-energy minimum to another, so a tiny perturbation of parameters can cause a sudden change in inference quality.
Timeline (last 90 days)
The research identifies the existence of a first-order phase transition in attention mechanisms, where the system can switch between two截然 different phases: a glassy state and a robust inference state.
A first-order phase transition refers to a type of phase transition in which the system's order parameter undergoes a discontinuous jump at the critical point, accompanied by latent heat and hysteresis phenomena; a typical example is the coexistence of ice and water.
In an attention system, a first-order phase transition means that when a control parameter such as temperature or the variance of the keys crosses a critical threshold, the system suddenly jumps from one free-energy minimum to another, and the system may exhibit hysteresis—the threshold for degrading from the robust state and the threshold for recovering are not the same.
All Facts (3)
The research identifies the existence of a first-order phase transition in attention mechanisms, where the system can switch between two截然 different phases: a glassy state and a robust inference state.
50%UnverifiedA first-order phase transition refers to a type of phase transition in which the system's order parameter undergoes a discontinuous jump at the critical point, accompanied by latent heat and hysteresis phenomena; a typical example is the coexistence of ice and water.
50%UnverifiedIn an attention system, a first-order phase transition means that when a control parameter such as temperature or the variance of the keys crosses a critical threshold, the system suddenly jumps from one free-energy minimum to another, and the system may exhibit hysteresis—the threshold for degrading from the robust state and the threshold for recovering are not the same.
50%