Direct Nash Optimization

A large-model alignment method that models preference alignment as a two-player game and iteratively approaches a Nash equilibrium. Its practical variant, DNO-Prct, uses a closed-loop process of online sampling, LLM scoring, filtering preference pairs, and DPO updates.