DeepSeek R1-zero trained a base model directly with pure reinforcement learning; its AIME 2024 pass@1 rose from 15.6% to 71%, and 64-sample majority voting reached 86.7%, and the paper says it matches or exceeds the early version of o1.