Let's Verify Step by Step

A paper published by OpenAI in 2023 demonstrating that process supervision outperforms outcome supervision, and releasing the PRM800K step-level labeled dataset.