Unverified50% confidenceFactExact time
The reward model training paradigm used by OpenAI when training InstructGPT is essentially an instantiation of the Bradley–Terry framework.
1
Sources
50%
Confidence
Long-term
Relevance
10/8/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe three-stage alignment training paradigm of SFT–reward model–RLHF was first systematically proposed by OpenAI in the InstructGPT paper.79% similarUnverifiedOpenAI's training of InstructGPT and Anthropic's training of Claude both rely heavily on human-in-the-loop mechanisms.74% similarUnverifiedRL Gym概念源自OpenAI开源的标准化强化学习训练环境框架72% similarVerifiedOpen weights differ from fully open source: the former makes model parameters public but does not necessarily disclose training data and complete training code.72% similarUnverifiedThe author speculates that the opinionated tendency observed in open-source models may be related to distillation training, as the training data comes from commercial large model outputs that are assumed to be correct by default71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/987019API
curl https://kongchang.com/api/v1/knowledge/claims/987019MCP
get_claim(id=987019)