Unverified50% confidenceFactExact time
DPO 由 Rafailov 等人于 2023 年提出，通过数学变换绕过奖励模型，直接用偏好数据优化策略模型
1
Sources
50%
Confidence
Long-term
Relevance
8/28/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedDPO (Direct Preference Optimization) is an alignment method proposed in 2023 that can skip reward model training and directly optimize the policy model from human preference data.77% similarUnverifiedDPO通过数学推导绕过奖励模型，直接在偏好数据上用分类损失函数优化语言模型，被Llama 3、Mistral等开源模型广泛采用72% similarUnverified微调后的模型可通过DPO（直接偏好优化）进行对齐，确保输出符合业务安全规范68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/810417API
curl https://kongchang.com/api/v1/knowledge/claims/810417MCP
get_claim(id=810417)