Unverified50% confidenceFactExact time
The implicit reward margin magnitude refers to the difference between the reward scores implicitly assigned by the model to a pair of responses in a preference optimization model (such as the Bradley-Terry model), i.e., |r(A)-r(B)|.
1
Sources
50%
Confidence
Long-term
Relevance
10/27/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn RLHF, if preference data is of low quality or contains systematic bias, the reward model will learn incorrect signals, causing the model's behavior to deviate from expectations.73% similarUnverifiedThe study defines the Private Sparse RLHF problem: it assumes the reward model is governed by only s* ≪ d relevant features and that preference feedback follows the Bradley-Terry-Luce (BTL) model.72% similarUnverifiedReward guidance during diffusion model sampling is usually implemented by computing the gradient of the reward function with respect to the current sample and adding it, with a weight, to the denoising update, similar to classifier guidance or classifier-free guidance, but with the guidance signal coming from an external reward model.72% similarUnverifiedThe Bellman equation exploits the Markov property to decompose the expectation of long-term return into "immediate reward + discounted value of the next state," thereby transforming a sequential decision problem into an equation that can be solved iteratively.70% similarVerifiedReward model training can use learning-to-rank frameworks such as the Bradley-Terry model, training a neural network to predict the probability of human preference between any two responses, taking a (prompt, response) pair as input and outputting a scalar score.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1102736API
curl https://kongchang.com/api/v1/knowledge/claims/1102736MCP
get_claim(id=1102736)