Population Majority Bias
A systematic error caused by a model's preference for the population-level majority answer. It is independent of the prompt and constitutes a structural bias arising from the prior or the training data distribution.
Timeline (last 90 days)
The paper decomposes the majority-vote supervision error under online direct preference optimization (DPO) into two parts: population-majority bias and prompt-dependent finite-rollout variation.
Population-majority bias stems from the model's preference for population-level majority answers and generally cannot be identified and eliminated without external supervision.
Although population-majority bias cannot be fully eliminated, PC-Dr.DPO significantly improves the reliability of TTRL by controlling the downstream effects of variation.
All Facts (3)
The paper decomposes the majority-vote supervision error under online direct preference optimization (DPO) into two parts: population-majority bias and prompt-dependent finite-rollout variation.
50%UnverifiedPopulation-majority bias stems from the model's preference for population-level majority answers and generally cannot be identified and eliminated without external supervision.
50%UnverifiedAlthough population-majority bias cannot be fully eliminated, PC-Dr.DPO significantly improves the reliability of TTRL by controlling the downstream effects of variation.
50%