[KongchangAI]
ConceptPopulation-Majority Bias

Population Majority Bias

A systematic error caused by a model's preference for the population-level majority answer. It is independent of the prompt and constitutes a structural bias arising from the prior or the training data distribution.

Timeline (last 90 days)

Nov 9

The paper decomposes the majority-vote supervision error under online direct preference optimization (DPO) into two parts: population-majority bias and prompt-dependent finite-rollout variation.

Unverified50%
Nov 9

Population-majority bias stems from the model's preference for population-level majority answers and generally cannot be identified and eliminated without external supervision.

Unverified50%
Nov 9

Although population-majority bias cannot be fully eliminated, PC-Dr.DPO significantly improves the reliability of TTRL by controlling the downstream effects of variation.

Unverified50%

All Facts (3)

Source Articles