Unverified50% confidenceFactExact time
The study focuses on answer preference in multiple-choice scenarios, measured by the logit margin between the correct answer and competing options.
1
Sources
50%
Confidence
Long-term
Relevance
10/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe paired comparison design separates the two factors of modality preference and evidence position, allowing changes in answers after swapping the order to be directly attributed to position itself.74% similarUnverified'Position bias' is a systematic bias documented in multiple studies: LLMs in two-option comparisons tend to favor the option listed first or last74% similarUnverifiedIn system design interviews, in-depth discussion of trade-offs (such as why one would choose eventual consistency over strong consistency in a specific scenario) is a key indicator distinguishing mid-level from senior engineers.70% similarUnverifiedLLM judges exhibit position bias: in pairwise comparisons, judges tend to favor the answer in a certain position, usually the first; merely swapping the order of the candidate answers can flip the ranking (Wang et al.).70% similarUnverifiedFor tone judgments on customer service agents, pointwise scoring is used, comparing a single answer against a threshold; when ranking is needed, switch to pairwise comparison and run both orders, because models tend to favor the answer they read first.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1114656API
curl https://kongchang.com/api/v1/knowledge/claims/1114656MCP
get_claim(id=1114656)