ConceptDistribution Illusion
Distribution Hallucination
A failure mode in contrastive learning in which a wider margin between the similarity distributions of positive and negative samples does not necessarily translate into better retrieval performance; a gap exists between distribution metrics and task performance.
Timeline (last 90 days)
Oct 14
A wider gap between the similarity distributions of positives and negatives does not necessarily translate into better retrieval performance; there is a gap between distribution-level 'looking good' and task-level 'working well' (termed 'distribution illusion').
Unverified50%