Min-Entropy
The limit of Renyi entropy as α→∞, determined solely by the most probable word; it is the most sensitive to the peak of a probability distribution.
Timeline (last 90 days)
As α→0, Renyi entropy approaches the observed vocabulary richness (the logarithm of the number of word types that have appeared); at α=1 it equals Shannon entropy; at α=2 it is called collision entropy; and as α→∞ it yields min-entropy.
The robustness of the turning-point order was verified under multiple settings: in four other settings, min-entropy still turned before richness (in Hindi it holds only at the interpolation root); and among 13 different measurements under eight text representations, 12 support this order.
All Facts (2)
As α→0, Renyi entropy approaches the observed vocabulary richness (the logarithm of the number of word types that have appeared); at α=1 it equals Shannon entropy; at α=2 it is called collision entropy; and as α→∞ it yields min-entropy.
50%UnverifiedThe robustness of the turning-point order was verified under multiple settings: in four other settings, min-entropy still turned before richness (in Hindi it holds only at the interpolation root); and among 13 different measurements under eight text representations, 12 support this order.
50%