[KongchangAI]
Conceptmin-entropy / 最小熵

Min-Entropy

The limit of Renyi entropy as α→∞, determined solely by the most probable word; it is the most sensitive to the peak of a probability distribution.

Timeline (last 90 days)

Nov 9

As α→0, Renyi entropy approaches the observed vocabulary richness (the logarithm of the number of word types that have appeared); at α=1 it equals Shannon entropy; at α=2 it is called collision entropy; and as α→∞ it yields min-entropy.

Unverified50%
Nov 9

The robustness of the turning-point order was verified under multiple settings: in four other settings, min-entropy still turned before richness (in Hindi it holds only at the interpolation root); and among 13 different measurements under eight text representations, 12 support this order.

Unverified50%

All Facts (2)

Source Articles