Kac's Lemma

A mathematical lemma originating in ergodic theory, stating that in a stationary ergodic system the expected return time to a state or block of states is inversely proportional to its measure. In information-theoretic contexts it is generalized to describe how the time required for a stationary source to repeat a given block grows exponentially with the entropy of that block.