Unverified50% confidenceFactExact time
The asymptotic equipartition property (AEP) states that for a stationary ergodic source, as the sequence length n tends to infinity, the probability of occurrence of a typical sequence is approximately 2^{-nH}, where H is the source entropy.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedFor a stationary ergodic process, the entropy rate limit exists and equals the conditional entropy limit lim H(X_n|X_{n-1},...,X_1).74% similarUnverifiedShannon's information entropy formula is H = -Σ p(x) log₂ p(x), which describes the average uncertainty of a random variable.70% similarUnverifiedKac's lemma states that the time required for a stationary source to repeatedly output a block of length n grows exponentially with the entropy of that block.68% similarUnverified跨分词器蒸馏前应先测量熵保留率或概率质量对齐度以避免在错误目标上浪费算力65% similarUnverified从信息论角度，DSL约束的本质是降低了输出分布的熵，一个等概率的N选1分布熵值为log₂N64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1028948API
curl https://kongchang.com/api/v1/knowledge/claims/1028948MCP
get_claim(id=1028948)