Unverified50% confidenceFactExact time
Mutual information I(X;Y) is defined as the KL divergence between the joint distribution and the product of the marginal distributions, equivalent to the reduction in uncertainty about Y from knowing X.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
Unverified互信息定义为I(X;Y) = H(X) + H(Y) - H(X,Y)，度量两个变量间的总依赖关系（包括线性和非线性），为零当且仅当两变量统计独立71% similarUnverifiedFor a random variable Y and its predicted cumulative distribution function F(y|X), the PIT value is defined as U=F(Y|X); if the predicted distribution is completely correct, U follows a uniform distribution on [0,1].67% similarUnverifiedUnder the multivariate Gaussian distribution, mutual information is fully determined by the covariance matrix and can be expressed as the ratio of the determinant of the joint covariance matrix to the determinant of the marginal covariance matrices.64% similarUnverifiedThe posterior distribution is obtained via Bayes' theorem: p(θ|x) ∝ p(x|θ)·p(θ), combining prior knowledge with the data likelihood.64% similarUnverifiedThe residual distribution is defined as follows: for tokens where the target model probability p(x) is greater than the draft model probability q(x), the residual probability is proportional to max(0, p(x)-q(x)); this mechanism ensures that the marginal distribution of the sampled results strictly equals the original distribution of the target model.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1010263API
curl https://kongchang.com/api/v1/knowledge/claims/1010263MCP
get_claim(id=1010263)