Verified65% confidenceFactExact time
KL divergence was proposed by Solomon Kullback and Richard Leibler in 1951, originally used in statistical inference to compare the similarity of two probability distributions.
3
Sources
65%
Confidence
Long-term
Relevance
7/19/2026
First Seen
Sources
梯度下降与反向传播详解：神经网络学习机制从零拆解
Related Claims
UnverifiedKL散度最早由Solomon Kullback和Richard Leibler在1951年提出，具有非对称性即KLD(P||Q) ≠ KLD(Q||P)76% similarUnverified库恩-塔克（KKT）条件在1951年将最优性判据推广至非线性情形，构成非线性规划的核心理论基础65% similarUnverifiedThe mathematical definition of KL divergence is D_KL(P||Q) = Σ P(x) log(P(x)/Q(x)), used to measure the degree of difference between two probability distributions.65% similarVerifiedThe establishment of probability theory as a rigorous mathematical discipline traces back to Andrey Kolmogorov's publication of Foundations of the Theory of Probability in 1933, in which he provided an axiomatic definition using the language of measure theory.64% similarUnverifiedReverse KL tensorization focuses on the reverse form of the Kullback-Leibler divergence and gives an upper bound relation for how the reverse KL divergence under a product distribution is controlled by the reverse KL divergences of the marginal distributions.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/558231API
curl https://kongchang.com/api/v1/knowledge/claims/558231MCP
get_claim(id=558231)