Unverified50% confidenceFactExact time
The choice of bottleneck dimensionality is essentially a trade-off between information compression rate and reconstruction quality, corresponding to rate-distortion theory; Shannon proved in 1959 that there exists a theoretical minimum coding rate lower bound for a given distortion tolerance.
1
Sources
50%
Confidence
Long-term
Relevance
8/22/2026
First Seen
Sources
Entropic Scree：用信息熵替代方差重构PCA降维方法
Related Entities
Related Claims
Unverified香农的率失真理论证明，在给定比特率约束下，任何有损压缩都存在不可逾越的失真下界75% similarUnverifiedSaxe and other researchers challenged the compression phase of the information bottleneck, finding that the compression phase is not universally present and its occurrence depends on the choice of activation function (e.g., compression often does not appear when using ReLU)71% similarUnverified梯度下降的收敛条件与学习率和损失函数的Lipschitz常数的关系有关70% similarUnverifiedNegative constraints narrow the probability space by explicitly excluding undesired outputs, are equally important as positive instructions, and can reduce deviations caused by the model's creative improvisation.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/788596API
curl https://kongchang.com/api/v1/knowledge/claims/788596MCP
get_claim(id=788596)