Unverified50% confidenceFactExact time
Thermodynamic entropy in physics and Shannon entropy in information theory are deeply connected in mathematical form, but they are not the same thing.
1
Sources
50%
Confidence
Long-term
Relevance
11/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSupporters respond that concepts such as phase space and entropy in physics also initially faced criticism of being non-operational, but eventually became standard tools, and interpretability may need a similar conceptual upgrade.72% similarUnverifiedUsing the Rényi chain rule, the paper decomposes the sequence-level Rényi entropy into step-wise entropies of arbitrary order, and when α>1 the step-wise entropy is closely related to the most likely token at each step.71% similarUnverifiedThe geometric energy dissipation theorem derives that entropy in a closed system evolves in an oscillatory rather than monotonically increasing manner.71% similarUnverifiedThe concept of information entropy originates from information theory, proposed by Claude Shannon in 1948 to measure uncertainty and disorder in information systems.67% similarUnverifiedThe formation of a white hole requires the system to spontaneously return from high entropy to low entropy, which contradicts the second law of thermodynamics and the direction of the arrow of time in the universe.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1158690API
curl https://kongchang.com/api/v1/knowledge/claims/1158690MCP
get_claim(id=1158690)