ConceptShannon Information Theory / 信息论
Shannon Information Theory
A mathematical theory founded by Claude Shannon that studies the quantification, storage, and communication of information. Its core concepts include entropy, mutual information, channel capacity, and rate-distortion theory, and it forms the theoretical basis of modern communication and compression technologies.