Information Theory

A mathematical theory founded by Claude Shannon whose core concern is quantifying the reduction of uncertainty in information; it is widely applied in communications, coding, and related fields.