Information theory · 1948 · Claude E. Shannon
A Mathematical Theory of Communication
Measure information as uncertainty and derive mathematical limits for compression and reliable communication without depending on message meaning.
The central move
Measure information as uncertainty and derive mathematical limits for compression and reliable communication without depending on message meaning.
Why it had to exist
Communication engineers needed to compare sources and noisy channels. Ordinary language about meaning could not tell them the minimum number of bits or the maximum reliable transmission rate.
Where it leads
Entropy → source and error-correcting codes → storage, networks, cryptography, statistics, and modern token budgets.