the.com/information theory

The math of surprise: predictable messages carry less news than shocking ones.

means The mathematical study of how information can be measured, compressed, stored, and transmitted reliably, even through noisy channels.

from The term crystallized with Claude Shannon's 1948 paper 'A Mathematical Theory of Communication,' written at Bell Labs — the word 'theory' here used in its rigorous scientific sense, not idle speculation. 'Information' comes from Latin informare, 'to give form to' or 'shape an idea in the mind.' Shannon's leap was to strip the word of meaning and feeling altogether, treating a message as pure probability — measured in 'bits,' a term reportedly suggested to him by colleague John Tukey as shorthand for 'binary digit.' The name stuck to a field that now underlies compression, cryptography, and nearly every signal sent down a wire.

founder
Claude Shannon, one 1948 paper, whole field born
core unit
the bit, before computers made it cool
key insight
noise can be out-talked, never fully silenced
weird fact
same math describes DNA, language, and black holes
the.com · every word