Claude Elwood Shannon
the negative reciprocal of probability
the more predictable, the less information; the less predictable, the more information
Reference: See, for example, Shannon.
Norbert Wiener conceived of information in much the same terms at around the same period.
Gregory Bateson’s definition digests Shannon and Wiener’s work.
My goal was to digest and advance all of it. (Now it’s to try to salvage as much of what I’d done as possible.)
|Information Menu||Information Definitions|