Claude Elwood Shannon’s Information

  • H = -∑pi
  • Claude Elwood Shannon

    the negative reciprocal of probability
    the more predictable, the less information; the less predictable, the more information

    Reference: See, for example, Shannon.

    Norbert Wiener conceived of information in much the same terms at around the same period.
    Gregory Bateson’s definition digests Shannon and Wiener’s work.
    My goal was to digest and advance all of it. (Now it’s to try to salvage as much of what I’d done as possible.)

    Information Menu Information Definitions

    About pk

    Seems to me that some modicum of honesty is requisite to intelligence. If we look in the mirror and see not kleptocrats but Christians, we’re still in the same old trouble.
    This entry was posted in definition, information, pk Teaching, thinking tools. Bookmark the permalink.

    Leave a Reply

    Fill in your details below or click an icon to log in: Logo

    You are commenting using your account. Log Out /  Change )

    Google photo

    You are commenting using your Google account. Log Out /  Change )

    Twitter picture

    You are commenting using your Twitter account. Log Out /  Change )

    Facebook photo

    You are commenting using your Facebook account. Log Out /  Change )

    Connecting to %s