QuoteProject
Information: the negative reciprocal value of probability.
Claude Shannon
ShareWTF𝕏

Interpretation

What this quote means

This quote emphasizes the relationship between information and probability in a mathematical context.

Claude Shannon's quote succinctly describes how information can be quantified in relation to probability. By viewing information as the negative reciprocal of probability, it highlights the idea that as an event becomes more likely, the amount of new information it provides decreases, thus bridging concepts of uncertainty, knowledge, and communication in the fields of information theory and statistics.

Themes

InformationProbabilityCommunicationKnowledgeUncertainty

In practice

Example use cases

In a lecture on information theory, discussing the foundational ideas of Claude Shannon.

Similar quotes

I miss the early days; I do. I was so lucky. I basically had it to myself, learning about these chimpanzees. Nobody knew anything about them. Discovering their different personalities, different life histories. I was lucky.
Jane GoodallRead
Brain studies of mental workouts in which you sustain a single, chosen focus show that the more you detach from what's distracting you and refocus on what you should be paying attention to, the stronger this brain circuitry becomes.
Daniel GolemanRead
After exponential quantities the circular functions, sine and cosine, should be considered because they arise when imaginary quantities are involved in the exponential.
Leonhard EulerRead
If you take 100 breast-cancer samples, 100 types of cancer have 100 different hallmarks of mutated genes. You could be nihilistic and say, 'Oh, God, we'll never be able to tackle this!' But there are deep, systematic, organizational principles at work in all that diversity.
Siddhartha MukherjeeRead
An Experiment, like every other event which takes place, is a natural phenomenon; but in a Scientific Experiment the circumstances are so arranged that the relations between a particular set of phenomena may be studied to the best advantage.
James Clerk MaxwellRead
The constancy of the internal environment is the condition for free and independent life: the mechanism that makes it possible is that which assured the maintenance, with the internal environment, of all the conditions necessary for the life of the elements.
Claude BernardRead

A little wisdom, now and then

Subscribe for the occasional hand-picked quote. No noise.