Tag: introspection

Entropy (Information Theory)

Initially written as a Tweet, but to-be-expounded on this blog post. When the data source produces a low-probability value (i.e., when a low-probability event occurs), the event carries more “information” than when the data source produces a high-probability value. Wiki on Entropy. Information Theory by Claude Shannon. In the context of relationships This translates to […]