LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

On Suspicious Coincidences and Pointwise Mutual Information

Photo by alterego_swiss from unsplash

Abstract Barlow (1985) hypothesized that the co-occurrence of two events A and B is “suspicious” if P(A,B)≫P(A)P(B). We first review classical measures of association for 2 × 2 contingency tables,… Click to show full abstract

Abstract Barlow (1985) hypothesized that the co-occurrence of two events A and B is “suspicious” if P(A,B)≫P(A)P(B). We first review classical measures of association for 2 × 2 contingency tables, including Yule's Y (Yule, 1912), which depends only on the odds ratio λ and is independent of the marginal probabilities of the table. We then discuss the mutual information (MI) and pointwise mutual information (PMI), which depend on the ratio P(A,B)/P(A)P(B), as measures of association. We show that once the effect of the marginals is removed, MI and PMI behave similarly to Y as functions of λ. The pointwise mutual information is used extensively in some research communities for flagging suspicious coincidences. We discuss the pros and cons of using it in this way, bearing in mind the sensitivity of the PMI to the marginals, with increased scores for sparser events.

Keywords: mutual information; information; suspicious coincidences; coincidences pointwise; pointwise mutual

Journal Title: Neural Computation
Year Published: 2022

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.