LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

The f-Divergence and Coupling of Probability Distributions

We consider the problem of finding the minimum and maximum values of f -divergence for discrete probability distributions P and Q provided that one of these distributions and the value… Click to show full abstract

We consider the problem of finding the minimum and maximum values of f -divergence for discrete probability distributions P and Q provided that one of these distributions and the value of their coupling are given. An explicit formula for the minimum value of the f -divergence under the above conditions is obtained, as well as a precise expression for its maximum value. This precise expression is not explicit in the general case, but in many special cases it allows us to write out both explicit formulas and simple upper bounds, which are sometimes optimal. Similar explicit formulas and upper bounds are also obtained for the Kullback–Leibler and χ 2 divergences, which are the most important cases of the f -divergence.

Keywords: probability distributions; coupling probability; divergence; value; divergence coupling

Journal Title: Problems of Information Transmission
Year Published: 2021

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.