Information Geometry

  • Home
  • About Us
  • Privacy Policy
  • Contact Us
Home  /  News  /  The Burbea-Rao and Bhattacharyya centroids

The Burbea-Rao and Bhattacharyya centroids

Frank April 29, 2010 News Comments are off

We study the centroid with respect to the class of information-theoretic distortion measures called Burbea-Rao divergences. Burbea-Rao divergences generalize the Jensen-Shannon divergence by measuring the non-negative Jensen difference induced by a strictly convex and differentiable function expressing a measure of entropy. We first show that a symmetrization of Bregman divergences called Jensen-Bregman distances yields a natural definition of Burbea-Rao divergences. We then define skew Burbea-Rao divergences, and prove that skew Burbea-Rao divergences amount to compute Bregman divergences in asymptotical cases. We prove that Burbea-Rao centroids are always unique, and we design a generic iterative algorithm for efficiently estimating those centroids with guaranteed convergence. In statistics, the Bhattacharyya distance is widely used to measure the degree of overlap of probability distributions. This distance notion is all the more useful as it provides both upper and lower bounds on Bayes misclassification error, and turns out to be equal at the infinitesimal level to Fisher information. We show that Bhattacharyya distances on members of the same exponential family amount to calculate a Burbea-Rao divergence. We thus get as a byproduct an efficient algorithm for computing the Bhattacharyya centroid of a set of parametric distributions belonging to the same exponential families, improving over former specialized methods that were mostly limited to univariate or “diagonal” multivariate Gaussians.

Here is theĀ arxiv report

Share this...
Share on Facebook
Facebook
Pin on Pinterest
Pinterest
Tweet about this on Twitter
Twitter
Share on LinkedIn
Linkedin
Previous Article
Next Article

About Author

Frank

Related Posts

  • How to Choose a General Contractor for a Custom Home

    How to Choose a General Contractor for a Custom Home

    December 8, 2022
  • How Do Security Systems Work at Home?

    How Do Security Systems Work at Home?

    December 1, 2022
  • Common CCTV Problems and Their Fixes

    Common CCTV Problems and Their Fixes

    November 24, 2022

Recent Posts

  • How to Choose a General Contractor for a Custom Home
  • How Do Security Systems Work at Home?
  • Common CCTV Problems and Their Fixes
  • How to Choose Upholstery Fabric?
  • Why Educational Signage Is Important?
  • Pros and Cons of Foam Filled Tires
  • What Does an Accountant Do?
  • Types of Vacuum Cleaners
  • Tips For Hiring a Ducted Air Conditioning Installer
  • Common Roofing Problems And How To Fix Them

Archives

  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • June 2010
  • May 2010
  • April 2010
  • March 2010
February 2023
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
2728  
« Dec    
Theme by ThemesPie | Proudly Powered by WordPress