Jorge Silva, Shrikanth Narayanan: “On Data-Driven Histogram-Based Estimation for Mutual Information”

June 13, 2010 | Austin, TX

Speaker: Jorge Silva, Shrikanth Narayanan
Host: IEEE International Symposium on Information Theory (ISIT)

The problem of mutual information (MI) estimation based on data-dependent partition is addressed in this work. Sufficient conditions are stipulated on a histogram-based construction to guarantee a strong consistent estimate for the MI. The practical implications of this result are in the specification of a range of design parameters for two data-driven histogrambased approaches – statistically equivalent blocks and treestructure vector quantizations – to yield density-free strongly consistent estimates for the MI.