Abstract

This work studies the problem of information divergence estimation based on data-dependent partitions. A histogram-based data-dependent estimate is proposed adopting a version of Barron-type histogram-based estimate. The main result is the stipulation of sufficient conditions on the partition scheme to make the estimate strongly consistent. Furthermore, when the distributions are equipped with density functions in (Rd,B(Rd)), we obtain sufficient conditions that guarantee a density-free strongly consistent information divergence estimate. In this context, the result is presented for two emblematic partition schemes: the statistically equivalent blocks (Gessaman's data-driven partition) and data-dependent tree-structured vector quantization (TSVQ).

Date

November 1, 2010

Authors

Jorge Silva, Shrikanth S Narayanan

Journal

Journal of Statistical Planning and Inference

Volume

140

Issue

11

Pages

3180-3198

Publisher

North-Holland