In probability theory and information theory, the Kullback–Leibler divergence, also called discrimination information (the name preferred by Kullback… (More)

Semantic Scholar uses AI to extract papers important to this topic.

Review

2014

Review

2014

- Tim van Erven, Peter Harremoës
- IEEE Trans. Information Theory
- 2014

Rényi divergence is related to Rényi entropy much like Kullback-Leibler divergence is related to Shannon’s entropy, and comes up… (More)

Is this relevant?

2012

2012

- Zhaolin Hu, L. Jeff Hong
- 2012

In this paper we study distributionally robust optimization (DRO) problems where the ambiguity set of the probability… (More)

Is this relevant?

2008

2008

- Fernando Pérez-Cruz
- 2008 IEEE International Symposium on Information…
- 2008

We present a method for estimating the KL divergence between continuous densities and we prove it converges almost surely… (More)

Is this relevant?

2008

2008

- Mostafa Z. Afgani, Sinan Sinanovic, H. Haas
- 2008 First International Symposium on Applied…
- 2008

A method of detecting changes or anomalies in periodic information-carrying signals or any other sets of data using Kullback… (More)

Is this relevant?

Highly Cited

2007

Highly Cited

2007

- Abd-Krim Seghouane, Shun-ichi Amari
- IEEE Trans. Neural Networks
- 2007

The Akaike information criterion (AIC) is a widely used tool for model selection. AIC is derived as an asymptotically unbiased… (More)

Is this relevant?

Highly Cited

2007

Highly Cited

2007

- John R. Hershey, Peder A. Olsen
- 2007 IEEE International Conference on Acoustics…
- 2007

The Kullback Leibler (KL) divergence is a widely used tool in statistics and pattern recognition. The KL divergence between two… (More)

Is this relevant?

Highly Cited

2004

Highly Cited

2004

- Ziad Rached, Fady Alajaji, L. Lorne Campbell
- IEEE Transactions on Information Theory
- 2004

In this work, we provide a computable expression for the Kullback-Leibler divergence rate lim/sub n/spl rarr//spl infin//1/nD(p… (More)

Is this relevant?

Highly Cited

2003

Highly Cited

2003

- Pedro J. Moreno, Purdy Ho, Nuno Vasconcelos
- NIPS
- 2003

Over the last years significant efforts have been made to develop kernels that can be applied to sequence data such as DNA, text… (More)

Is this relevant?

2002

2002

- John Reidar Mathiassen, Amund Skavhaug, Ketil Bø
- ECCV
- 2002

We propose a texture similarity measure based on the Kullback-Leibler divergence between gamma distributions (KLGamma). We… (More)

Is this relevant?

Highly Cited

2000

Highly Cited

2000

We define a new distance measure the resistor-average distance between two probability distributions that is closely related to… (More)

Is this relevant?