All Fields
Computer Science
Medicine
FAQ
Contact
Sign in
Kullback–Leibler divergence
Known as:
Kl-divergence
, KL-distance
, Kullback divergence
(More)
In probability theory and information theory, the Kullback–Leibler divergence, also called discrimination information (the name preferred by Kullback…
(More)
Wikipedia
Topic mentions per year
Topic mentions per year
1957-2018
0
200
400
600
1957
2017
Related topics
Related topics
50 relations
Akaike information criterion
Bayes factor
Bayesian experimental design
Bayesian information criterion
(More)
Related mentions per year
Related mentions per year
1936-2019
1940
1960
1980
2000
2020
Kullback–Leibler divergence
Statistical classification
Entropy
Mutual information
Information theory
Optimal design
Papers overview
Semantic Scholar uses AI to extract papers important to this topic.
Review
2014
Review
2014
Rényi Divergence and Kullback-Leibler Divergence
Tim van Erven
,
Peter Harremoës
IEEE Trans. Information Theory
2014
Rényi divergence is related to Rényi entropy much like Kullback-Leibler divergence is related to Shannon’s entropy, and comes up…
(More)
Is this relevant?
2012
2012
Kullback-Leibler Divergence Constrained Distributionally Robust Optimization
Zhaolin Hu
,
L. Jeff Hong
2012
In this paper we study distributionally robust optimization (DRO) problems where the ambiguity set of the probability…
(More)
Is this relevant?
2008
2008
Kullback-Leibler divergence estimation of continuous distributions
Fernando Pérez-Cruz
2008 IEEE International Symposium on Information…
2008
We present a method for estimating the KL divergence between continuous densities and we prove it converges almost surely…
(More)
Is this relevant?
2008
2008
Anomaly detection using the Kullback-Leibler divergence metric
Mostafa Z. Afgani
,
Sinan Sinanovic
,
H. Haas
2008 First International Symposium on Applied…
2008
A method of detecting changes or anomalies in periodic information-carrying signals or any other sets of data using Kullback…
(More)
Is this relevant?
Highly Cited
2007
Highly Cited
2007
The AIC Criterion and Symmetrizing the Kullback-Leibler Divergence
Abd-Krim Seghouane
,
Shun-ichi Amari
IEEE Trans. Neural Networks
2007
The Akaike information criterion (AIC) is a widely used tool for model selection. AIC is derived as an asymptotically unbiased…
(More)
Is this relevant?
Highly Cited
2007
Highly Cited
2007
Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models
John R. Hershey
,
Peder A. Olsen
2007 IEEE International Conference on Acoustics…
2007
The Kullback Leibler (KL) divergence is a widely used tool in statistics and pattern recognition. The KL divergence between two…
(More)
Is this relevant?
Highly Cited
2004
Highly Cited
2004
The Kullback-Leibler divergence rate between Markov sources
Ziad Rached
,
Fady Alajaji
,
L. Lorne Campbell
IEEE Transactions on Information Theory
2004
In this work, we provide a computable expression for the Kullback-Leibler divergence rate lim/sub n/spl rarr//spl infin//1/nD(p…
(More)
Is this relevant?
Highly Cited
2003
Highly Cited
2003
A Kullback-Leibler Divergence Based Kernel for SVM Classification in Multimedia Applications
Pedro J. Moreno
,
Purdy Ho
,
Nuno Vasconcelos
NIPS
2003
Over the last years significant efforts have been made to develop kernels that can be applied to sequence data such as DNA, text…
(More)
Is this relevant?
2002
2002
Texture Similarity Measure Using Kullback-Leibler Divergence between Gamma Distributions
John Reidar Mathiassen
,
Amund Skavhaug
,
Ketil Bø
ECCV
2002
We propose a texture similarity measure based on the Kullback-Leibler divergence between gamma distributions (KLGamma). We…
(More)
Is this relevant?
Highly Cited
2000
Highly Cited
2000
Symmetrizing the Kullback-Leibler Distance
Don H. Johnson
,
Sinan Sinanovic
2000
We define a new distance measure the resistor-average distance between two probability distributions that is closely related to…
(More)
Is this relevant?