Mutual information of population codes and distance measures in probability space.

  title={Mutual information of population codes and distance measures in probability space.},
  author={K Kang and Haim Sompolinsky},
  journal={Physical review letters},
  volume={86 21},
We studied the mutual information between a stimulus and a system consisting of stochastic, statistically independent elements that respond to a stimulus. Using statistical mechanical methods the properties of the mutual information (MI) in the limit of a large system size N are calculated. For continuous valued stimuli, the MI increases logarithmically with N and is related to the log of the Fisher information of the system. For discrete stimuli the MI saturates exponentially with N. We find… CONTINUE READING

From This Paper

Figures and tables from this paper.


Publications citing this paper.
Showing 1-10 of 29 extracted citations

Predictability , Complexity , and Learning

A. U.S.
View 4 Excerpts
Highly Influenced

Predictability, Complexity, and Learning

Neural Computation • 2001
View 4 Excerpts
Highly Influenced

Spontaneous activity does not predict morphological type in cerebellar interneurons.

The Journal of neuroscience : the official journal of the Society for Neuroscience • 2015
View 8 Excerpts
Highly Influenced


Publications referenced by this paper.
Showing 1-7 of 7 references


I. Samengo, A. Treves
Rev. E 63, 011910 • 2001
View 3 Excerpts
Highly Influenced


J. Rissanen, IEEE Trans
Theory 42, 40 • 1996
View 6 Excerpts
Highly Influenced

Neural Comput

N. Brunel, J. P. Nadal
10, 1731 • 1998

Spikes: Exploring the Neural Code

F. Rieke
View 2 Excerpts


E. Salinas, L. F. Abbott, J. Comput
1, 89 • 1994
View 2 Excerpts


H. S. Seung, H. Sompolinsky
Natl. Acad. Sci. U.S.A. 90, 10 749 • 1993
View 3 Excerpts


M. A. Paradiso
Cybernet. 58, 35 • 1988
View 2 Excerpts

Similar Papers

Loading similar papers…