Mutual information of population codes and distance measures in probability space.

@article{Kang2001MutualIO,
  title={Mutual information of population codes and distance measures in probability space.},
  author={K Kang and Haim Sompolinsky},
  journal={Physical review letters},
  year={2001},
  volume={86 21},
  pages={4958-61}
}
We studied the mutual information between a stimulus and a system consisting of stochastic, statistically independent elements that respond to a stimulus. Using statistical mechanical methods the properties of the mutual information (MI) in the limit of a large system size N are calculated. For continuous valued stimuli, the MI increases logarithmically with N and is related to the log of the Fisher information of the system. For discrete stimuli the MI saturates exponentially with N. We find… CONTINUE READING

From This Paper

Figures and tables from this paper.

Citations

Publications citing this paper.
Showing 1-10 of 29 extracted citations

Predictability , Complexity , and Learning

A. U.S.
2002
View 4 Excerpts
Highly Influenced

Predictability, Complexity, and Learning

Neural Computation • 2001
View 4 Excerpts
Highly Influenced

Spontaneous activity does not predict morphological type in cerebellar interneurons.

The Journal of neuroscience : the official journal of the Society for Neuroscience • 2015
View 8 Excerpts
Highly Influenced

References

Publications referenced by this paper.
Showing 1-7 of 7 references

Phys

I. Samengo, A. Treves
Rev. E 63, 011910 • 2001
View 3 Excerpts
Highly Influenced

Inf

J. Rissanen, IEEE Trans
Theory 42, 40 • 1996
View 6 Excerpts
Highly Influenced

Neural Comput

N. Brunel, J. P. Nadal
10, 1731 • 1998

Spikes: Exploring the Neural Code

F. Rieke
1997
View 2 Excerpts

Neurosci

E. Salinas, L. F. Abbott, J. Comput
1, 89 • 1994
View 2 Excerpts

Proc

H. S. Seung, H. Sompolinsky
Natl. Acad. Sci. U.S.A. 90, 10 749 • 1993
View 3 Excerpts

Biol

M. A. Paradiso
Cybernet. 58, 35 • 1988
View 2 Excerpts

Similar Papers

Loading similar papers…