Estimating mutual information and multi-information in large networks

  title={Estimating mutual information and multi-information in large networks},
  author={Noam Slonim and Gurinder S. Atwal and Ga{\vs}per Tka{\vc}ik and William Bialek},
We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained with manageable computational effort. The same methods allow estimation of higher order, multi–information terms. These ideas are illustrated by analyses of gene expression, financial markets, and consumer preferences. In each case, information theoretic… CONTINUE READING
Highly Cited
This paper has 74 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 32 extracted citations

Voice Pathology Detection and Discrimination Based on Modulation Spectral Features

IEEE Transactions on Audio, Speech, and Language Processing • 2011
View 4 Excerpts
Highly Influenced

Nonparametric estimation of information causality between analog narrowband signals

2015 International Symposium on Wireless Communication Systems (ISWCS) • 2015
View 1 Excerpt

Positional information, in bits.

Proceedings of the National Academy of Sciences of the United States of America • 2013
View 2 Excerpts

Transfer entropy as a tool for reconstructing interaction delays in neural signals

International Symposium on Signals, Circuits and Systems ISSCS2013 • 2013
View 1 Excerpt

74 Citations

Citations per Year
Semantic Scholar estimates that this publication has 74 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-6 of 6 references

O Carmel–Harel

AP Gasch, PT Spellman, CM Kao
MB Eisen, G Storz, D Botstein & PO Brown, Mol Biol Cell 11, 4241–4257 • 2000
View 8 Excerpts
Highly Influenced

RR de Ruyter van Steveninck & W Bialek

SP Strong, R Koberle
Phys Rev Lett 80, 197–200 • 1998
View 3 Excerpts
Highly Influenced

F Shafee & W Bialek

I Nemenman
Advances in Neural Information Processing 14, TG Dietterich, S Becker & Z Ghahramani, eds, pp 471–478 (MIT Press, Cambridge, 2002). I Nemenman, W Bialek & R de Ruyter van Steveninck, Phys Rev E 69, 056111 • 2004
View 1 Excerpt

MJ Berry II & W Bialek

E Schneidman, S Still
Phys Rev Lett 91, 238701 • 2003
View 2 Excerpts

in Information Theory in Psychology: Problems and Methods IIB H Quastler

GA Miller
ed. pp 95–100 (Free Press, Glencoe IL, 1955). See also A Treves & Panzeri, Neural Comp 7, 399–407 (1995), and L Paninski, Neural Comp 15, 1191–1253 • 2003
View 1 Excerpt

L Issel– Tarver

M Ashburner, CA Ball, +9 authors DP Hill
A Kasarskis, S Lewis, JCMatese, JE Richardson, M Ringwald, GM Rubin & G Sherlock, Nature Genetics 25, 25–29 • 2000
View 1 Excerpt

Similar Papers

Loading similar papers…