Multivariate information transmission

@article{McGill1954MultivariateIT,
  title={Multivariate information transmission},
  author={William J. McGill},
  journal={Psychometrika},
  year={1954},
  volume={19},
  pages={97-116}
}
  • W. J. McGill
  • Published 1 June 1954
  • Computer Science
  • Psychometrika
A multivariate analysis based on transmitted information is presented. It is shown that sample transmitted information provides a simple method for measuring and testing association in multi-dimensional contingency tables. Relations with analysis of variance are pointed out, and statistical tests are described. 
Epistasis analysis using information theory.
TLDR
Entropy-based measures derived from information theory for detecting and characterizing epistasis in genetic association studies and a few published studies of complex human diseases that have used these measures.
A new unconditional information inequality
  • Zhen Zhang, R. Yeung
  • Mathematics, Computer Science
    1998 Information Theory Workshop (Cat. No.98EX131)
  • 1998
TLDR
This paper reports an unconditional inequality of Shannon's information measures which is not implied by the nonnegativity of such measures, which is the first such inequality ever discovered.
Explaining data using causal Bayesian networks
TLDR
Causal Bayesian Networks are introduced as a formalism for representing and explaining probabilistic causal relations and a research avenue for studying pairwise identification of causal relations inspired by graphical causality criteria is illustrated.
Multiple Mutual Informations and Multiple Interactions in Frequency Data
McGill's multiple mutual informations are useful to systematically describe multiple interactions of frequency data with general n-way. The asymptotic behaviour of the maximum likelihood estimators
Interaction information in multivariate probability distributions
Abstract : It is shown in this note that the entropy of a multivariate distribution can be expressed in terms of the sum of onedimensional marginal entropies, the sum of transmitted information
Interaction information for causal inference: The case of directed triangle
TLDR
This work uses interaction information, which can be negative, to find the direction of causal influences among variables in a triangle topology under some mild assumptions.
Multivariate Mutual Information Measures for Discovering Biological Networks
TLDR
This paper introduces multivariate mutual information measures to reconstruct multivariate interactions/relationships in biological networks.
observational data bases and for performing multivariate information analysis and log-linear contingency table analysis of sequential and nonsequential data
The sequential and nonsequential analysis of observa­ tional data requires the use of a mathematical model that is appropriate to nominal scale variables. Schlundt (Note 1) discusses this issue and
Information and Symmetry
TLDR
This work journeys through the assumptions, advantages and disadvantages of the view of a particular model of the universe based on probability theory based on symmetries between probabilities, which reveals ignorance, indifference and information.
...
...

References

SHOWING 1-9 OF 9 REFERENCES
Transmission of information
A quantitative measure of “information” is developed which is based on physical as contrasted with psychological considerations. How the rate of transmission of this information over a system is
ON THE PROBABILITY THAT TWO INDEPENDENT DISTRIBUTIONS OF FREQUENCY ARE REALLY SAMPLES FROM THE SAME PARENT POPULATION
nl, n2, fl3, ... fS, *n, and ni, P2, n* ,... nv Then I proved in a paper published in 1911 , that if 28=vN.N` n, 2 1 8=N N'N N Ps. the frequency distribution of x2 would be given by y =
Transmission of information
A quantitative measure of “information” is developed which is based on physical as contrasted with psychological considerations. How the rate of transmission of this information over a system is
The amount of information in absolute judgements.
Computational methods useful in analyzing series of binary data.
  • E. B. Newman
  • Computer Science
    The American journal of psychology
  • 1951
The mathematical theory of communication
TLDR
This commemorative reprinting of The Mathematical Theory of Communication, published originally as a paper on communication theory more than fifty years ago, is released.