A unified theory of information transfer and causal relation

  title={A unified theory of information transfer and causal relation},
  author={Yang Tian and Hedong Hou and Yaoyuan Wang and Ziyang Zhang and Pei Sun},
Information transfer between coupled stochastic dynamics, measured by transfer entropy and information flow, is suggested as a physical process underlying the causal relation of systems. While information transfer analysis has booming applications in both science and engineering fields, critical mysteries about its foundations remain unsolved. Fundamental yet difficult questions concern how information transfer and causal relation originate, what they depend on, how they differ from each other, and… 

Figures from this paper


Assessing transfer entropy from biochemical data.
The computational methods are tested by using them in analyzing data generated from a theoretically tractable time-varying signal model, which leads to the development of a method to screen only statistically significant estimates.
Fourier-domain transfer entropy spectrum
The Fourier-domain transfer entropy spectrum is proposed, a novel generalization of transfer entropy, as a model-free metric of causality for arbitrary systems, and its validity in the aspects of parameter dependence, statistic significance test, and sensibility is demonstrated.
TENET: gene network reconstruction using transfer entropy reveals key regulatory factors from single cell transcriptomic data
This work proposes a novel approach ‘TENET’ to reconstruct GRNs from single cell RNA sequencing (scRNAseq) datasets, and shows outstanding performance in identifying key regulators compared to existing methods; TENET can reveal previously uncharacterized regulators.
Effective Transfer Entropy Approach to Information Flow Among EPU, Investor Sentiment and Stock Market
In contrast to the traditional view that economic policy affects investor sentiment and eventually causes stock price fluctuations, we reveal that investor sentiment is a reflection of both economic
Transfer entropy rate through Lempel-Ziv complexity.
The simulation results over three different unidirectional coupled dynamical systems suggest that this methodology can be used to assess the direction and strength of the information flow between systems and provides good estimations for short-length time series.
Symbolic transfer entropy.
Analyzing multiday, multichannel electroencephalographic recordings from 15 epilepsy patients, it is demonstrated numerically that symbolic transfer entropy is a robust and computationally fast method to quantify the dominating direction of information flow between time series.
Transfer Entropy and Transient Limits of Computation
This work generalises Landauer's limit to bi-directional information dynamics for non-equilibrium processes, revealing that the limit applies to prediction, in addition to retrodiction (information erasure), and establishes transfer entropy as a central measure connecting information theory, thermodynamics and theory of computation.
Assessing causality from multivariate time series.
  • P. F. Verdes
  • Mathematics
    Physical review. E, Statistical, nonlinear, and soft matter physics
  • 2005
In this work we propose a general nonparametric test of causality for weakly dependent time series. More precisely, we study the problem of attribution, i.e., the proper comparison of the relative