Decomposing information into copying versus transformation

@article{Kolchinsky2019DecomposingII,
  title={Decomposing information into copying versus transformation},
  author={Artemy Kolchinsky and Bernat Corominas-Murtra},
  journal={bioRxiv},
  year={2019}
}
In many real-world systems, information can be transmitted in two qualitatively different ways: by copying or by transformation. Copying occurs when messages are transmitted without modification, e.g., when an offspring receives an unaltered copy of a gene from its parent. Transformation occurs when messages are modified systematically during transmission, e.g., when non-random mutations occur during biological reproduction. Standard information-theoretic measures do not distinguish these two… 

Behavior of information flow near criticality.

TLDR
Stochastic simulations of a driven two-dimensional Ising system are employed and the instantaneous mutual information and the information transmission rate between a driven input spin and an output spin are studied.

A graph-theoretic approach to understanding emergent behavior in physical systems

The exact dynamics of emergence remains one of the most prominent outstanding questions for the field of complexity science. I first discuss various perspectives on emergence in various contexts,

Direct and Indirect Effects—An Information Theoretic Perspective

TLDR
An identifiability result is provided and application of the proposed measures are demonstrated in estimating the causal effect of the El Niño–Southern Oscillation on temperature anomalies in the North American Pacific Northwest.

References

SHOWING 1-10 OF 81 REFERENCES

The transmission sense of information

TLDR
Taking the viewpoint of a communications engineer and focusing on the decision problem of how information is to be packaged for transport, this approach resolves several problems that have plagued the information concept in biology, and highlights a number of important features of the way that information is encoded, stored, and transmitted as genetic sequence.

Towards a mathematical theory of meaningful communication

TLDR
Inspired by the concept of duality of the communicative sign stated by the swiss linguist Ferdinand de Saussure, here is a complete description of the minimal system necessary to measure the amount of information that is consistently decoded.

Nonequilibrium correlations in minimal dynamical models of polymer copying

TLDR
A general measure of the thermodynamic efficiency with which nonequilibrium states are created is identified and the accuracy and efficiency of a family of dynamical models that produce persistent copies are analyzed, which provide insight into the design of natural self-replicating systems and can aid the designs of synthetic replicators.

The fitness value of information

TLDR
It is shown that in many cases the fitness value of a developmental cue, when measured this way, is exactly equal to the reduction in uncertainty about the environment, as described by the mutual information.

The evolution of language.

  • M. NowakD. Krakauer
  • Biology
    Proceedings of the National Academy of Sciences of the United States of America
  • 1999
TLDR
The theory provides a systematic approach for thinking about the origin and evolution of human language and argues that grammar originated as a simplified rule system that evolved by natural selection to reduce mistakes in communication.

Semantic information, autonomous agency and non-equilibrium statistical physics

TLDR
This paper defines semantic information as the syntactic information that a physical system has about its environment which is causally necessary for the system to maintain its own existence, and uses recent results in non-equilibrium statistical physics to analyse semantic information from a thermodynamic point of view.

Fundamental Costs in the Production and Destruction of Persistent Polymer Copies.

TLDR
It is shown that this separation has three fundamental thermodynamic effects, which set limits on the underlying costs and resource requirements, and suggest design principles, for autonomous copying and replication in biological and synthetic systems.

Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition

TLDR
This new edition presents unique discussions of information theoretic secrecy and of zero-error information theory, including the deep connections of the latter with extremal combinatorics.

Bits from Biology for Computational Intelligence

TLDR
This article shows how to analyze neural systems using information theory to obtain constraints that help identify the algorithms run by such systems and the information they represent.

Thermodynamics from Information

Thermodynamics and information have intricate inter-relations. The justification of the fact that information is physical, is done by inter-linking information and thermodynamics – through Landauer’s
...