Efficient Algorithms for Searching the Minimum Information Partition in Integrated Information Theory

@article{Kitazono2018EfficientAF,
  title={Efficient Algorithms for Searching the Minimum Information Partition in Integrated Information Theory},
  author={Jun Kitazono and Ryota Kanai and Masafumi Oizumi},
  journal={Entropy},
  year={2018},
  volume={20}
}
The ability to integrate information in the brain is considered to be an essential property for cognition and consciousness. Integrated Information Theory (IIT) hypothesizes that the amount of integrated information (Φ) in the brain is related to the level of consciousness. IIT proposes that, to quantify information integration in a system as a whole, integrated information should be measured across the partition of the system at which information loss caused by partitioning is minimized… 

Figures and Tables from this paper

Information integration in large brain networks

An outstanding problem in neuroscience is to understand how information is integrated across the many modules of the brain. While classic information-theoretic measures have transformed our

Great Than The Sum: Integrated Information In Large Brain Networks

TLDR
This work presents a solution to the computation time for large systems from longer than the timespan of the universe to just several hours, and demonstrates that brain connectomes are structured in ways that facilitate high integrated information and provide the first measurement of integrated information in a real nervous system: the brain of Caenorhabditis elegans.

Evaluating Approximations and Heuristic Measures of Integrated Information

Integrated information theory (IIT) proposes a measure of integrated information, termed Phi (Φ), to capture the level of consciousness of a physical system in a given state. Unfortunately,

Different Approximation Methods for Calculation of Integrated Information Coefficient in the Brain during Instrumental Learning

TLDR
It is shown that during instrumental learning sessions, all applied approximation methods reflect temporal trends of Φ in the rat hippocampus, and the value ofΦ is positively correlated with the number of successful acts performed by a rat.

Criticality as a Determinant of Integrated Information Φ in Human Brain Networks

TLDR
Network criticality is suggested as a necessary condition of a large Φ in the human brain, a surrogate of integrated information in a complex dynamic system such as the brain.

Criticality as a Determinant of Integrated Information Φ in Human Brain Networks

TLDR
The hypothesis that network criticality, a dynamically balanced state between a large variation of functional network configurations and a large constraint of structural network configurations, is a necessary condition for the emergence of a cause-effect structure that results in a large Φ, a surrogate of integrated information, is tested.

Fast and exact search for the partition with minimal information loss

TLDR
A computationally efficient search to precisely identify the Minimum Information Partition among all possible partitions is proposed by exploiting the submodularity of the measure of information loss, when the measureof information loss is submodular.

Efficient search for informational cores in complex systems: Application to brain networks.

Efficient search for informational cores in complex systems: Application to brain networks

TLDR
The proposed algorithm for finding cores, called Hierarchical Partitioning for Complex search (HPC), enables us to find cores in large systems consisting of several hundred elements in a practical amount of time, and it is proved that HPC is exact when an information loss function satisfies a mathematical property, monotonicity.

References

SHOWING 1-10 OF 48 REFERENCES

Measuring Integrated Information from the Decoding Perspective

TLDR
The novel practical measure Φ* is derived by introducing a concept of mismatched decoding developed from information theory that is properly bounded from below and above, as required, as a measure of integrated information.

Information integration in large brain networks

An outstanding problem in neuroscience is to understand how information is integrated across the many modules of the brain. While classic information-theoretic measures have transformed our

Fast and exact search for the partition with minimal information loss

TLDR
A computationally efficient search to precisely identify the Minimum Information Partition among all possible partitions is proposed by exploiting the submodularity of the measure of information loss, when the measureof information loss is submodular.

Consciousness as Integrated Information: a Provisional Manifesto

  • G. Tononi
  • Psychology
    The Biological Bulletin
  • 2008
The integrated information theory (IIT) starts from phenomenology and makes use of thought experiments to claim that consciousness is integrated information. Specifically: (i) the quantity of

Integrated Information in Discrete Dynamical Systems: Motivation and Theoretical Framework

TLDR
A time- and state-dependent measure of integrated information, φ, which captures the repertoire of causal states available to a system as a whole and appears to be a useful metric to characterize the capacity of any physical system to integrate information.

A measure for brain complexity: relating functional segregation and integration in the nervous system.

TLDR
A measure, called neural complexity (CN), that captures the interplay between functional segregation and functional integration in brains of higher vertebrates and may prove useful in analyzing complexity in other biological domains such as gene regulation and embryogenesis.

Improved Measures of Integrated Information

TLDR
A simple taxonomy of Φ-measures is presented where they are each characterized by their choice of factorization method, choice of probability distributions to compare and choice of measure for comparing probability distributions.

An information integration theory of consciousness

  • G. Tononi
  • Psychology, Biology
    BMC Neuroscience
  • 2004
TLDR
The information integration theory accounts, in a principled manner, for several neurobiological observations concerning consciousness, including the association of consciousness with certain neural systems rather than with others; the fact that neural processes underlying consciousness can influence or be influenced by neural processes that remain unconscious; the reduction of consciousness during dreamless sleep and generalized seizures.

From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3.0

TLDR
Integrated Information Theory of consciousness 3.0 is presented, which incorporates several advances over previous formulations and arrives at an identity: an experience is a maximally irreducible conceptual structure (MICS, a constellation of concepts in qualia space), and the set of elements that generates it constitutes a complex.

A Theoretically Based Index of Consciousness Independent of Sensory Processing and Behavior

TLDR
An electroencephalographic-derived index of human consciousness that reflects the information content of the brain’s response to a magnetic stimulus is defined, and appears to be a robust measure that distinguishes conscious from unconscious states well enough to be used on an individual basis, a prerequisite for deployment in the clinic.