# Minimal Algorithmic Information Loss Methods for Dimension Reduction, Feature Selection and Network Sparsification.

@article{Zenil2020MinimalAI, title={Minimal Algorithmic Information Loss Methods for Dimension Reduction, Feature Selection and Network Sparsification.}, author={Hector Zenil and Narsis Aftab Kiani and Felipe S. Abrah{\~a}o and Antonio Rueda-Toicen and Allan A. Zea and Jesper Tegn'er}, journal={arXiv: Data Structures and Algorithms}, year={2020} }

We introduce a family of unsupervised, domain-free, and (asymptotically) model-independent algorithms based on the principles of algorithmic probability and information theory designed to minimize the loss of algorithmic information, including a lossless-compression-based lossy compression algorithm. The methods can select and coarse-grain data in an algorithmic-complexity fashion (without the use of popular compression algorithms) by collapsing regions that may procedurally be regenerated from…

## 9 Citations

### An Algorithmic Information Distortion in Multidimensional Networks

- Computer ScienceCOMPLEX NETWORKS
- 2020

It is demonstrated that the algorithmic information necessary to encode multidimensional networks that are isomorphic to logarithmically compressible monoplex networks may display exponentially larger distortions in the general case.

### On incompressible multidimensional networks

- Computer Science
- 2018

It is proved that incompressible general multidimensional networks have edges linking vertices at non-sequential time instants (layers or, in general, elements of a node dimension) and representational incompressibility implies a necessary underlying constraint in the multiddimensional network topology.

### Emergence of complex data from simple local rules in a network game

- Computer ScienceArXiv
- 2020

This article presents a model for a network game played by complex networks in which nodes are computable systems and discusses how some network topological properties and simple local communication rules are able to generate a phase transition with respect to the emergence of incompressible data.

### Algorithmic Information Dynamics

- Computer ScienceScholarpedia
- 2020

Algorithmic Information Dynamics (AID) is an algorithmic probabilistic framework for causal discovery and causal analysis. It enables a numerical solution to inverse problems based or motivated on…

### The sulfur cycle connects microbiomes and biogeochemistry in deep-sea hydrothermal plumes

- Environmental SciencebioRxiv
- 2022

In globally distributed deep-sea hydrothermal vent plumes, microbiomes are shaped by the redox energy landscapes created by reduced hydrothermal vent fluids mixing with oxidized seawater. Plumes can…

### Emergence and algorithmic information dynamics of systems and observers

- Computer SciencePhilosophical Transactions of the Royal Society A
- 2022

The results show that, restricted to the context of finite discrete deterministic dynamical systems, computable systems and irreducible information content measures, AOIE is the strongest form of emergence that formal theories can attain.

### Algorithmic Information Distortions in Node-Aligned and Node-Unaligned Multidimensional Networks

- Computer ScienceEntropy
- 2021

The results establish that isomorphisms between finite multidimensional networks and finite monoplex networks do not preserve algorithmic information in general and highlight that the algorithmmic information of the multid dimensional space itself needs to be taken into account in multiddimensional network complexity analysis.

### The Thermodynamics of Network Coding, and an Algorithmic Refinement of the Principle of Maximum Entropy †

- Computer ScienceEntropy
- 2019

The analysis provides insight in that the reprogrammability asymmetry appears to originate from a non-monotonic relationship to algorithmic probability, which motivates further analysis of the origin and consequences of the aforementioned asymmetries, reprogmability, and computation.

### Algorithmic information and incompressibility of families of multidimensional networks.

- Computer Science
- 2018

This article presents a theoretical investigation of string-based generalized representations of families of finite networks in a multidimensional space that are formalized in the form of multiaspect graphs and shows that, unlike classical graphs, the algorithmic information of a multi-dimensional network is not in general dominated by the algorithm of the binary sequence that determines the presence or absence of edges.

## References

SHOWING 1-10 OF 65 REFERENCES

### Graph sparsification by effective resistances

- Mathematics, Computer ScienceSIAM J. Comput.
- 2011

A key ingredient in the algorithm is a subroutine of independent interest: a nearly-linear time algorithm that builds a data structure from which the authors can query the approximate effective resistance between any two vertices in a graph in O(log n) time.

### Spectral sparsification of graphs: theory and algorithms

- Computer ScienceCACM
- 2013

It is explained what it means for one graph to be a spectral approximation of another and the development of algorithms for spectral sparsification are reviewed, including a faster algorithm for finding approximate maximum flows and minimum cuts in an undirected network.

### FANMOD: a tool for fast network motif detection

- Computer ScienceBioinform.
- 2006

FANMOD relies on recently developed algorithms to improve the efficiency of network motif detection by some orders of magnitude over existing tools, which facilitates the detection of larger motifs in bigger networks than previously possible.

### A model of Internet topology using k-shell decomposition

- Computer ScienceProceedings of the National Academy of Sciences
- 2007

This analysis uses information on the connectivity of the network shells to separate, in a unique (no parameters) way, the Internet into three subcomponents: a nucleus that is a small, very well connected globally distributed subgraph; a fractal subcomponent that is able to connect the bulk of the Internet without congesting the nucleus, with self-similar properties and critical exponents predicted from percolation theory.

### On the History of the Minimum Spanning Tree Problem

- Computer ScienceAnnals of the History of Computing
- 1985

There are several apparently independent sources and algorithmic solutions of the minimum spanning tree problem and their motivations, and they have appeared in Czechoslovakia, France, and Poland, going back to the beginning of this century.

### Network motifs: simple building blocks of complex networks.

- BiologyScience
- 2002

Network motifs, patterns of interconnections occurring in complex networks at numbers that are significantly higher than those in randomized networks, are defined and may define universal classes of networks.

### Network motifs in the transcriptional regulation network of Escherichia coli

- Computer ScienceNature Genetics
- 2002

This work applied new algorithms for systematically detecting network motifs to one of the best-characterized regulation networks, that of direct transcriptional interactions in Escherichia coli, and finds that much of the network is composed of repeated appearances of three highly significant motifs.

### Identification of influential spreaders in complex networks

- Business
- 2010

Spreading of information, ideas or diseases can be conveniently modelled in the context of complex networks. An analysis now reveals that the most efficient spreaders are not always necessarily the…

### Algorithmic information and incompressibility of families of multidimensional networks.

- Computer Science
- 2018

This article presents a theoretical investigation of string-based generalized representations of families of finite networks in a multidimensional space that are formalized in the form of multiaspect graphs and shows that, unlike classical graphs, the algorithmic information of a multi-dimensional network is not in general dominated by the algorithm of the binary sequence that determines the presence or absence of edges.

### Algorithmic Information Dynamics of Emergent, Persistent, and Colliding Particles in the Game of Life

- Computer ScienceFrom Parallel to Emergent Computing
- 2019