Corpus ID: 2868646

Optimizing Associative Information Transfer within Content-addressable Memory

  title={Optimizing Associative Information Transfer within Content-addressable Memory},
  author={Mikhail Prokopenko and Daniel Polani and Peter Wang},
  journal={Int. J. Unconv. Comput.},
This paper investigates an information-theoretic design principle, intended to support an evolution of a memory structure fitting a specific selection pressure: associative information transfer through the structure. The proposed criteria measure how much does associativity in memory add to the information transfer in terms of precision, recall and effectiveness. The study also introduces a conjectural analogy between memory retrieval and self-replication, with DNA as a partially-associative… Expand
A tactics memory for a new theory of computing
This work postulates the processor to use the said smaller memory to access the bigger knowledge base, without the processor directly accessing the knowledge base as in the present computations. Expand


Optimizing Potential Information Transfer with Self-referential Memory
The proposed information-theoretic criteria intend to formalize the notion of information transfer involved in self-replication, and enable bio-inspired design of more effective memory structures. Expand
Sparse Distributed Memory
Pentti Kanerva's Sparse Distributed Memory presents a mathematically elegant theory of human long term memory that resembles the cortex of the cerebellum, and provides an overall perspective on neural systems. Expand
Neural networks and physical systems with emergent collective computational abilities.
  • J. Hopfield
  • Computer Science, Medicine
  • Proceedings of the National Academy of Sciences of the United States of America
  • 1982
A model of a system having a large number of simple equivalent components, based on aspects of neurobiology but readily adapted to integrated circuits, produces a content-addressable memory which correctly yields an entire memory from any subpart of sufficient size. Expand
Self-replication and Evolution of DNA Crystals
This paper presents a design for such a replicator constructed exclusively from synthetic DNA, and shows how to adapt error-correction techniques from algorithmic self-assembly to lower the replication error rate as much as is required. Expand
Organization of the information flow in the perception-action loop of evolved agents
This paper evolves finite-state automata as agent controllers to solve an information acquisition task in a simple virtual world and studies how the information flow is organized by evolution, providing insight into how evolution organizes sensoric information acquisition, memory, processing and action selection. Expand
Self-reference and the encoding of personal information.
Results indicate that self-reference is a rich and powerful encoding process that appears to function as a superordinate schema that is deeply involved in the processing, interpretation, and memory of personal information. Expand
Sparse distributed memory and related models
Several variations of the basic SDM design are discussed: the selected-coordinate and hyperplane designs of Jaeckel, the pseudorandom associative neural memory of Hassoun, and SDM with real-valued input variables by Prager and Fallside. Expand
Representations of Space and Time in the Maximization of Information Flow in the Perception-Action Loop
The evolved implicit representations of space and time are analyzed in an information-theoretic manner, which paves the way toward a principled and general understanding of the mechanisms guiding the evolution of sensors in nature and provides insights into the design of mechanisms for artificial sensor evolution. Expand
Computation at the edge of chaos: phase transitions and emergent computation
There is a fundamental connection between computation and phase transitions, especially second-order or “critical” transitions, and some of the implications for the understanding of nature if such a connection is borne out are discussed. Expand
Self-Organizing Hierarchies in Sensor and Communication Networks
We consider a hierarchical multicellular sensing and communication network, embedded in an ageless aerospace vehicle that is expected to detect and react to multiple impacts and damage over a wideExpand