Self-organization in a perceptual network

@article{Linsker1988SelforganizationIA,
  title={Self-organization in a perceptual network},
  author={R. Linsker},
  journal={Computer},
  year={1988},
  volume={21},
  pages={105-117}
}
The emergence of a feature-analyzing function from the development rules of simple, multilayered networks is explored. It is shown that even a single developing cell of a layered network exhibits a remarkable set of optimization properties that are closely related to issues in statistics, theoretical physics, adaptive signal processing, the formation of knowledge representation in artificial intelligence, and information theory. The network studied is based on the visual system. These results… Expand
Information maximization in a network of linear neurons
It is known since the work of Hubel and Wiesel [3], that many cells in the early visual areas of mammals have characteristic response properties. For example, there are cells sensitive to lightdarkExpand
Development of feature detectors by self-organization
We present a two-layered network of linear neurons that organizes itself as to extract the complete information contained in a set of presented patterns. The weights between layers obey a HebbianExpand
Self-organizing maps and adaptive filters
TLDR
This contribution reports results on two important network models, one of which is a hierarchical network for principal component analysis and the other a self-organizing feature maps based on Kohonen's model. Expand
Self-similar Neural Networks Based on a Kohonen Learning Rule
TLDR
The work reported in this paper is an investigation of the structures that may evolve in a simple artificial neural network driven not by random changes of input pattern, but directly by transformations which are themselves related to transformations of the input signal through an analysis of motion-prediction error. Expand
Towards a Theory of Early Visual Processing
TLDR
A theory of the early processing in the mammalian visual pathway is proposed and the solution for the class of encodings to which the parvocellular retinal processing belongs, namely linear and nondivergent transformations is found. Expand
Parallel hierarchical networks in communications
TLDR
The multistage approach to image processing, described in this paper, comprises both main types of cortical multistages, which maps input images into a flexible hierarchy which reflects the complexity of the image data. Expand
Scaling in a Hierarchical Unsupervised Network 1
A persistent worry with computational models of unsupervised learning is that learning will become more difficult as the problem is scaled. We examine this issue in the context of a novelExpand
Scaling in a hierarchical unsupervised network
A persistent worry with computational models of unsupervised learning is that learning will become more difficult as the problem is scaled. We examine this issue in the context of a novelExpand
Emergence of Retinotopic Orientation Map by Hebb-rule: Network Model and Analysis
The emergence of cortical maps is modeled with a neuronal network with stochastic neuronal dynamics and a Hebb-rule for the coupling dynamics. The network is analyzed systematically. As a result, theExpand
Learning spatially coherent properties of the visual world in connectionist networks
TLDR
Simulations show that using an information-theoretic algorithm called IMAX, a network can be trained to represent depth by observing random dot stereograms of surfaces with continuously varying disparities. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 21 REFERENCES
Towards an Organizing Principle for a Layered Perceptual Network
TLDR
An information-theoretic optimization principle is proposed for the development of each processing stage of a multilayered perceptual network that maximizes the information that the output signal values convey about the input signals values, subject to certain constraints and in the presence of processing noise. Expand
From basic network principles to neural architecture (series)
Orientation-selective cells-cells that are selectively responsive to bars and edges at particular orientations-are a salient feature of the architecture of mammalian visual cortex. In the previousExpand
From basic network principles to neural architecture: emergence of spatial-opponent cells.
  • R. Linsker
  • Computer Science, Medicine
  • Proceedings of the National Academy of Sciences of the United States of America
  • 1986
TLDR
This paper is the first of three that address the origin and organization of feature-analyzing cells in simple systems governed by biologically plausible development rules, and introduces the theory of "modular self-adaptive networks," of which this system is an example, and explicitly demonstrates the emergence of a layer of spatial-opponent cells. Expand
Neural networks and physical systems with emergent collective computational abilities.
  • J. Hopfield
  • Computer Science, Medicine
  • Proceedings of the National Academy of Sciences of the United States of America
  • 1982
TLDR
A model of a system having a large number of simple equivalent components, based on aspects of neurobiology but readily adapted to integrated circuits, produces a content-addressable memory which correctly yields an entire memory from any subpart of sufficient size. Expand
Ferrier lecture - Functional architecture of macaque monkey visual cortex
  • D. Hubel, T. Wiesel
  • Geography, Medicine
  • Proceedings of the Royal Society of London. Series B. Biological Sciences
  • 1977
TLDR
In most respects the above description fits the newborn monkey just as well as the adult, suggesting that area 17 is largely genetically programmed. Expand
Functional architecture of macaque monkey visual cortex
TLDR
By four independent anatomical methods it has been shown that these columns have an ocular dominance column all cells respond preferentially to the same eye, in that cells with common physiological properties are grouped together in vertically organized systems of columns. Expand
Self-Organization and Associative Memory
TLDR
The purpose and nature of Biological Memory, as well as some of the aspects of Memory Aspects, are explained. Expand
Simplified neuron model as a principal component analyzer
  • E. Oja
  • Mathematics, Medicine
  • Journal of mathematical biology
  • 1982
A simple linear neuron model with constrained Hebbian-type synaptic modification is analyzed and a new class of unconstrained learning rules is derived. It is shown that the model neuron tends toExpand
Brain mechanisms of vision.
From basic network principles to neural architecture
...
1
2
3
...