Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position

@article{Fukushima2004NeocognitronAS,
  title={Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position},
  author={Kunihiko Fukushima},
  journal={Biological Cybernetics},
  year={2004},
  volume={36},
  pages={193-202}
}
  • K. Fukushima
  • Published 1 April 1980
  • Computer Science, Biology
  • Biological Cybernetics
A neural network model for a mechanism of visual pattern recognition is proposed in this paper. [] Key Result Neither is it affected by a small change in shape nor in size of the stimulus pattern.

Artificial vision by multi-layered neural networks: Neocognitron and its advances

Analysis of Multi-Layer Neural Network’s Recognition Mechanism Using Alopex Algorithm

TLDR
This paper discusses the recognition and training mechanism of a NN model by use of Alopex algorithm, which is an iterative and stochastic processing to minimize or maximize a cost function.

A hierarchical neural network model for associative memory

A hierarchical neural network model with feedback interconnections, which has the function of associative memory and the ability to recognize patterns, is proposed. The model consists of a

A neural network model for selective attention in visual pattern recognition

TLDR
A neural network model of the mechanism of selective attention in visual pattern recognition is proposed and simulated on a digital computer and, even if one of the patterns to which the model is paying selective attention is affected by noise or defects, the model can recall the complete pattern from which the noise has been eliminated and the defects corrected.

Self-Organizing Formation of Receptive Fields and Competitive Systems

TLDR
Computer simulations show that this model allows for the formation of local receptive fields with orientation selectivity, and that selforganization successfully structures the competitive system.

Multiwinner feedforward self-organizing neural network with a distributed representation of information

TLDR
This paper aims at hardware implementation for easily implementing the neural network on a hardware model and proposes a layered structure model based on a simple multiwinner algorithm, which can easily be implemented in hardware.

A model of complex cell development by information separation

TLDR
It is demonstrated that neurons in layer C learn invariance to shift in input position, which explains complex cell development in terms of the principle of information separation.

A Generalized Net Model of the Neocognitron Neural Network

TLDR
A generalized net model of the Neocognitron neural network, a self-organizing network with the ability to recognize patterns based on the difference of their form, which is able to correctly identify an image, even if there is a violation or movement into position.

Hierarchical Models of the Visual System

  • Thomas Serre
  • Computer Science
    Encyclopedia of Computational Neuroscience
  • 2014
TLDR
Deep convolutional networks are architecturally similar neural networks that have led to impressive results in a wide range of engineering disciplines, from computer vision to natural language processing, and artificial intelligence more broadly.

On the self-organization of a hierarchical memory for compositional object representation in the visual cortex

TLDR
A functional model of a self-organizing hierarchical memory network based on hypothetical neuronal mechanisms involved in cortical processing and adaptation is proposed, showing its ability to recognize identity and gender of the persons from alternative face views not shown before.
...

References

SHOWING 1-10 OF 22 REFERENCES

Cognitron: A self-organizing multilayered neural network

  • K. Fukushima
  • Computer Science, Biology
    Biological Cybernetics
  • 2004
TLDR
A new hypothesis for the organization of synapses between neurons is proposed: “The synapse from neuron x to neuron y is reinforced when x fires provided that no neuron in the vicinity of y is firing stronger than y”, and a new algorithm with which a multilayered neural network is effectively organized can be deduced.

Receptive fields, binocular interaction and functional architecture in the cat's visual cortex

TLDR
This method is used to examine receptive fields of a more complex type and to make additional observations on binocular interaction and this approach is necessary in order to understand the behaviour of individual cells, but it fails to deal with the problem of the relationship of one cell to its neighbours.

Visual properties of neurons in inferotemporal cortex of the Macaque.

TLDR
There are several lines of evidence suggesting that a possible site for further processing of visual information and perhaps even for storage of such information might, in the monkey, be inferotemporal cortexthe cortex on the inferior convexity of the temporal lobe.

Ferrier lecture - Functional architecture of macaque monkey visual cortex

  • D. HubelT. Wiesel
  • Biology
    Proceedings of the Royal Society of London. Series B. Biological Sciences
  • 1977
TLDR
In most respects the above description fits the newborn monkey just as well as the adult, suggesting that area 17 is largely genetically programmed.

Functional architecture of macaque monkey visual cortex

TLDR
By four independent anatomical methods it has been shown that these columns have an ocular dominance column all cells respond preferentially to the same eye, in that cells with common physiological properties are grouped together in vertically organized systems of columns.

RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT.

TLDR
To UNDERSTAND VISION in physiological terms represents a formidable problem for the biologist, and one approach is to stimulate the retina with patterns of light while recording from single cells or fibers at various points along the visual pathway.

Feature Extraction and Recognition of Handwritten Characters by Homogeneous Layers

TLDR
It is not necessary that an artificial recognition system is constructed in the same way as neuronal systems; but if it is based on the same principles of perception — as far as they are known — it might have a better chance of performing the same recognition operation.

A Proposed Model for Visual Information Processing in the Human Brain

TLDR
It is your own time to continue reading habit and one of the books you can enjoy now is a proposed model for visual information processing in the human brain here.

Self-Organization of a Neural Network which Gives Position-Invariant Response

TLDR
A new algorithm for self-organizing a multilayered neural network which has an ability to recognize patterns based on the geometrical similarity of their shapes, whose nickname is "neo-cognitron", has a structure similar to the hierarchy model of the visual nervous system proposed by Hubel and Wiesel.