Independent component filters of natural images compared with simple cells in primary visual cortex

@article{vanHateren1998IndependentCF,
  title={Independent component filters of natural images compared with simple cells in primary visual cortex},
  author={J. H. van Hateren and Arjen van der Schaaf},
  journal={Proceedings of the Royal Society of London. Series B: Biological Sciences},
  year={1998},
  volume={265},
  pages={359 - 366}
}
Properties of the receptive fields of simple cells in macaque cortex were compared with properties of independent component filters generated by independent component analysis (ICA) on a large set of natural images. Histograms of spatial frequency bandwidth, orientation tuning bandwidth, aspect ratio and length of the receptive fields match well. This indicates that simple cells are well tuned to the expected statistics of natural stimuli. There is no match, however, in calculated and measured… 
View on Royal Society
europepmc.org
793 Citations
Highly Influential Citations
39
Background Citations
179
Methods Citations
186
Results Citations
18

Figures from this paper

793 Citations

INDEPENDENT COMPONENT ANALYSIS OF NATURAL IMAGE SEQUENCES YIELDS SPATIOTEMPORAL FILTERS SIMILAR TO SIMPLE CELLS IN PRIMARY VISUAL CORTEX

Simple cells in primary visual cortex process incoming visual information with receptive fields localized in space and time, bandpass in spatial and temporal frequency, tuned in orientation, and…

Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex

It is shown that performing independent component analysis (ICA) on video sequences of natural scenes produces results with qualitatively similar spatio-temporal properties, contrary to earlier ICA results on static images, which gave only filters at the finest possible spatial scale.

Statistical model of natural stimuli predicts edge-like pooling of spatial frequency channels in V2

The pooling that emerges allows the features to code for realistic low-level image features related to step edges in the modelled primary visual cortex to prove the viability of statistical modelling of natural images as a framework that produces quantitative predictions of visual processing.

Statistical Models of Natural Images and Cortical Visual Representation

This work has shown that linear sparse coding, which is equivalent to independent component analysis (ICA), and provided a very good description of the receptive fields of simple cells, can be applied to the response properties of neurons.

Simple-Cell-Like Receptive Fields Maximize Temporal Coherence in Natural Video

It is shown that simple-cell-type receptive fields emerge when temporal response strength correlation is maximized for natural image sequences, and suggests an interpretation of simple cells in terms of invariant coding principles, which have previously been used to explain complex-cell receptive fields.

The independent components of natural images are perceptually dependent

The pixel basis, the ICA basis and the discrete cosine basis are compared by asking subjects to interactively predict missing pixels (for the pixel basis) or to predict the coefficients of ICA and DCT basis functions in patches of natural images.

Are V1 Simple Cells Optimized for Visual Occlusions? A Comparative Study

‘globular’ fields may be evidence for an optimal encoding of visual occlusions in primary visual cortex, as suggested in the here investigated linear model and optimal sparsity.

Shaping of Receptive Fields in the Visual Cortex During Retinal Maturation

It is shown that different orientation selectivities are obtained for network models trained with natural images in contrast to random phase images of identical second order statistics, which suggests that higher-order statistics of the inputs influences development of primary visual cortex.

Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex.

Measurements of the spatial structure of simple-cell receptive fields in macaque primary visual cortex show a tendency for neurons that are well tuned in orientation and spatial frequency to have odd-symmetric receptive fields, and a population analysis reveals that the distribution of spatial profiles inPrimary visual cortex lies approximately on a one-parameter family of filter shapes.

Receptive field structure of neurons in monkey primary visual cortex revealed by stimulation with natural image sequences.

The technique provides an estimate of the conventional first-order receptive field of a neuron, similar to what can be obtained with other reverse-correlation schemes, and demonstrates for the first time that it might be feasible to investigate the receptive field structure of visual neurons from their responses to natural image sequences.
...

References

SHOWING 1-10 OF 39 REFERENCES

Edges are the Independent Components of Natural Scenes

It is shown here that non-linear 'infomax', when applied to an ensemble of natural scenes, produces sets of visual filters that are localised and oriented and resemble the receptive fields of simple cells in visual cortex, which suggests that these neurons form an information-theoretic co-ordinate system for images.

Mathematical description of the responses of simple cortical cells.

  • S. Marčelja
  • Biology
    Journal of the Optical Society of America
  • 1980
It is argued that the visual cortex representation corresponds closely to the Gabor scheme owing to its advantages in treating the subsequent problem of pattern recognition.

Emergence of simple-cell receptive field properties by learning a sparse code for natural images

It is shown that a learning algorithm that attempts to find sparse linear codes for natural scenes will develop a complete family of localized, oriented, bandpass receptive fields, similar to those found in the primary visual cortex.

Two-dimensional spatial structure of receptive fields in monkey striate cortex.

  • A. ParkerM. Hawken
  • Biology, Psychology
    Journal of the Optical Society of America. A, Optics and image science
  • 1988
Measurements of the spatial contrast sensitivity function and orientation selectivity of visual neurons in the foveal striate cortex (V1) of primates were interpreted within the context of a model of…

The “independent components” of natural scenes are edge filters

Relations between the statistics of natural images and the response properties of cortical cells.

  • D. Field
  • Computer Science
    Journal of the Optical Society of America. A, Optics and image science
  • 1987
The results obtained with six natural images suggest that the orientation and the spatial-frequency tuning of mammalian simple cells are well suited for coding the information in such images if the goal of the code is to convert higher-order redundancy into first- order redundancy.

Statistics of Natural Images: Scaling in the Woods

This work gathers images from the woods and finds that these scenes possess an ensemble scale invariance, and this non-Gaussian character cannot be removed through local linear filtering, meaning information is maximized at fixed channel variance.

A linear model fails to predict orientation selectivity of cells in the cat visual cortex.

Non‐linear mechanisms, which can include suppression of non‐optimal responses and/or amplification of optimal responses, are involved in the generation of orientation selectivity in the primary visual cortex.

Receptive fields and functional architecture of monkey striate cortex

The striate cortex was studied in lightly anaesthetized macaque and spider monkeys by recording extracellularly from single units and stimulating the retinas with spots or patterns of light, with response properties very similar to those previously described in the cat.

The orientation and direction selectivity of cells in macaque visual cortex