Learning a model of shape selectivity in V4 cells reveals shape encoding mechanisms in the brain

@article{Mehrani2021LearningAM,
  title={Learning a model of shape selectivity in V4 cells reveals shape encoding mechanisms in the brain},
  author={Paria Mehrani and John K. Tsotsos},
  journal={ArXiv},
  year={2021},
  volume={abs/2111.14250}
}
The mechanisms involved in transforming early visual signals to curvature representations in V4 are unknown. We propose a hierarchical model that reveals V1/V2 encodings that are essential components for this transformation to the reported curvature representations in V4. Then, by relaxing the often-imposed prior of a single Gaussian, V4 shape selectivity is learned in the last layer of the hierarchy from Macaque V4 responses. We found that V4 cells integrate multiple shape parts from the full… 

Figures from this paper

References

SHOWING 1-10 OF 36 REFERENCES
Modeling Shape Representation in Area V4
TLDR
The results suggest that boundary orientation and surface information are both maintained until at least the mid-level visual representation, and it is hypothesized that this arrangement is crucial for image segmentation.
Shape representation in area V4: position-specific tuning for boundary conformation.
TLDR
Individual V4 cells appear to encode moderately complex boundary information at specific locations within larger shapes, which suggests that, at intermediate stages in the V1-IT transformation, complex objects are represented at least partly in terms of the configurations and positions of their contour components.
Underlying principles of visual shape selectivity in posterior inferotemporal cortex
TLDR
This work found that neurons in posterior IT (Brodmann's areas TEO and posterior TE) integrate information about multiple contour elements using both linear and nonlinear mechanisms, which results in complex, distributed response patterns that cannot be characterized solely in terms of example stimuli.
A model of V4 shape selectivity and invariance.
TLDR
A quantitative model of hierarchical processing is provided that provides a plausible mechanism for the translation-invariant shape representation observed in area V4 and points toward a possible canonical mechanism operating throughout the ventral pathway.
Population coding of shape in area V4
TLDR
This work studied the population code for shape in area V4 of macaque monkeys, which is part of the ventral (object-related) pathway in primate visual cortex, and found that many macaque V4 neurons are tuned for the curvature and object-centered position of boundary fragments.
Sparse coding generates curvature selectivity in V4 neurons.
TLDR
The results support the hypothesis that sparseness plays an essential role in the construction of curvature selectivity in V4 and suggest that sparse coding is the principle driving the generation of the spatial properties of the receptive field that exhibit curvatureSelectivity.
Modeling diverse responses to filled and outline shapes in macaque V4.
TLDR
It is suggested that boundary orientation and interior surface information are both maintained until at least the midlevel visual representation, consistent with the idea that object fill is important for recognition and perception in natural vision.
Responses to contour features in macaque area V4.
TLDR
The results suggest that V4 processes information about contour features as a step toward complex shape recognition, and a strong bias toward convex features implies a neural basis for the well-known perceptual dominance of convexity.
Selectivity for Complex Shapes in Primate Visual Area V2
TLDR
The results indicate that V2 cells explicitly represent complex shape information and suggest specific types of higher order visual information that V1 cells extract from visual scenes.
Toward a Unified Theory of Visual Area V4
...
1
2
3
4
...