High Accuracy Decoding of Dynamical Motion from a Large Retinal Population

@article{Marre2015HighAD,
  title={High Accuracy Decoding of Dynamical Motion from a Large Retinal Population},
  author={Olivier Marre and Vicente Botella-Soler and Kristina D. Simmons and Thierry Mora and Ga{\vs}per Tka{\vc}ik and Michael J. Berry},
  journal={PLoS Computational Biology},
  year={2015},
  volume={11}
}
Motion tracking is a challenge the visual system has to solve by reading out the retinal population. It is still unclear how the information from different neurons can be combined together to estimate the position of an object. Here we recorded a large population of ganglion cells in a dense patch of salamander and guinea pig retinas while displaying a bar moving diffusively. We show that the bar’s position can be reconstructed from retinal activity with a precision in the hyperacuity regime… 

Figures from this paper

Multiplexed computations in retinal ganglion cells of a single type
TLDR
Using large-scale recordings in the rat retina, it is shown that a homogeneous population of fast OFF ganglion cells simultaneously encodes two radically different features of a visual scene.
Global Motion Processing by Populations of Direction-Selective Retinal Ganglion Cells
TLDR
Different DSGC population decoding regimes that utilize or mitigate correlated spiking to achieve high spatial versus high temporal resolution are defined and explored.
Modeling a population of retinal ganglion cells with restricted Boltzmann machines
TLDR
This work validate the applicability of Restricted Boltzmann Machines to model the spiking activity responses of a large a population of RGCs recorded with high-resolution electrode arrays and shows that latent variables can encode modes in the RGC activity distribution that are closely related to the visual stimuli.
Motion encoding in the salamander retina
TLDR
In complex visual scenes, standard DS cells simultaneously encode motion direction and strong local contrast changes caused by large translational movements independent of their direction, which suggests that the direction of global image shifts and of locally moving objects is processed in parallel via different pathways.
Modeling Retinal Ganglion Cell Population Activity with Restricted Boltzmann Machines
TLDR
Results show that binary states can encode the regularities associated to different stimuli, using both gratings and natural scenes as stimuli, and hidden variables encode interesting properties of retinal activity, interpreted as population receptive fields.
Nonlinear decoding of natural images from large-scale primate retinal ganglion recordings
TLDR
This work develops a scalable nonlinear decoding method to decode natural images from the responses of over a thousand simultaneously recorded units, and shows that this decoder significantly improves on the state of the art in decoding natural stimuli from large populations of neurons.
Visual reconstruction from 2-photon calcium imaging suggests linear readout properties of neurons in mouse primary visual cortex
TLDR
The first pixel-by-pixel reconstruction of a complex natural stimulus from 2-photon calcium imaging responses of mouse primary visual cortex (V1) is presented, suggesting that, conditional on the spatial and temporal limits of the recording technique, V1 neurons display linear readout properties, with low information content in the joint distribution of their activity.
Closed-loop estimation of retinal network sensitivity reveals signature of efficient coding
TLDR
A method to characterize the sensitivity of the retinal network to perturbations of a stimulus is developed, and it is argued that a peak in the sensitivity is set to maximize information transmission.
Spatially displaced excitation contributes to the encoding of interrupted motion by the retinal direction-selective circuit
TLDR
It is reported that On-Off DSGCs have a spatially displaced glutamatergic receptive field along their preferred-null motion axis, which contributes to DSGC null-direction spiking during interrupted motion trajectories.
...
...

References

SHOWING 1-10 OF 105 REFERENCES
Mapping a Complete Neural Population in the Retina
TLDR
This work shows that the combination of a large, dense multielectrode array and a novel, mostly automated spike-sorting algorithm allowed them to record simultaneously from a highly overlapping population of >200 ganglion cells in the salamander retina, allowing unprecedented access to the complete neural representation of visual information.
Nonlinear Dynamics Support a Linear Population Code in a Retinal Target-Tracking Circuit
TLDR
It is demonstrated that a population of fast-OFF ganglion cells in the salamander retina, whose dynamics are governed by a nonlinear circuit, serve to compute the future position of the target over hundreds of milliseconds, using the population vector average (PVA).
Decoding visual information from a population of retinal ganglion cells.
TLDR
This work investigates how a time-dependent visual stimulus is encoded by the collective activity of many retinal ganglion cells, and shows that the optimal interpretation of aganglion cell's action potential depends strongly on the simultaneous activity of other nearby cells.
A Neural Computation for Visual Acuity in the Presence of Eye Movements
TLDR
This work derives a decision rule for using retinal spike trains to discriminate between two stimuli, given that their retinal image moves with an unknown random walk trajectory, and dynamically estimates the probability of the stimulus at different retinal locations, and uses this to modulate the influence of retinal spikes acquired later.
Role of eye movements in the retinal code for a size discrimination task.
TLDR
The beginning of fixation, namely the time immediately after the saccade, provided the most visual information about object size, with fixational eye movements, which consist of tremor and drift in the archer fish, yielding only a minor contribution.
Fidelity of the ensemble code for visual motion in primate retina.
TLDR
Simulation of downstream speed estimation using populations of speed-tuned units showed that peak (winner take all) readout provided more precise speed estimates than centroid (vector average) read out.
Temporal Resolution of Ensemble Visual Motion Signals in Primate Retina
TLDR
It is suggested that cortical neurons could filter their inputs on a time scale of tens of milliseconds, rather than relying on the precise times of individual input spikes, to sense motion most reliably.
Segregation of object and background motion in the retina
TLDR
It is shown how a population of ganglion cells selective for differential motion can rapidly flag moving objects, and even segregate multiple moving objects.
A Retinal Circuit That Computes Object Motion
TLDR
A quantitative model of these circuit elements and their interactions explains how an important visual computation is accomplished by retinal neurons and synapses.
Low error discrimination using a correlated population code.
TLDR
A picture is suggested in which linear decoders allow a coarse categorization of shape stimuli, whereas nonlinear decoder, which take advantage of both correlation and spike timing, are needed to achieve high-fidelity discrimination.
...
...