Real-time prediction of hand trajectory by ensembles of cortical neurons in primates

  title={Real-time prediction of hand trajectory by ensembles of cortical neurons in primates},
  author={Johan Wessberg and Christopher R. Stambaugh and Jerald D. Kralik and Pamela D. Beck and Mark Laubach and John K. Chapin and Jung Kim and S. James Biggs and Mandayam A. Srinivasan and Miguel A. L. Nicolelis},
Signals derived from the rat motor cortex can be used for controlling one-dimensional movements of a robot arm. It remains unknown, however, whether real-time processing of cortical signals can be employed to reproduce, in a robotic device, the kind of complex arm movements used by primates to reach objects in space. Here we recorded the simultaneous activity of large populations of neurons, distributed in the premotor, primary motor and posterior parietal cortical areas, as non-human primates… 

Optimizing a Linear Algorithm for Real-Time Robotic Control using Chronic Cortical Ensemble Recordings in Monkeys

The results of a comprehensive analysis of the contribution of single cortical neurons to a simple linear model indicate that the experimental paradigm described here may be useful not only to investigate aspects of neural population coding, but it may also provide a test bed for the development of clinically useful cortical prosthetic devices aimed at restoring motor functions in severely paralyzed patients.

Nonlinear physically-based models for decoding motor-cortical population activity

It is found that the decoded spring coefficients produced accurate hand trajectories compared with state-of-the-art methods for direct decoding of hand kinematics and that their frequency spectrum more closely matched that of natural hand movements.

Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates

It is demonstrated that primates can learn to reach and grasp virtual objects by controlling a robot arm through a closed-loop brain–machine interface (BMIc) that uses multiple mathematical models to extract several motor parameters from the electrical activity of frontoparietal neuronal ensembles.

On variability and use of rat primary motor cortex responses in behavioral task discrimination

The results are dependent upon a small, randomly sampled neural population, and indicate that information about similar behavioral tasks may be extracted from M1 based on relatively few channels of neural signal for possible use in a cortical neuroprosthetic system.

Cortical Representation of Ipsilateral Arm Movements in Monkey and Man

In two macaque monkeys trained to perform center-out reaching movements, it is found that the ensemble spiking activity in M1 could continuously represent ipsilateral limb position, and this representation was more correlated with joint angles than hand position.

Prediction of upper limb muscle activity from motor cortical discharge during reaching

This work has undertaken the prediction of myoelectric (EMG) signals recorded from various muscles of the arm and hand during button pressing and prehension movements and shown that these signals can be predicted with accuracy that is similar to that of kinematic signals, despite their stochastic nature and greater bandwidth.

Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator Controlled by a Brain-Machine Interface

It is shown that rapid modifications in neuronal representation of velocity of the hand and actuator occur in multiple cortical areas during the operation of a BMI, and that, during BMI control, cortical ensembles represent behaviorally significant motor parameters, even if these are not associated with movements of the animal's own limb.

Towards a Naturalistic Brain-Machine Interface: Hybrid Torque and Position Control Allows Generalization to Novel Dynamics

It is found that neural control of torques leads to ballistic, possibly more naturalistic movements than position control alone, and that adding the influence of position in a hybrid torque-position control changes the feedforward behavior of these BMI movements.

Towards a Brain-Computer Interface for Dexterous Control of a Multi-Fingered Prosthetic Hand

It is suggested that dexterous control of individual digits and wrist of a prosthetic hand can be achieved by real-time decoding of neuronal ensembles from the Ml hand area in primates.

Computing Arm Movements with a Monkey Brainet

A Brainet that utilizes very-large-scale brain activity from two (B2) or three (B3) nonhuman primates to engage in a common motor behaviour is introduced, suggesting that primate brains can be integrated into a Brainet, which self-adapts to achieve acommon motor goal.



Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex

A possible means for movement restoration in paralysis patients is suggested after rats trained to position a robot arm to obtain water by pressing a lever routinely used brain-derived signals to position the robot arm and obtain water.

Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task

Ch chronically recording from neuronal ensembles located in the rat motor cortex, throughout the period required for rats to learn a reaction-time task demonstrated a decrease in the variance of the rats' reaction times and an increase in the time the animals were able to wait for a trigger stimulus.

Neuronal population coding of movement direction.

The direction of movement was found to be uniquely predicted by the action of a population of motor cortical neurons that can be monitored during various tasks, and similar measures in other neuronal populations could be of heuristic value where there is a neural representation of variables with vectorial attributes.

On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex

The orderly variation of cell discharge with the direction of movement and the fact that cells related to only one of the eight directions of movement tested were rarely observed indicate that movements in a particular direction are not subserved by motor cortical cells uniquely related to that movement.

Predicting Measures of Motor Performance from Multiple Cortical Spike Trains

The results suggest that hypotheses concerning the response variables "controlled" by cortical motor systems may well depend upon whether or not the temporal relations between simultaneously active neurons are taken into account.

Direct cortical representation of drawing.

A population vector method was used to visualize the motor cortical representation of the hand's trajectory made by rhesus monkeys as they drew spirals and showed that the movement trajectory is an important determinant of motor cortical activity.

Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space.

A large proportion of area 5 neurons were relatively insensitive to passive joint rotations, as compared with similar neurons of the postcentral gyrus, but were driven to high rates of discharge when the same joint was rotated during an active movement of the animal.

Postspike facilitation of forelimb muscle activity by primate corticomotoneuronal cells.

In macaque monkeys making rampand-hold wrist movements against elastic loads, activity of task-related motor cortex cells and specific wrist and finger muscles was recorded and postspike facilitation (PSF) of average EMG activity was recorded.

Reaching movements with similar hand paths but different arm orientations. II. Activity of individual cells in dorsal premotor cortex and parietal area 5.

The observed changes in neuronal activity related to posture and movement in MI, PMd and area 5 demonstrate that single-cell activity in these cortical areas is not simply related to the spatial attributes of hand trajectory but is also strongly influenced by attributes of movement related to arm geometry.

Combination of hand and gaze signals during reaching: activity in parietal area 7 m of the monkey.

This area seems to perform an early combination of information in the processing leading from target localization to movement generation, and for the majority of cells to a combination of visuomanual and oculomotor information.