Operant Conditioning of Primate Prefrontal Neurons

@article{Kobayashi2010OperantCO,
  title={Operant Conditioning of Primate Prefrontal Neurons},
  author={Shunsuke Kobayashi and Wolfram Schultz and Masamichi Sakagami},
  journal={Journal of Neurophysiology},
  year={2010},
  volume={103},
  pages={1843 - 1855}
}
An operant is a behavioral act that has an impact on the environment to produce an outcome, constituting an important component of voluntary behavior. Because the environment can be volatile, the same action may cause different consequences. Thus to obtain an optimal outcome, it is crucial to detect action–outcome relationships and adapt the behavior accordingly. Although prefrontal neurons are known to change activity depending on expected reward, it remains unknown whether prefrontal activity… 

Figures and Tables from this paper

Coexistence of Reward and Unsupervised Learning During the Operant Conditioning of Neural Firing Rates
TLDR
This work proposes a new RSTDP model of synaptic plasticity based upon the observed effects that dopamine has on long-term potentiation and depression (LTP and LTD), and shows that this model can exhibit unsupervised learning and lead to firing rate reinforcement.
Requirements for the robust operant conditioning of neural firing rates
TLDR
This study proposes a generalization of the existing R STDP model (classical RSTDP) that can account for experiments where dopamine differentially modulates the amplitude of long-term potentiation and depression (LTP and LTD) and predicts that it cannot robustly elicit an increased firing rate.
Operant Conditioning of Synaptic and Spiking Activity Patterns in Single Hippocampal Neurons
TLDR
It is reported that animals can generate a specific form of synaptic activity in a given neuron in the hippocampus, and internally motivated animals are capable of routing an ongoing action potential series into a specific neural pathway of the hippocampal network.
On-line optical operant conditioning of cortical activity
TLDR
It is found that single neurons in layer 2/3 of motor cortex could be trained to increase activity in a specific manner, and that this increase primes operant conditioning of the same neurons over subsequent days.
Selective Attention from Voluntary Control of Neurons in Prefrontal Cortex
TLDR
The results reveal a specific association of voluntarily driven neuronal activity with “top-down” attention and suggest a basis for the use of neurofeedback training to treat disorders of attention.
Volitional Control of Individual Neurons in the Human Brain
TLDR
This work directly linked the firing rate of a single (direct) neuron to the position of a box on a screen, which participants tried to control, and demonstrated that humans can volitionally control neuronal activity in mnemonic structures.
Conditioned enhancement of firing rates and synchrony of hippocampal neurons and firing rates of motor cortical neurons in rats
TLDR
The results suggest that neuronal operant conditioning enhances the firing rates and synchrony of only some neurons in small restricted areas of the motor cortex and hippocampus.
Volitional enhancement of firing synchrony and oscillation by neuronal operant conditioning: interaction with neurorehabilitation and brain-machine interface
TLDR
It is argued that synchrony and oscillation of neuronal firing are the key activities required for developing both reliable neurorehabilitation and high-performance BMI and can be a common important bridge among all of them.
Bidirectional control of a one-dimensional robotic actuator by operant conditioning of a single unit in rat motor cortex
TLDR
This study demonstrates the feasibility, even in the rodent, of using a motor cortex neuron to control a prosthesis in real-time bidirectionally, and includes modifications of the activity of neighboring cortical neurons while the conditioned neuron selectively leads the activity patterns associated with the prosthesis control.
...
...

References

SHOWING 1-10 OF 59 REFERENCES
Task-specific neural activity in the primate prefrontal cortex.
TLDR
It is found that in monkeys trained to alternate between three tasks, the activity of many neurons in the prefrontal cortex was task dependent, which supports the hypothesis that a major prefrontal function is the acquisition and implementation of task context and the "rules" used to guide behavior.
Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex
TLDR
A significant number of neurons in the medial prefrontal cortex were activated, after cue presentation and before motor execution, only by particular action-reward combinations, likely to underlie goal-based action selection.
Positive and negative modulation of motor response in primate superior colliculus by reward expectation.
TLDR
Two groups of SC neurons that encoded reward information in the presaccadic period were found: positive reward-coding neurons that showed higher activity when reward was expected and negative reward- coded neurons that show higher activityWhen reward was not expected.
An integrative theory of prefrontal cortex function.
TLDR
It is proposed that cognitive control stems from the active maintenance of patterns of activity in the prefrontal cortex that represent goals and the means to achieve them, which provide bias signals to other brain structures whose net effect is to guide the flow of activity along neural pathways that establish the proper mappings between inputs, internal states, and outputs needed to perform a given task.
Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions
The capacity to accurately evaluate the causal effectiveness of our actions is key to successfully adapting to changing environments. Here we scanned subjects using functional magnetic resonance
Encoding of behavioral significance of visual stimuli by primate prefrontal neurons: relation to relevant task conditions
TLDR
It is suggested that neurons in the inferior dorsolateral prefrontal cortex may participate in the conversion of sensory information from different visual channels into behavioral information (information on the upcoming response) in a symmetrically rewarded go/no-go discrimination task.
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Value Representations in the Primate Striatum during Matching Behavior
...
...