A Forward Model at Purkinje Cell Synapses Facilitates Cerebellar Anticipatory Control

@article{HerrerosAlonso2016AFM,
  title={A Forward Model at Purkinje Cell Synapses Facilitates Cerebellar Anticipatory Control},
  author={Ivan Herreros-Alonso and Xerxes D. Arsiwalla and Paul Verschure},
  journal={bioRxiv},
  year={2016}
}
How does our motor system solve the problem of anticipatory control in spite of a wide spectrum of response dynamics from different musculo-skeletal systems, transport delays as well as response latencies throughout the central nervous system? To a great extent, our highly-skilled motor responses are a result of a reactive feedback system, originating in the brain-stem and spinal cord, combined with a feed-forward anticipatory system, that is adaptively fine-tuned by sensory experience and… 
Cerebellar-inspired learning rule for gain adaptation of feedback controllers
TLDR
This work frames a model-reference adaptive control problem and derives an adaptive control scheme treating the gains of a feedback controller as if they were the weights of an adaptive linear unit, and demonstrates that the approach of controlling plasticity with a forward model of the subsystem controlled can provide a solution to a wide set of adaptive control problems.
A Cerebellum-Inspired Learning Approach for Adaptive and Anticipatory Control
TLDR
A novel bio-inspired modular control architecture that merges a recurrent cerebellar-like loop for adaptive control and a Smith predictor controller is proposed to provide accurate anticipatory corrections to the generation of the motor commands in spite of sensory delays and to validate the robustness of the proposed control method to input and physical dynamic changes.
The perceptual shaping of anticipatory actions
TLDR
This work proposes and validate the alternative hypothesis that anticipatory control can be realized through a cascade of purely sensory predictions that drive the motor system, reflecting the causal sequence of the perceptual events preceding the error.
A cerebellar-based solution to the nondeterministic time delay problem in robotic control
TLDR
A Cerebellar-like spiking neural network (SNN) controller is implemented that is adaptive, compliant, and robust to variable sensorimotor delays by replicating the cerebellar mechanisms that embrace the presence of biological delays and allow motor learning and adaptation.
Adaptively Learning Levels of Coordination from One's, Other's and Task Related Errors Through a Cerebellar Circuit: A Dual Cart-Pole Setup
TLDR
The results confirm experimentally that anticipating the error in the task including inputs extracted from the behavior of the other, further improves precision in the realization.
Robust Postural Stabilization with a Biomimetic Hierarchical Control Architecture
TLDR
It is proved that the proposed hierarchical control architecture can deal with different types of alterations in the causal structure of the environment, therefore extending the limits of performance.
Epistemic Autonomy: Self-supervised Learning in the Mammalian Hippocampus
Control Architecture for Human-Like Motion With Applications to Articulated Soft Robots
TLDR
A control framework that ensures natural movements in articulated soft robots, implementing specific functionalities of the human central nervous system, i.e., learning by repetition, after-effect on known and unknown trajectories, anticipatory behavior, its reactive re-planning, and state covariation in precise task execution is introduced.
Modeling the formation of social conventions from embodied real-time interactions
TLDR
This work proposes a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups and shows that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution.
Modeling the Formation of Social Conventions in Multi-Agent Populations
TLDR
This work proposes a novel Control-based Reinforcement Learning architecture (CRL) that can account for the acquisition of social conventions in multi-agent populations that are solving a benchmark social decision-making problem.
...
...

References

SHOWING 1-10 OF 35 REFERENCES
A cerebellar model for predictive motor control tested in a brain-based device.
TLDR
A computer model based on the anatomy and dynamics of the cerebellum was constructed and it was found that the Cerebellar circuit selectively responded to motion cues in specific receptive fields of simulated middle temporal visual areas.
Recurrent Cerebellar Loops Simplify Adaptive Control of Redundant and Nonlinear Motor Systems
TLDR
The properties of recurrent loop connectivity in the case of redundant and nonlinear motor systems are investigated and suggest a central functional role for the closed cerebellar loops, which have been shown to be ubiquitous in motor systems.
A hierarchical neural-network model for control and learning of voluntary movement
TLDR
A hierarchical neural network model which accounts for the learning and control capability of the CNS and provides a promising parallel-distributed control scheme for a large-scale complex object whose dynamics are only partially known is proposed.
The cerebellum in action: a simulation and robotics study
TLDR
A computational model is presented pursuing whether and how the suggested underlying mechanisms could give rise to behavioural phenomena in cerebellar‐mediated conditioning and it is demonstrated that the model supports adaptively timed responses under real‐world conditions.
Learning to predict the future: the cerebellum adapts feedforward movement control
  • A. Bastian
  • Psychology, Biology
    Current Opinion in Neurobiology
  • 2006
Adaptive filter model of the cerebellum
TLDR
The Marr-Albus model of the cerebellum has been reformulated with linear system analysis and will give an account for the phenomena which have been termed “cerebellar compensation”.
Prediction of complex two-dimensional trajectories by a cerebellar model of smooth pursuit eye movement.
TLDR
A neural network model based on the anatomy and physiology of the cerebellum is presented that can generate both simple and complex predictive pursuit, while also responding in a feedback mode to visual perturbations from an ongoing trajectory, which suggests that both the model and the eye make short-term predictions about future events to compensate for visual feedback delays in receiving information about the direction of a target moving along a changing trajectory.
Neuronlike adaptive elements that can solve difficult learning control problems
TLDR
It is shown how a system consisting of two neuronlike adaptive elements can solve a difficult learning control problem and the relation of this work to classical and instrumental conditioning in animal learning studies and its possible implications for research in the neurosciences.
Biomimetic smooth pursuit based on fast learning of the target dynamics
  • T. Shibata, S. Schaal
  • Computer Science
    Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180)
  • 2001
TLDR
By using a fast online statistical learning network, the humanoid oculomotor system is able to acquire a high performance smooth pursuit after about 5 seconds of learning despite significant processing delays in the system.
...
...