• Publications
  • Influence
STOMP: Stochastic trajectory optimization for motion planning
It is experimentally show that the stochastic nature of STOMP allows it to overcome local minima that gradient-based methods like CHOMP can get stuck in. Expand
A Generalized Path Integral Control Approach to Reinforcement Learning
The framework of stochastic optimal control with path integrals is used to derive a novel approach to RL with parameterized policies to demonstrate interesting similarities with previous RL research in the framework of probability matching and provides intuition why the slightly heuristically motivated probability matching approach can actually perform well. Expand
Information theoretic MPC for model-based reinforcement learning
An information theoretic model predictive control algorithm capable of handling complex cost criteria and general nonlinear dynamics and using multi-layer neural networks as dynamics models to solve model-based reinforcement learning tasks is introduced. Expand
Aggressive driving with model predictive path integral control
A model predictive control algorithm designed for optimizing non-linear systems subject to complex cost criteria using a stochastic optimal control framework using a fundamental relationship between the information theoretic notions of free energy and relative entropy is presented. Expand
Reinforcement learning of motor skills in high dimensions: A path integral approach
This paper derives a novel approach to RL for parameterized control policies based on the framework of stochastic optimal control with path integrals, and believes that this new algorithm, Policy Improvement with Path Integrals (PI2), offers currently one of the most efficient, numerically robust, and easy to implement algorithms for RL in robotics. Expand
Learning variable impedance control
The results show that the power of variable impedance control is made available to a wide variety of robotic systems and practical applications and can be used not only for planning but also to derive variable gain feedback controllers in realistic scenarios. Expand
Skill learning and task outcome prediction for manipulation
This work presents a Reinforcement Learning based approach to acquiring new motor skills from demonstration that allows the robot to learn fine manipulation skills and significantly improve its success rate and skill level starting from a possibly coarse demonstration. Expand
Information-Theoretic Model Predictive Control: Theory and Applications to Autonomous Driving
An information-theoretic approach to stochastic optimal control problems that can be used to derive general sampling-based optimization schemes is presented and applied to the task of aggressive autonomous driving around a dirt test track. Expand
From dynamic movement primitives to associative skill memories
This paper reviews how a particular computational approach to movementPrimitives, called dynamic movement primitives, can contribute to learning motor skills, and addresses imitation learning, generalization, trial-and-error learning by reinforcement learning, movement recognition, and control based on movement Primitives. Expand
Model Predictive Path Integral Control using Covariance Variable Importance Sampling
In this paper we develop a Model Predictive Path Integral (MPPI) control algorithm based on a generalized importance sampling scheme and perform parallel optimization via sampling using a GraphicsExpand