Extracting bimanual synergies with reinforcement learning

  title={Extracting bimanual synergies with reinforcement learning},
  author={K. Luck and H. B. Amor},
  journal={2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
  • K. Luck, H. B. Amor
  • Published 2017
  • Computer Science
  • 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Motor synergies are an important concept in human motor control. Through the co-activation of multiple muscles, complex motion involving many degrees-of-freedom can be generated. However, leveraging this concept in robotics typically entails using human data that may be incompatible for the kinematics of the robot. In this paper, our goal is to enable a robot to identify synergies for low-dimensional control using trial-and-error only. We discuss how synergies can be learned through latent… Expand
Exploiting Symmetries in Reinforcement Learning of Bimanual Robotic Tasks
A symmetrization method for ProMPs is presented and used to represent two movements, employing a single ProMP for the first arm and a symmetry surface that maps that ProMP to the second arm, which is adopted in reinforcement learning of bimanual tasks using relative entropy policy search algorithm. Expand
Improved Exploration through Latent Trajectory Optimization in Deep Deterministic Policy Gradient
This work evaluates the use of model-based trajectory optimization methods used for exploration in Deep Deterministic Policy Gradient when trained on a latent image embedding, leading to a symbiotic relationship between the deep reinforcement learning algorithm and the latent trajectory optimizer. Expand


Extracting motor synergies from random movements for low-dimensional task-space control of musculoskeletal robots.
This paper proposes to extract motor synergies from a subset of randomly generated reaching-like movement data, and presents a kernel-based regression formulation to estimate the forward and the inverse dynamics, and a sliding controller in order to cope with estimation error. Expand
Policy Search for Motor Primitives in Robotics
This paper extends previous work on policy learning from the immediate reward case to episodic reinforcement learning, resulting in a general, common framework also connected to policy gradient methods and yielding a novel algorithm for policy learning that is particularly well-suited for dynamic motor primitives. Expand
Kinesthetic Bootstrapping: Teaching Motor Skills to Humanoid Robots through Physical Interaction
A new programming-by-demonstration method called Kinesthetic Bootstrapping for teaching motor skills to humanoid robots by means of intuitive physical interactions, which has been successfully applied to the learning of various complex motor skills such as walking and standing up. Expand
Latent space policy search for robotics
This paper presents a novel policy search method that performs efficient reinforcement learning by uncovering the low-dimensional latent space of actuator redundancies by performing dimensionality reduction as a preprocessing step but naturally combines it with policy search. Expand
Hand Posture Subspaces for Dexterous Robotic Grasping
An on-line grasp planner that allows a human operator to perform dexterous grasping tasks using an artificial hand in a hand posture subspace of highly reduced dimensionality is presented. Expand
Subject-specific muscle synergies in human balance control are consistent across different biomechanical contexts.
It is shown that trial-by-trial variations in muscle activation for multidirectional balance control in humans were constrained by a small set of muscle synergies, and Muscle synergies represent consistent motor modules that map intention to action, regardless of the biomechanical context of the task. Expand
Sparse Latent Space Policy Search
A reinforcement learning method for sample-efficient policy search that exploits correlations between control variables, particularly frequent in motor skill learning tasks, and outperforms state-of-the-art policy search methods. Expand
Goal directed multi-finger manipulation: Control policies and analysis
This work presents a method for one-handed, task-based manipulation of objects that uses a mid-level, multi-phase approach to organize the problem into three phases and results in cyclic finger motions that accomplish the task. Expand
Identification of muscle synergies associated with gait transition in humans
The results suggest that the CNS low-dimensionally regulate the activation profiles of the specific synergies based on afferent information (spontaneous gait Transition) or by changing only the descending neural input to the muscle synergies (voluntary gait transition) to achieve a gait transitions. Expand
Grasp synthesis from low‐dimensional probabilistic grasp models
A novel data‐driven animation method for the synthesis of natural looking human grasping that greatly reduces the high number of degrees of freedom of the human hand to a few dimensions in a continuous grasp space. Expand