Planning Reactive Manipulation in Dynamic Environments

  title={Planning Reactive Manipulation in Dynamic Environments},
  author={Philipp S. Schmitt and Florian Wirnshofer and Kai M. Wurm and Georg von Wichert and Wolfram Burgard},
  journal={2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
When robots perform manipulation tasks, they need to determine their own movement, as well as how to make and break contact with objects in their environment. Reasoning about the motions of robots and objects simultaneously leads to a constrained planning problem in a high-dimensional state-space. Additionally, when environments change dynamically motions must be computed in real-time.To this end, we propose a feedback planner for manipulation. We model manipulation as constrained motion and… Expand
Dynamic Grasping with Reachability and Motion Awareness
This paper model the reachability space of the robot using a signed distance field which enables us to quickly screen unreachable grasps and train a neural network to predict the grasp quality conditioned on the current motion of the target. Expand
Towards a Generic Manipulation Framework for Robots based on Model Predictive Interaction Control
An optimization-based control framework for robotic manipulation tasks based on the concept of model predictive interaction control (MPIC) and the generic control concept are demonstrated for a screwing application using a robot arm with seven degrees of freedom. Expand
Domain Optimization for Hierarchical Planning based on Set-Theory
A domain optimization algorithm for hierarchical planners that uses a set-based formulation that reduces the effects of the non-optimality that comes with the hierarchical approach is presented. Expand
Survivable Hyper-Redundant Robotic Arm with Bayesian Policy Morphing
A Bayesian reinforcement learning framework that allows robotic manipulators to adaptively recover from random mechanical failures autonomously, hence being survivable, and it is shown that policy search, in the direction biased by prior experience, significantly improves learning efficiency in terms of sampling requirements. Expand
A Differentiable Recipe for Learning Visual Dexterous Planar Manipulation
  • 2021
Specifying tasks with videos is a powerful technique towards acquiring novel 1 and general robot skills. However, reasoning over mechanics and dexterous interactions 2 can make it challenging toExpand
A Differentiable Recipe for Learning Visual Non-Prehensile Planar Manipulation
This work proposes a novel architecture, Differentiable Learning for Manipulation (DLM), that combines video decoding neural models with priors from contact mechanics by leveraging differentiable optimization and finite difference based simulation. Expand
Planning Under Manifold Constraints


Optimal, sampling-based manipulation planning
This paper proposes an asymptotically optimal manipulation planner that extends optimal sampling-based roadmap planners to efficiently explore the configuration space of the robot and the object and proves probabilistic completeness and global, asymPTotic optimality. Expand
Modeling and Planning Manipulation in Dynamic Environments
A new model for sequential manipulation tasks that also considers robot dynamics and time-variant environments is proposed and automatically derive constraint-based controllers and use them as steering functions in a kinodynamic manipulation planner. Expand
Sampling-Based Methods for Motion Planning with Constraints
This survey describes the families of methods for sampling-based planning with constraints and places them on a spectrum delineated by their complexity and focuses on the representation of constraints and sampling- based planners that incorporate constraints. Expand
Extending the iTaSC Constraint-based Robot Task Specification Framework to Time-Independent Trajectories and User-Configurable Task Horizons
This paper extends a generic modeling approach for geometrically complex robot tasks to include task constraints that are not given as explicit functions of time, to allow task programmers to make a trade-off between computational speed and (global) task optimality. Expand
A geometrical approach to planning manipulation tasks. The case of discrete placements and grasps
The problem is shown to be a constrained instance of the coordinated motion planning problem for multiple moving bodies, and the constraints are related to the placement and the motion of objects, and can be expressed geometrically. Expand
Asymptotically Optimal Planning under Piecewise-Analytic Constraints
It is demonstrated that, given the ability to sample from the locally reachable subset of the configuration space with positive probability, the first asymptotically optimal algorithm for motion planning problems with piecewise-analytic differential constraints can construct random geometric graphs that contain optimal plans with probability one in the limit of infinite samples. Expand
Manipulation Planning with Probabilistic Roadmaps
A general manipulation planning approach capable of addressing continuous sets for modeling both the possible grasps and the stable placements of the movable object, rather than discrete sets generally assumed by the previous approaches. Expand
Task Planning with Continuous Actions and Nondeterministic Motion Planning Queries
We present a new probabilistic tree-of-roadmaps (PTR) planner that integrates discrete task planning and continuous motion planning using a probabilistic forward search. PTR is explicitly designedExpand
Sensor-Based Reactive Execution of Symbolic Rearrangement Plans by a Legged Mobile Manipulator
This work demonstrates the physical rearrangement of wheeled stools in a moderately cluttered indoor environment by a quadrupedal robot that autonomously achieves a user's desired configuration using a three layer hierarchical architecture. Expand
Constraint-based Task Specification and Estimation for Sensor-Based Robot Systems in the Presence of Geometric Uncertainty
This paper introduces a systematic constraint-based approach to specify complex tasks of general sensor-based robot systems consisting of rigid links and joints. The approach integrates bothExpand