Motion planning under uncertainty using iterative local optimization in belief space


We present a new approach to motion planning under sensing and motion uncertainty by computing a locally optimal solution to a continuous partially observable Markov decision process (POMDP). Our approach represents beliefs (the distributions of the robot’s state estimate) by Gaussian distributions and is applicable to robot systems with non-linear dynamics and observation models. The method follows the general POMDP solution framework in which we approximate the belief dynamics using an extended Kalman filter and represent the value function by a quadratic function that is valid in the vicinity of a nominal trajectory through belief space. Using a belief space variant of iterative LQG (iLQG), our approach iterates with second-order convergence towards a linear control policy over the belief space that is locally optimal with respect to a user-defined cost function. Unlike previous work, our approach does not assume maximumlikelihood observations, does not assume fixed estimator or control gains, takes into account obstacles in the environment, and does not require discretization of the state and action spaces. The running time of the algorithm is polynomial (O[n6]) in the dimension n of the state space. We demonstrate the potential of our approach in simulation for holonomic and nonholonomic robots maneuvering through environments with obstacles with noisy and partial sensing and with non-linear dynamics and observation models.

DOI: 10.1177/0278364912456319

Extracted Key Phrases

8 Figures and Tables

Citations per Year

136 Citations

Semantic Scholar estimates that this publication has 136 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Berg2012MotionPU, title={Motion planning under uncertainty using iterative local optimization in belief space}, author={Jur P. van den Berg and Sachin Patil and Ron Alterovitz}, journal={I. J. Robotics Res.}, year={2012}, volume={31}, pages={1263-1278} }