Path Planning for Visual servoing and Navigation using Convex Optimization

  title={Path Planning for Visual servoing and Navigation using Convex Optimization},
  author={A. H. Abdul Hafez and Anil Kumar Nelakanti and C. V. Jawahar},
  journal={Int. J. Robotics Autom.},
Exploiting visual cues to control systems for robotic applications is a promising idea. Practically, they are usable only if the end result accedes to the restrictions of the specific environment. These restrictions are like the limited field of view of the camera and physical constraints of the workspace of the robot. Hence, there is a need for a general framework that can be used adaptively across various environments. We develop such an algorithmic framework that is flexible to accommodate… 

Figures from this paper

Image space based path planning for reactionless manipulation of redundant space robot

The proposed algorithm is able to incorporate the necessary coupling between the motions of the the dual arms and the base of the robot to ensure zero base reactions and gives the flexibility to apply multiple constraints in both the image space and the configuration space.

Maintaining Visibility of a Landmark using Optimal Sampling-based Path Planning

An approach to extend sampling-based path planning algorithms to include visual restrictions, which dynamically builds a 3D model of camera field visibility as seen from the moving robot, and both results in simulation and experiments using a real robot manipulator are presented.

Image-based visual servoing dealing with constraints

The proposed method deals with visibility constraints and occultation avoidance using potential fields and doesn't require neither trajectory planning nor pose estimation step, so it is more efficient in terms of computation time.

Planning and Tracking in Image Space for Image-Based Visual Servoing of a Quadrotor

A method is proposed to solve the image-based control of a quadrotor Unmanned Aerial Vehicle (UAV) by directly planning and tracking in image space. First, by adopting the virtual camera approach and

Smooth-optimal Adaptive Trajectory Tracking Using an Uncalibrated Fish-eye Camera

This paper presents a two-stage smooth-optimal trajectory tracking strategy that can be directly determined in an uncalibrated fish-eye image, and has a good performance in both tracking accuracy and motion smoothness.

Robust Image-Based Visual Servoing With Prescribed Performance Under Field of View Constraints

In this paper, we propose a visual servoing scheme that imposes predefined performance specifications on the image feature coordinate errors and satisfies the visibility constraints that inherently

An accurate Path Planning Algorithm based on triangular Meshes in robotic fibre Placement

Based on triangular meshes, an accurate path planning algorithm with the commonly used four laying angles in the robotic fibre placement (RFP) is proposed and the simulation results verify the effectiveness of this method.



Path planning for robust image-based control

This paper proposes a new approach to resolve difficulties in vision feedback control loop techniques by coupling path planning in image space and image-based control and ensures robustness with respect to modeling errors.

Visual Servoing Path Planning via Homogeneous Forms and LMI Optimizations

  • G. Chesi
  • Mathematics
    IEEE Transactions on Robotics
  • 2009
This paper introduces a general parametrization of the trajectories from the initial to the desired location based on homogeneous forms and a parameter-dependent version of the Rodrigues formula, which allows us to impose typical constraints via positivity conditions on suitable homogeneity forms.

Path planning approach to visual servoing with feature visibility constraints: A convex optimization based solution

The visual servoing problem with feature visibility constraints is formulated as a convex optimization of a function of the camera position i.e. the translation of the film position, which allows the introduction of more constraints, like joint limits of the arm, into the visual Servoing process.

Path-Planning for Visual Servoing: A Review and Issues

This survey provides a comprehensive technical review of existing major approaches to path-planning for visual servoing and discusses the underlying pathplanning techniques along with the issues regarding their integration with reactive visual servo controllers.

Visual Servo Control by Optimizing Hybrid Objective Function with Visibility and Path Constraints

Simulation results show that the new stable hybrid visual servo controller presented provides an efficient solution to the camera retreat and features visibility problems and is superior to the state of the art.

Randomized Kinodynamic Planning for Robust Visual Servoing

A randomized kinodynamic path planning approach with image-based control of a robotic arm equipped with an in-hand camera yields continuously differentiable camera trajectories by taking camera dynamics into account, while accounting for a critical set of image and physical constraints at the planning stage.

Path planning for image-based control of wheeled mobile manipulators

This work proposes a kinodynamic planning approach that explores the camera state space for permissible trajectories by iteratively extending a search tree in this space and simultaneously tracking these trajectories in the WMM configuration space through weighted pseudo-inverse Jacobian solutions combined with a null space optimization technique.

Model-free optimal trajectories in the image space: application to robot vision control

  • Y. MezouarF. Chaumette
  • Mathematics
    Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001
  • 2001
This paper addresses the problem of generating and tracking realistic and optimal smooth trajectories of complex features in the image space of image-based servoing using image based control.

Optimal Camera Trajectory with Image-Based Control

This paper addresses the problem of finding realistic image-space trajectories that correspond to optimal 3D trajectories and experimental results obtained on a six-degrees-of-freedom eye-in-hand robotic system confirm the validity of the proposed approach.

A tutorial on visual servo control

This article provides a tutorial introduction to visual servo control of robotic manipulators by reviewing the prerequisite topics from robotics and computer vision, including a brief review of coordinate transformations, velocity representation, and a description of the geometric aspects of the image formation process.