Template-Based Conformal Shape-from-Motion-and-Shading for Laparoscopy

  title={Template-Based Conformal Shape-from-Motion-and-Shading for Laparoscopy},
  author={Abed C. Malti and Adrien Bartoli and Toby Collins},
Shape-from-Shading (SfS) is one of the fundamental techniques to recover depth from a single view. Such a method has shown encouraging but limited results in laparoscopic surgery due to the complex reflectance properties of the organ tissues. On the other hand, Template-Based Deformable-Shape-from-Motion (DSfM) has been recently used to recover a coarse 3D shape in laparoscopy. We propose to combine both geometric and photometric cues to robustly reconstruct 3D human organs. Our method is… 

Combining Conformal Deformation and Cook–Torrance Shading for 3-D Reconstruction in Laparoscopy

A new monocular 3-D reconstruction method adapted for reconstructing organs in the abdominal cavity that copes with both sequential processing and self-recovery from tracking failure and is validated using ex vivo and in vivo data with ground-truth.

Fast shape-from-template using local features

A template-based approach is presented to reconstruct the surface of an isometric deformable object and two new approaches to detect and remove the possible outliers based on geometrical properties of the matched keypoints are proposed.

Towards Live Monocular 3D Laparoscopy Using Shading and Specularity Information

An accurate method to model any laparoscope's light source, and a highly-parallelised SfS algorithm that outperforms the fastest current method, and the successful in-vivo reconstruction of the human uterus is presented.

Image-Aligned Dynamic Liver Reconstruction Using Intra-Operative Field of Views for Minimal Invasive Surgery

This work proposes an efficient technique for liver surface reconstruction based on the structure from motion to handle liver deformation, which will assist surgeons to visualize liver surface more efficiently with better depth perception and shows that the reconstruction accuracy can be enhanced even in challenging laparoscopic environments.

Local deformation modelling for non-rigid structure from motion

This thesis proposes its own local model – the Quadratic Deformation model – and shows how patch division and reconstruction can be formulated in a principled approach by alternating at minimizing a single geometric cost – the image re-projection error of the reconstruction.

3D Estimation of Extensible Surfaces Through a Local Monocular Reconstruction Technique

This paper deals with the monocular reconstruction of an extensible surface by proposing a novel approach for the determination of the 3D positions of a set of points on images of the deformed

3D Reconstruction in Laparoscopy with Close-Range Photometric Stereo

The first solution to 3D reconstruction in monocular laparoscopy using methods based on Photometric Stereo (PS) is presented, which can compute 3D from a single image, does not require correspondence estimation, and computes absolute depth densely.

Realtime Wide-baseline Registration of the Uterus in Monocular Laparoscopic Videos

This work presents a way to register the uterus in monocular laparoscopy in realtime using a novel two-phase approach that significantly outperforms SLAM on an in vivo dataset comprising three human uteri.

Shape-from-Polarization in laparoscopy

Qualitative and quantitative comparison to Shape-from-Shading (SfS) show the effectiveness of the method and its promising use in laparoscopic surgery.

Non Rigid Registration of 3D Images to Laparoscopic Video for Image Guided Surgery

A novel stereo reconstruction approach which exploits prior knowledge of patient specific organ models and outlier robust non rigid registration is proposed which is validated on phantom data and the practical application of the reconstruction is demonstrated on in vivo data.



Template-Based Conformal Shape-from-Motion from Registered Laparoscopic Images

A new sequential 3D reconstruction method well-adapted to the peritoneal environment that makes both sequential processing and effective self-recovery from tracking errors possible and demonstrates the ability of the method to deal with extensible deformations of the tissues.

Monocular Template-based Reconstruction of Inextensible Surfaces

A monocular 3D reconstruction algorithm for inextensible deformable surfaces that uses point correspondences between a single image of the deformed surface taken by a camera with known intrinsic parameters and a template to recover the 3D surface shape as seen in the image.

Monocular Template-Based Reconstruction of Smooth and Inextensible Surfaces

The idea is to say that the 2D-3D map must be everywhere a local isometry, which induces conditions on the Jacobian matrix of the map which are included in a least-squares minimization problem.

Local deformation models for monocular 3D shape recovery

This paper proposes an approach to learning shape priors, and uses a texture-based approach, to learn local deformation models, and combine them to reconstruct surfaces of arbitrary global shapes, and shows that their models are effective to reconstruct from single videos poorly-textured surfaces of arbitrarily shape.

Capturing 3D stretchable surfaces from single images in closed form

We present a closed form solution to the problem of recovering the 3D shape of a nonrigid potentially stretchable surface from 3D-to-2D correspondences. In other words, we can reconstruct a surface

Dense Surface Reconstruction for Enhanced Navigation in MIS

A high-fidelity tissue geometry mapping by combining a sparse SLAM map with semi-dense surface reconstruction is proposed and shown that the method is able to effectively increase the coverage of the expanded surgical view without compromising mapping accuracy.

Three-dimensional morphing of similar shapes using a template mesh

A novel approach in which a template mesh is mapped directly to the target mesh is proposed for the efficient treatment of the conforming mesh generation problem.

A Unifying and Rigorous Shape from Shading Method Adapted to Realistic Data and Applications

A new method for the Lambertian Shape From Shading (SFS) problem based on the notion of Crandall-Lions viscosity solution is proposed and some stability results are given and numerical schemes for the SFS based on this method are described.

Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery

A novel stereo reconstruction algorithm that propagates disparity information around a set of candidate feature matches that has the advantage of avoiding problems with specular highlights, occlusions from instruments and view dependent illumination bias.

EKF monocular SLAM with relocalization for laparoscopic sequences

This paper proposes the combination EKF Monocular SLAM + 1-Point RANSAC + Randomised List Relocalization to process laparoscopic sequences -abdominal cavity images-.