Computer-aided liver surgery planning: an augmented reality approach

  title={Computer-aided liver surgery planning: an augmented reality approach},
  author={Alexander Bornik and Reinhard R. Beichel and Bernhard Reitinger and Georg Gotschuli and Erich Sorantin and Franz W. Leberl and Milan Sonka},
  booktitle={SPIE Medical Imaging},
Surgical resection of liver tumors requires a detailed three-dimensional understanding of a complex arrangement of vasculature, liver segments and tumors inside the liver. In most cases, surgeons need to develop this understanding by looking at sequences of axial images from modalities like X-ray computed tomography. A system for liver surgery planning is reported that enables physicians to visualize and refine segmented input liver data sets, as well as to simulate and evaluate different… 

Liver segment approximation in CT data for surgical resection planning

Validation of the developed portal vein segmentation method in computer generated phantoms shows that more vessel branches can be segmented, compared to a conventional approach, and the outcome of a Nearest Neighbor liver segment approximation method applied to phantom data demonstrates that the proposed vessel segmentation approach translates into a more accurate segment partitioning.

An Augmented Reality Platform with Hand Gestures-Based Navigation for Applications in Image-Guided Surgery: Prospective Concept Evaluation by Surgeons

Developing a generic AR-based and wireless gestures platform for image-guided surgery planning showed that surgeons found the application a suitable alternative to understand better the previous steps involved in surgical planning, especially for minimally invasive surgery.

Three-Dimensional Visualization of Liver CT Slices by Amira

3-D physical parameters of the liver and tumors were obtained from reconstruction surface results, which could be applied to simulate the distribution of temperature field and helped to choose the most suitable hyperthermia parameters for liver cancer treatment.

Integrated Medical Workflow for Augmented Reality Applications

A component-oriented software architecture which specifically aims at addressing the needs of medical AR, in particular strategies for ensuring uniform application quality throughout the medical workflow is discussed.

Augmented reality in surgical procedures

ARIS*ER is a multidisciplinary consortium developing a new generation of decision support tools for MIT by augmenting visual and sensorial feedback providing tailored solutions for a range of clinical applications.

Augmented Reality Based Measurement Tools for Liver Surgery Planning

Besides two fast volume calculation algorithms, different Augmented Reality based 3D distance measurement methods are presented and usability aspects for such a system are identified.

Spatial measurements for medical augmented reality

It is argued that AR is a superior tool compared to desktop 2D or 3D visualization for performing such analysis, because it allows true direct manipulation of 3D virtual objects in space, while rendering the medical data in the familiar context of the user's own body.

Robust Segmentation of Tubular Structures in 3 D Volume Data

Segmentation of tubular structures like blood vessels and airways in 3D volume data is of vital interest for medical applications like diagnosis and surgical planning. The aim of this diploma thesis

A Hybrid User Interface for Manipulation of Volumetric Medical Data

A novel system for interactive visualization and manipulation of medical datasets for surgery planning based on a hybrid VR / Tablet PC user interface to facilitate efficient visual inspection and correction of surface models generated by automated segmentation algorithms based on x-ray computed tomography scans.

Sketch‐Based Editing Tools for Tumour Segmentation in 3D Medical Images

An image‐based as well as an image‐independent method for intuitive and efficient segmentation editing in 3D in the context of tumour segmentation in computed tomography (CT) is presented.



A system for the virtual planning of liver surgery

A system for the virtual planning of liver surgery that was implemented on the base of an object oriented white box framework is presented, which enables the reception of image data and the forwarding of the results.

HepaVision2 — a software assistant for preoperative planning in living-related liver transplantation and oncologic liver surgery

HepaVision2, a user friendly software application for preoperative planning based on CT images in liver surgery is presented. It is intended for both, evaluation of potential donors in living-related

An Augmented Reality Navigation System for Computer Assisted Arthroscopic Surgery of the Knee

The prototype system has been positively evaluated by a selected group of skilled orthopaedic surgeons and preliminary tests on the overall accuracy of the system show that errors can be kept within 3°/3mm.

Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery

The accuracy and utility of the creation of a 3D liver model compared with the conventional reading of the CT scan by a radiologist are confirmed and may allow improved preoperative planning of hepatic surgery by more precisely delineating liver pathology and its relationship to normal hepatic structures.

Stereo Augmented Reality in the Surgical Microscope

The MAGI (microscope-assisted guided interventions) augmented-reality system, which allows surgeons to view virtual features segmented from preoperative radiological images accurately overlaid in stereo in the optical path of a surgical microscope, has a theoretical overlay accuracy of better than 1 mm at the focal plane of the microscope.

Intraoperative presentation of surgical planning and simulation results using a stereoscopic see-through head-mounted display

This paper uses a see- through head-mounted display for the superimposition of a patient with virtual dat for surgeons to visualize and to re-use preoperatively calculated data directly in the operation field using Augmented Reality techniques.

Marching cubes: A high resolution 3D surface construction algorithm

We present a new algorithm, called marching cubes, that creates triangle models of constant density surfaces from 3D medical data. Using a divide-and-conquer approach to generate inter-slice

Augmented Reality Visualization for Laparoscopic Surgery

The system uses 3D visualization, depth extraction from laparoscopic images, and six degree-of-freedom head and laparoscope tracking to display a merged real and synthetic image in the surgeon’s video-see-through head-mounted display.

Diaphragm dome surface segmentation in CT data sets: a 3D active appearance model approach

A new 3D Active Appearance Model (AAM) approach to segmentation of the top layer of the diaphragm dome is presented, based on a gradient-descent optimization process and uses image intensity appearance around the actual dome shape.

Improving realism of a surgery simulator: linear anisotropic elasticity, complex interactions and force extrapolation

The latest developments of the minimally invasive hepatic surgery simulator prototype developed at INRIA are described, including the implementation of several biomechanical models and the integration of two force-feedback devices in the simulation platform.