Mixed reality using illumination-aware gradient mixing in surgical telepresence: enhanced multi-layer visualization

@article{Puri2022MixedRU,
  title={Mixed reality using illumination-aware gradient mixing in surgical telepresence: enhanced multi-layer visualization},
  author={Nirakar Puri and Abeer Alsadoon and P. W. C. Prasad and Nada AlSalami and Tarik Ahmed Rashid},
  journal={Multimedia Tools and Applications},
  year={2022},
  volume={81},
  pages={1153-1178}
}
Surgical telepresence using augmented perception has been applied, but mixed reality is still being researched and is only theoretical. The aim of this work is to propose a solution to improve the visualization in the final merged video by producing globally consistent videos when the intensity of illumination in the input source and target video varies. The proposed system uses an enhanced multi-layer visualization with illumination-aware gradient mixing using Illumination Aware Video… 

References

SHOWING 1-10 OF 25 REFERENCES
A novel mixed reality in breast and constructive jaw surgical tele-presence
Remote Surgeon Hand Motion and Occlusion Removal in Mixed Reality in Breast Surgical Telepresence: Rural and Remote Care
TLDR
The proposed system provides a satisfactory outcome in terms of accuracy and operating time, which allows surgeons in local and remote sites to collaborate more effectively, and brings about improvements by removing occlusion and the noise caused by hand motions during surgery.
Illumination-Guided Video Composition via Gradient Consistency Optimization
TLDR
This work proposes an illumination-guided video composition method via a unified spatial and temporal optimization framework that can produce globally consistent composition results and maintain the temporal coherency.
Video composition by optimized 3D mean‐value coordinates
TLDR
The combination of alpha matte‐based approaches and the 3D MVC method can further refine the produced video when the boundaries of the source object and the target object are very different, and this approach is able to achieve high‐performance blending with less computation.
A novel noise filtered and occlusion removal: navigational accuracy in augmented reality-based constructive jaw surgery
TLDR
The acceptable range of accuracy and the processing time are provided by this study for surgeons for carrying out a smooth surgical flow on positioning of an implant in relation to the jaw bone to be cut or drilled.
Automatic Trimap Generation and Consistent Matting for Light-Field Images
TLDR
This paper first performs binary segmentation to roughly segment a light-field image into foreground and background based on depth and color, and estimates accurate trimaps through analyzing color distribution along the boundary of the segmentation using guided image filter and KL-divergence.
Automatic Trimap Generation and Consistent Matting for Light-Field Images.
TLDR
This paper first performs binary segmentation to roughly segment a light-field image into foreground and background based on depth and color, and estimates accurate trimaps through analyzing color distribution along the boundary of the segmentation using guided image filter and KL-divergence.
Alpha matting with image pixel correlation
TLDR
The experimental study on images dataset shows that image pixels correlation is effective to improve matting, and that the matting results are comparable to some recent approaches.
Mixed Reality Guided Radiofrequency Needle Placement: A Pilot Study
TLDR
A novel mixed reality (MR) guidance method for liver tumors radiofrequency ablation (RFA) that is a holographic navigation platform, which projects a MR overlay onto the patient via HoloLens during RFA, which can provide a more natural and intuitive surgical mode for surgeons.
...
...