Visual information retrieval in endoscopic video archives

@article{RoldanCarlos2015VisualIR,
  title={Visual information retrieval in endoscopic video archives},
  author={Jennifer Roldan-Carlos and Mathias Lux and Xavier Gir{\'o}-i-Nieto and Pia Mu{\~n}oz and Nektarios Anagnostopoulos},
  journal={2015 13th International Workshop on Content-Based Multimedia Indexing (CBMI)},
  year={2015},
  pages={1-6}
}
In endoscopic procedures, surgeons work with live video streams from the inside of their subjects. A main source for documentation of procedures are still frames from the video, identified and taken during the surgery. However, with growing demands and technical means, the streams are saved to storage servers and the surgeons need to retrieve parts of the videos on demand. In this submission we present a demo application allowing for video retrieval based on visual features and late fusion… Expand
Content-based retrieval in videos from laparoscopic surgery
TLDR
It is proposed to use feature signatures, which can appropriately and concisely describe the content of laparoscopic images, and it is shown that by using this content descriptor with an appropriate metric, this work is able to efficiently perform content-based retrieval in Laparoscopic videos. Expand
Endoscopic Video Retrieval: A Signature-Based Approach for Linking Endoscopic Images with Video Segments
TLDR
The proposed distance-based similarity model facilitates an adaptive representation of the visual properties of endoscopic images and allows for matching these properties efficiently and improves the current state of the art by one order of magnitude. Expand
Semi-Automatic Retrieval of Relevant Segments from Laparoscopic Surgery Videos
TLDR
The thesis deals with the questions of how to semantically classify video frames using Convolutional Neural Networks into different semantic concepts of surgical actions and anatomical structures and investigates to what extent surgeons' needs are covered with the proposed extraction of relevant scenes. Expand
Large-Scale Endoscopic Image and Video Linking with Gradient-Based Signatures
TLDR
This paper proposes to approximate the video segments' content-based features by gradient-based signatures and to index these signatures with the Minkowski distance in order to determine the most query-like video segments efficiently. Expand
Static vs. Dynamic Content Descriptors for Video Retrieval in Laparoscopy
TLDR
The experimental results show that although static descriptors achieve the highest overall performance, dynamic descriptors are much more discriminative for certain classes of surgical actions. Expand
Content-based processing and analysis of endoscopic images and videos: A survey
TLDR
This survey aims to introduce this research field to a broader audience in the Multimedia community to stimulate further research, to describe domain-specific characteristics of endoscopic videos that need to be addressed in a pre-processing step, and to systematically bring together the very diverse research results for the first time. Expand
Binary convolutional neural network features off-the-shelf for image to video linking in endoscopic multimedia databases
TLDR
Evaluation shows that binary CNN features are compact, yet powerful image descriptors for retrieval in the endoscopic imaging domain are able to maintain state-of-the-art performance, while providing the benefit of low storage space requirements and hence provide the best compromise. Expand
Video content analysis of surgical procedures
TLDR
Content-based video analysis of surgical operations is a rapidly expanding field and several future prospects for research exist including, inter alia, shot boundary detection, keyframe extraction, video summarization, pattern discovery, and video annotation. Expand
Surgical Video Summarization
While surgical videos are valuable support material for activities around surgery, their summarization demands great amounts of time from surgeons, resulting in the production of very few videos. WeExpand
LIvRE: A Video Extension to the LIRE Content-Based Image Retrieval System
TLDR
This thesis presents an extension and adaptation of Lire and its plugin for Solr, an open-source enterprise search platform from the Apache Lucene project, for video retrieval based on visual features, as well as a web-interface for users from different devices. Expand
...
1
2
...

References

SHOWING 1-10 OF 33 REFERENCES
Keyframe extraction in endoscopic video
TLDR
A new keyframe extraction approach for this special video domain is proposed and it is shown that this method is significantly better than a previously proposed approach. Expand
Real-time retrieval of similar videos with application to computer-aided retinal surgery
TLDR
This paper introduces ongoing research on computer-aided ophthalmic surgery and presents a novel Content-Based Video Retrieval (CBVR) system, which has been successfully applied to automated recognition of retinal surgery steps on a 69-video dataset. Expand
Multimodal medical image retrieval: image categorization to improve search precision
TLDR
This work uses automatic annotation based on visual attributes to label images as part of the indexing process and the subsequently use these labels to filter or reorder the results during the retrieval process, creating a modality classifier for the weakly labeled images in this collection. Expand
Video Google: a text retrieval approach to object matching in videos
We describe an approach to object and scene retrieval which searches for and localizes all the occurrences of a user outlined object in a video. The object is represented by a set of viewpointExpand
A review of content-based image retrieval systems in medical applications - clinical benefits and future directions
TLDR
The goal is not, in general, to replace text-based retrieval methods as they exist at the moment but to complement them with visual search tools. Expand
A Content-Based Approach to Medical Image Database Retrieval
TLDR
This chapter is intended to disseminate the knowledge of the CBIR approach to the applications of medical image management and to attract greater interest from various research communities to rapidly advance research in this field. Expand
Comparing fusion techniques for the ImageCLEF 2013 medical case retrieval task
TLDR
Results of the compound figure separation and modality classification tasks are added and it is demonstrated that the selection of the fusion strategy can improve the best performance on the case-based retrieval task. Expand
GoldMiner: a radiology image search engine.
TLDR
The GoldMiner search engine provides easy, rapid access to a large library of images and their associated text, and it is freely available for use on the Internet. Expand
Content-Based Medical Image Retrieval: A Survey of Applications to Multidimensional and Multimodality Data
TLDR
This paper presents a review of state-of-the-art medical CBIR approaches in five main categories: two-dimensional image retrieval, retrieval of images with three or more dimensions, the use of nonimage data to enhance the retrieval, multimodality image retrieved, and retrieval from diverse datasets. Expand
LIRE: open source image retrieval in Java
  • M. Lux
  • Computer Science
  • MM '13
  • 2013
TLDR
An overview on LIRE is given, its use, capabilities and reports on retrieval and runtime performance, that provides a simple way to index and retrieve millions of images based on the images' contents. Expand
...
1
2
3
4
...