Flexible Interactive Retrieval SysTem 2.0 for Visual Lifelog Exploration at LSC 2021

@article{TrangTrung2021FlexibleIR,
  title={Flexible Interactive Retrieval SysTem 2.0 for Visual Lifelog Exploration at LSC 2021},
  author={Hoang-Phuc Trang-Trung and Thanh-Cong Le and Mai-Khiem Tran and Van-Tu Ninh and Tu-Khiem Le and Cathal Gurrin and Minh-Triet Tran},
  journal={Proceedings of the 4th Annual on Lifelog Search Challenge},
  year={2021}
}
With a huge collection of photos and video clips, it is essential to provide an efficient and easy-to-use system for users to retrieve moments of interest with a wide variation of query types. This motivates us to develop and upgrade our flexible interactive retrieval system for visual lifelog exploration. In this paper, we briefly introduce version 2 of our system with the following main features. Our system supports multiple modalities for interaction and query processing, including visual… 
View on ACM
doras.dcu.ie
5 Citations
Background Citations
4
Methods Citations
1

5 Citations

Flexible Interactive Retrieval SysTem 3.0 for Visual Lifelog Exploration at LSC 2022

This work develops FIRST 3.0, a novel and flexible system that leverages expressive cross-domain embeddings to enhance the searching process and aims to adaptively capture the semantics of an image at different levels of detail.

E-Myscéal: Embedding-based Interactive Lifelog Retrieval System for LSC'22

This paper upgrades the previous MyScéal, which was the top performing system in LSC'20 and L SC'21, and presents E-My Scéal for LSC’22, which includes a completely different search engine and improves the event view browsing in order to better support novice users.

MEMORIA: A Memory Enhancement and MOment RetrIeval Application for LSC 2022

The MEMORIA computational tool to participate for the first time in the Lifelog Search Challenge 2022 is presented, confirming the effectiveness of the proposed approach and showing the most relevant functionalities of the system.

Memento 2.0: An Improved Lifelog Search Engine for LSC'22

An improved version of the Memento system, which first participated in the Lifelog Search Challenge 2021, is presented, which employs image-text embeddings derived from two CLIP models and adopts a weighted ensemble approach to derive a combined final ranking.

Introduction to the Fourth Annual Lifelog Search Challenge, LSC'21

An overview of the motivation for LSC'21, the lifelog dataset used in the competition, and the participating systems is presented.

References

SHOWING 1-10 OF 31 REFERENCES

FIRST - Flexible Interactive Retrieval SysTem for Visual Lifelog Exploration at LSC 2020

FIRST, a Flexible Interactive Retrieval SysTem, is developed to help users to combine or integrate various query components in a flexible manner to handle different query scenarios, such as visual clustering data based on color histogram, visual similarity, GPS location, or scene attributes.

Introduction to the Fourth Annual Lifelog Search Challenge, LSC'21

An overview of the motivation for LSC'21, the lifelog dataset used in the competition, and the participating systems is presented.

Probabilistic Embeddings for Cross-Modal Retrieval

It is argued that deterministic functions are not sufficiently powerful to capture one-to-many correspondences and proposed Probabilistic Cross-Modal Embedding (PCME), where samples from the different modalities are represented as probabilistic distributions in the common embedding space.

Lifelog Moment Retrieval with Self-Attention based Joint Embedding Model

A novel interactive system to retrieve specific moments utilizing textbased queries using Self-Attention based Joint Embedding Model (SAJEM) for that purpose and achieves the first rank in Lifelog Moment Retrieval task of ImageCLEF Lifelogs 2020.

Overview of ImageCLEF Lifelog 2020: Lifelog Moment Retrieval and Sport Performance Lifelog

The fourth edition of Lifelog challenges in ImageCLEF 2020 is described, which is a larger multimodal dataset based on the merger of three previous NTCIR Lifelov datasets, which contain approximately 191,439 images with corresponding visual concepts and other related metadata.

SOMHunter for Lifelog Search

This work presents an extended version of SOMHunter, an interactive retrieval tool designed for known-item and ad-hoc search tasks over image and video datasets that integrates functionality required to deal with lots of highly similar images collected in typical lifelogs.

VRLE: Lifelog Interaction Prototype in Virtual Reality: Lifelog Search Challenge at ACM ICMR 2020

A novel approach to visual lifelog exploration based on research to date utilising virtual reality as a medium for interactive information retrieval is presented.

Myscéal: An Experimental Interactive Lifelog Retrieval System for LSC'20

Myscéal, an interactivelifelog retrieval engine designed to support novice users to retrieve items of interest from a large multimodal lifelog, is introduced.

VIRET Tool with Advanced Visual Browsing and Feedback

Several new features that focus on result set presentation based on dynamically computed self-organized maps, as well as additional feedback about the distribution of relevance scores for a query are implemented for the Lifelog Search Challenge 2020.

Interactive Lifelog Retrieval with vitrivr

This paper shows how the new dataset can be used for retrieval in different modalities without sacrificing efficiency, and describes two recent additions, temporal scoring and staged querying, and discusses the deep learning methods used to enrich the dataset.