Generating Images Instead of Retrieving Them: Relevance Feedback on Generative Adversarial Networks

  title={Generating Images Instead of Retrieving Them: Relevance Feedback on Generative Adversarial Networks},
  author={Antti Ukkonen and Pyry Joona and Tuukka Ruotsalo},
  journal={Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval},
  • Antti Ukkonen, P. Joona, Tuukka Ruotsalo
  • Published 2020
  • Computer Science
  • Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval
Finding images matching a user's intention has been largely based on matching a representation of the user's information needs with an existing collection of images. For example, using an example image or a written query to express the information need and retrieving images that share similarities with the query or example image. However, such an approach is limited to retrieving only images that already exist in the underlying collection. Here, we present a methodology for generating images… Expand
Brain-computer interface for generating personally attractive images
While we instantaneously recognize a face as attractive, it is much harder to explain what exactly defines personal attraction. This suggests that attraction depends on implicit processing ofExpand
Brain Relevance Feedback for Interactive Image Generation
It is shown that brain relevance feedback can validly control a generative model, overcoming a critical limitation of current BCI approaches. Expand


Sketch-based Image Retrieval using Generative Adversarial Networks
A conditional generative adversarial network is employed to enrich the content information of sketches and recover the imaginary images, and two VGG-based encoders are used to constrain their perceptual consistency from the view of feature representations. Expand
Image Generation from Sketch Constraint Using Contextual GAN
This paper addresses image generation guided by hand sketch using a novel joint image completion approach, where the sketch provides the image context for completing, or generating the output image, using a generated adversarial network. Expand
Relevance feedback: a power tool for interactive content-based image retrieval
A relevance feedback based interactive retrieval approach that effectively takes into account the subjectivity of human perception of visual content and the gap between high-level concepts and low-level features in CBIR. Expand
MindFinder: interactive sketch-based image search on millions of images
By scaling up the database to more than two million images, MindFinder not only helps users to easily present whatever they are imagining, but also has the potential to retrieve the most desired images in their mind. Expand
Contextual image search
The key idea is to use the search-to-annotation technique and the contextual textual query mining scheme to determine the corresponding textual query, to finally get semantically similar search results. Expand
Leveraging User Interaction Signals for Web Image Search
A number of implicit relevance feedback features are proposed based on these additional interactions: hover-through rate, 'converted-hover' rate, referral page click through, and a number of dwell time features. Expand
From captions to visual concepts and back
This paper uses multiple instance learning to train visual detectors for words that commonly occur in captions, including many different parts of speech such as nouns, verbs, and adjectives, and develops a maximum-entropy language model. Expand
A Style-Based Generator Architecture for Generative Adversarial Networks
An alternative generator architecture for generative adversarial networks is proposed, borrowing from style transfer literature, that improves the state-of-the-art in terms of traditional distribution quality metrics, leads to demonstrably better interpolation properties, and also better disentangles the latent factors of variation. Expand
Interactive search in image retrieval: a survey
  • B. Thomee, M. Lew
  • Computer Science
  • International Journal of Multimedia Information Retrieval
  • 2012
We are living in an Age of Information where the amount of accessible data from science and culture is almost limitless. However, this also means that finding an item of interest is increasinglyExpand
The cornucopia of meaningful leads: Applying deep adversarial autoencoders for new molecule development in oncology
This paper presents the first application of generative adversarial autoencoders (AAE) for generating novel molecular fingerprints with a defined set of parameters, developed a 7-layer AAE architecture with the latent middle layer serving as a discriminator. Expand