• Corpus ID: 204852297

Interactive Image Restoration

  title={Interactive Image Restoration},
  author={Zhiwei Han and Thomas Weber and Stefan Matthes and Yuanting Liu and Hao Shen},
Machine learning and many of its applications are considered hard to approach due to their complexity and lack of transparency. One mission of human-centric machine learning is to improve algorithm transparency and user satisfaction while ensuring an acceptable task accuracy. In this work, we present an interactive image restoration framework, which exploits both image prior and human painting knowledge in an iterative manner such that they can boost on each other. Additionally, in this system… 

Figures from this paper



Image quality assessment: from error visibility to structural similarity

A structural similarity index is developed and its promise is demonstrated through a set of intuitive examples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000.

Deep Image Prior

It is shown that a randomly-initialized neural network can be used as a handcrafted prior with excellent results in standard inverse problems such as denoising, super-resolution, and inpainting.

EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning

A new approach for image inpainting that does a better job of reproducing filled regions exhibiting fine details is developed and outperforms current state-of-the-art techniques quantitatively and qualitatively.

Semantic Image Inpainting with Deep Generative Models

A novel method for semantic image inpainting, which generates the missing content by conditioning on the available data, and successfully predicts information in large missing regions and achieves pixel-level photorealism, significantly outperforming the state-of-the-art methods.

Image Inpainting for Irregular Holes Using Partial Convolutions

This work proposes the use of partial convolutions, where the convolution is masked and renormalized to be conditioned on only valid pixels, and outperforms other methods for irregular masks.

PatchMatch: a randomized correspondence algorithm for structural image editing

This paper presents interactive image editing tools using a new randomized algorithm for quickly finding approximate nearest-neighbor matches between image patches, and proposes additional intuitive constraints on the synthesis process that offer the user a level of control unavailable in previous methods.

Generative Image Inpainting with Contextual Attention

This work proposes a new deep generative model-based approach which can not only synthesize novel image structures but also explicitly utilize surrounding image features as references during network training to make better predictions.

Scene completion using millions of photographs

A new image completion algorithm powered by a huge database of photographs gathered from the Web that can generate a diverse set of image completions and allow users to select among them.

Globally and locally consistent image completion

We present a novel approach for image completion that results in images that are both locally and globally consistent. With a fully-convolutional neural network, we can complete images of arbitrary

Interactive machine learning

An interactive machine-learning (IML) model that allows users to train, classify/view and correct the classifications and the Crayons tool embodies the notions of interactive machine learning is proposed.