Hyperrealistic Image Inpainting with Hypergraphs

  title={Hyperrealistic Image Inpainting with Hypergraphs},
  author={Gourav Wadhwa and Abhinav Dhall and Subrahmanyam Murala and Usman Tariq},
  journal={2021 IEEE Winter Conference on Applications of Computer Vision (WACV)},
Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism to learn the global context of the image. This attention mechanism produces semantically plausible but blurry results because of incapability to capture the global context. In this paper, we introduce hypergraph convolution on spatial features to learn the… Expand

Figures and Tables from this paper


Image Inpainting using Multi-Scale Feature Image Translation
This work proposes a learning-based approach to generate visually coherent completion given a high-resolution image with missing components and shows that it not only generates results of comparable or better visual quality, but are orders of magnitude faster than previous state-of-the-art methods. Expand
Contextual-Based Image Inpainting: Infer, Match, and Translate
This work proposes a learning-based approach to generate visually coherent completion given a high-resolution image with missing components and shows that it generates results of better visual quality than previous state-of-the-art methods. Expand
Free-Form Image Inpainting With Gated Convolution
The proposed gated convolution solves the issue of vanilla convolution that treats all input pixels as valid ones, generalizes partial convolution by providing a learnable dynamic feature selection mechanism for each channel at each spatial location across all layers. Expand
Generative Image Inpainting with Contextual Attention
This work proposes a new deep generative model-based approach which can not only synthesize novel image structures but also explicitly utilize surrounding image features as references during network training to make better predictions. Expand
Context Encoders: Feature Learning by Inpainting
It is found that a context encoder learns a representation that captures not just appearance but also the semantics of visual structures, and can be used for semantic inpainting tasks, either stand-alone or as initialization for non-parametric methods. Expand
Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
This paper proposes a Pyramid-context Encoder Network for image inpainting by deep generative models, built upon a U-Net structure with three tailored components, ie. Expand
Shift-Net: Image Inpainting via Deep Feature Rearrangement
A special shift-connection layer to the U-Net architecture, namely Shift-Net, is introduced for filling in missing regions of any shape with sharp structures and fine-detailed textures and an end-to-end learning algorithm is further developed to train the Shift- net. Expand
Image Inpainting via Generative Multi-column Convolutional Neural Networks
A generative multi-column network that synthesizes different image components in a parallel manner within one stage to better characterize global structures while an implicit diversified MRF regularization is adopted to enhance local details. Expand
Colorful Image Colorization
This paper proposes a fully automatic approach to colorization that produces vibrant and realistic colorizations and shows that colorization can be a powerful pretext task for self-supervised feature learning, acting as a cross-channel encoder. Expand
Image Inpainting for Irregular Holes Using Partial Convolutions
This work proposes the use of partial convolutions, where the convolution is masked and renormalized to be conditioned on only valid pixels, and outperforms other methods for irregular masks. Expand