ChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution

@article{Vitoria2020ChromaGANAP,
  title={ChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution},
  author={Patricia Vitoria and Lara Raad and Coloma Ballester},
  journal={2020 IEEE Winter Conference on Applications of Computer Vision (WACV)},
  year={2020},
  pages={2434-2443}
}
The colorization of grayscale images is an ill-posed problem, with multiple correct solutions. In this paper, we propose an adversarial learning colorization approach coupled with semantic information. A generative network is used to infer the chromaticity of a given grayscale image conditioned to semantic clues. This network is framed in an adversarial model that learns to colorize by incorporating perceptual and semantic understanding of color and class distributions. The model is trained via… 

Figures and Tables from this paper

Towards Vivid and Diverse Image Colorization with Generative Color Prior
TLDR
This work aims at recovering vivid colors by leveraging the rich and diverse color priors encapsulated in a pretrained Generative Adversarial Networks (GAN) via a GAN encoder and incorporating these features into the colorization process with feature modulations.
Joint Intensity-Gradient Guided Generative Modeling for Colorization
TLDR
The joint intensity-gradient constraint in data-fidelity term is proposed to limit the degree of freedom within generative model at the iterative colorization stage, and it is conducive to edge-preserving.
Conditional Generative Modeling via Learning the Latent Space
TLDR
This work proposes a novel general-purpose framework for conditional generation in multimodal spaces, that uses latent variables to model generalizable learning patterns while minimizing a family of regression cost functions.
Wavelet Transform-assisted Adaptive Generative Modeling for Colorization
TLDR
A novel scheme that exploiting the score-based generative model in wavelet domain to address the issue of colorization robustness and diversity by taking advantage of the multi-scale and multi-channel representation via wavelet transform.
Image Colorization: A Survey and Dataset
TLDR
This article presents a comprehensive survey of recent state-of-the-art colorization using deep learning algorithms, describing their fundamental block architectures in terms of skip connections, input etc as well as optimizers, loss functions, training protocols, and training data etc.
VCGAN: Video Colorization with Hybrid Generative Adversarial Network
TLDR
Experimental results demonstrate that VCGAN produces higherquality and temporally more consistent colorful videos than existing approaches and proposes a dense long-term loss that smooths the temporal disparity of every two remote frames.
Collaborative Image and Object Level Features for Image Colourisation
TLDR
This work proposes a single network, named UCapsNet, that takes into consideration the image-level features obtained through convolutions and entity- level features captured by means of capsules, and enforce collaboration between such the convolutional and entity factors to produce a high-quality and plausible image colourisation.
SCGAN: Saliency Map-Guided Colorization With Generative Adversarial Network
TLDR
Experimental results show that SCGAN can generate more reasonable colorized images than state-of-the-art techniques and proposes a novel saliency map-based guidance method.
Progressive Colorization via Iterative Generative Models
TLDR
A novel progressive automatic colorization via iterative generative models (iGM) that can produce satisfactory colorization in an unsupervised manner in multi-color spaces jointly and enforced with linearly autocorrelative constraint is developed.
Analysis of Different Losses for Deep Learning Image Colorization
TLDR
This chapter analyzes the impact of the loss function on the estimated colorization results by reviewing the losses and evaluation metrics used in the literature and results show that the models trained with VGG-based LPIPS provide overall slightly better results for most evaluation metrics.
...
1
2
3
4
...

References

SHOWING 1-10 OF 54 REFERENCES
Image-to-Image Translation with Conditional Adversarial Networks
TLDR
Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Generative Adversarial Nets
We propose a new framework for estimating generative models via an adversarial process, in which we simultaneously train two models: a generative model G that captures the data distribution, and a
ImageNet: A large-scale hierarchical image database
TLDR
A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.
Wasserstein GAN
TLDR
The problem this paper is concerned with is that of unsupervised learning, what does it mean to learn a probability distribution and how to define a parametric family of densities.
Wasserstein Generative Adversarial Networks
TLDR
This work introduces a new algorithm named WGAN, an alternative to traditional GAN training that can improve the stability of learning, get rid of problems like mode collapse, and provide meaningful learning curves useful for debugging and hyperparameter searches.
Colorful Image Colorization
TLDR
This paper proposes a fully automatic approach to colorization that produces vibrant and realistic colorizations and shows that colorization can be a powerful pretext task for self-supervised feature learning, acting as a cross-channel encoder.
Learning Representations for Automatic Colorization
TLDR
A fully automatic image colorization system that leverages recent advances in deep networks, exploiting both low-level and semantic representations, and explores colorization as a vehicle for self-supervised visual representation learning.
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification
TLDR
A novel technique to automatically colorize grayscale images that combines both global priors and local image features and can process images of any resolution, unlike most existing approaches based on CNN.
Very Deep Convolutional Networks for Large-Scale Image Recognition
TLDR
This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
A Style-Based Generator Architecture for Generative Adversarial Networks
TLDR
An alternative generator architecture for generative adversarial networks is proposed, borrowing from style transfer literature, that improves the state-of-the-art in terms of traditional distribution quality metrics, leads to demonstrably better interpolation properties, and also better disentangles the latent factors of variation.
...
1
2
3
4
5
...