Colorful Image Colorization

Abstract

Given a grayscale photograph as input, this paper attacks the problem of hallucinating a plausible color version of the photograph. This problem is clearly underconstrained, so previous approaches have either relied on significant user interaction or resulted in desaturated col-orizations. We propose a fully automatic approach that produces vibrant and realistic colorizations. We embrace the underlying uncertainty of the problem by posing it as a classification task and use class-rebalancing at training time to increase the diversity of colors in the result. The system is implemented as a feed-forward pass in a CNN at test time and is trained on over a million color images. We evaluate our algorithm using a " colorization Turing test, " asking human participants to choose between a generated and ground truth color image. Our method successfully fools humans on 32% of the trials, significantly higher than previous methods. Moreover, we show that colorization can be a powerful pretext task for self-supervised feature learning, acting as a cross-channel encoder. This approach results in state-of-the-art performance on several feature learning benchmarks.

DOI: 10.1007/978-3-319-46487-9_40

Extracted Key Phrases

8 Figures and Tables

Showing 1-10 of 42 references

Automatic colorization

  • R Dahl
  • 2016
Showing 1-10 of 78 extracted citations
05010015020162017
Citations per Year

105 Citations

Semantic Scholar estimates that this publication has received between 80 and 145 citations based on the available data.

See our FAQ for additional information.