PixelNN: Example-based Image Synthesis

@article{Bansal2017PixelNNEI,
  title={PixelNN: Example-based Image Synthesis},
  author={Aayush Bansal and Yaser Sheikh and Deva Ramanan},
  journal={CoRR},
  year={2017},
  volume={abs/1708.05349}
}
We present a simple nearest-neighbor (NN) approach that synthesizes high-frequency photorealistic images from an ”incomplete” signal such as a low-resolution image, a surface normal map, or edges. Current state-of-the-art deep generative models designed for such conditional image synthesis lack two important things: (1) they are unable to generate a large set of diverse outputs, due to the mode collapse problem. (2) they are not interpretable, making it difficult to control the synthesized… CONTINUE READING