Image-to-Image Translation with Conditional Adversarial Networks
- Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, Alexei A. Efros
- Computer ScienceComputer Vision and Pattern Recognition
- 21 November 2016
Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
- Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Andrew Tao, J. Kautz, Bryan Catanzaro
- Computer ScienceIEEE/CVF Conference on Computer Vision and…
- 30 November 2017
A new method for synthesizing high-resolution photo-realistic images from semantic label maps using conditional generative adversarial networks (conditional GANs) is presented, which significantly outperforms existing methods, advancing both the quality and the resolution of deep image synthesis and editing.
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks
- Jun-Yan Zhu, Taesung Park, Phillip Isola, Alexei A. Efros
- Computer ScienceIEEE International Conference on Computer Vision
- 30 March 2017
This work presents an approach for learning to translate an image from a source domain X to a target domain Y in the absence of paired examples, and introduces a cycle consistency loss to push F(G(X)) ≈ X (and vice versa).
Semantic Image Synthesis With Spatially-Adaptive Normalization
- Taesung Park, Ming-Yu Liu, Ting-Chun Wang, Jun-Yan Zhu
- Computer ScienceComputer Vision and Pattern Recognition
- 18 March 2019
S spatially-adaptive normalization is proposed, a simple but effective layer for synthesizing photorealistic images given an input semantic layout that allows users to easily control the style and content of image synthesis results as well as create multi-modal results.
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
- Judy Hoffman, Eric Tzeng, Trevor Darrell
- Computer ScienceInternational Conference on Machine Learning
- 8 November 2017
A novel discriminatively-trained Cycle-Consistent Adversarial Domain Adaptation model that adapts representations at both the pixel-level and feature-level, enforces cycle-consistency while leveraging a task loss, and does not require aligned pairs is proposed.
Toward Multimodal Image-to-Image Translation
- Jun-Yan Zhu, Richard Zhang, Eli Shechtman
- Computer ScienceNIPS
- 1 November 2017
This work aims to model a distribution of possible outputs in a conditional generative modeling setting that helps prevent a many-to-one mapping from the latent code to the output during training, also known as the problem of mode collapse.
Contrastive Learning for Unpaired Image-to-Image Translation
- Taesung Park, Alexei A. Efros, Richard Zhang, Jun-Yan Zhu
- Computer ScienceEuropean Conference on Computer Vision
- 30 July 2020
The framework enables one-sided translation in the unpaired image-to-image translation setting, while improving quality and reducing training time, and can be extended to the training setting where each "domain" is only a single image.
Video-to-Video Synthesis
- Ting-Chun Wang, Ming-Yu Liu, Bryan Catanzaro
- Computer ScienceNeural Information Processing Systems
- 20 August 2018
This paper proposes a novel video-to-video synthesis approach under the generative adversarial learning framework, capable of synthesizing 2K resolution videos of street scenes up to 30 seconds long, which significantly advances the state-of-the-art of video synthesis.
Generative Visual Manipulation on the Natural Image Manifold
- Jun-Yan Zhu, Philipp Krähenbühl, Eli Shechtman, Alexei A. Efros
- Computer Science, ArtEuropean Conference on Computer Vision
- 12 September 2016
This paper proposes to learn the natural image manifold directly from data using a generative adversarial neural network, and defines a class of image editing operations, and constrain their output to lie on that learned manifold at all times.
Generating Adversarial Examples with Adversarial Networks
- Chaowei Xiao, Bo Li, Jun-Yan Zhu, Warren He, M. Liu, D. Song
- Computer ScienceInternational Joint Conference on Artificial…
- 8 January 2018
Adversarial examples generated by AdvGAN on different target models have high attack success rate under state-of-the-art defenses compared to other attacks, and have placed the first with 92.76% accuracy on a public MNIST black-box attack challenge.
...
...