Corpus ID: 11758569

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks

@article{Radford2016UnsupervisedRL,
  title={Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks},
  author={Alec Radford and Luke Metz and Soumith Chintala},
  journal={CoRR},
  year={2016},
  volume={abs/1511.06434}
}
In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge the gap between the success of CNNs for supervised learning and unsupervised learning. We introduce a class of CNNs called deep convolutional generative adversarial networks (DCGANs), that have certain architectural constraints, and demonstrate that they are… Expand
Unsupervised Deep Learning by Neighbourhood Discovery
TLDR
This work introduces a generic unsupervised deep learning approach to training deep models without the need for any manual label supervision and progressively discover sample anchored/centred neighbourhoods to reason and learn the underlying class decision boundaries iteratively and accumulatively. Expand
Learning Deep Representations Using Convolutional Auto-Encoders with Symmetric Skip Connections
TLDR
A simple yet powerful CNN based denoising auto-encoder network which can be trained end-to-end in an unsupervised manner which can not only reconstruct clean images from corrupted ones, but also learn abstract image representation through the reconstruction training. Expand
Unsupervised feature learning-based encoder and adversarial networks
In this paper, we propose a novel deep learning-based feature learning architecture for object classification. Conventionally, deep learning methods are trained with supervised learning for objectExpand
Unsupervised Deep Learning via Affinity Diffusion
TLDR
A general-purpose unsupervised deep learning approach to deriving discriminative feature representations based on self-discovering semantically consistent groups of unlabelled training samples with the same class concepts through a progressive affinity diffusion process is introduced. Expand
Generating Videos Based on Convolutional Recurrent Generative Adversarial Networks
TLDR
This paper uses a method that combines convolutional neural networks (CNN), which are used to deal with spatio relationships of videos, with Long Short Term Memory (LSTM), which is a variant of recurrent neural networks and used to deals with temporal relationships of Videos to generate videos. Expand
Building an automatic sprite generator with deep convolutional generative adversarial networks
TLDR
Evidence is provided that CNNs can generate unique sprites from the input data that was provided as input, even with small input datasets. Expand
Semi-supervised Learning for Convolutional Neural Networks Using Mild Supervisory Signals
TLDR
The results showed that learning using non-labeled data dramatically improves the efficiency of supervised learning. Expand
Weakly Supervised Object Discovery by Generative Adversarial & Ranking Networks
TLDR
This work approaches GANs with a novel training method and learning objective, to discover multiple object instances for three cases: 1) synthesizing a picture of a specific object within a cluttered scene; 2) localizing different categories in images for weakly supervised object detection; and 3) improving object discovery in object detection pipelines. Expand
Saliency detection by conditional generative adversarial network
  • Xiaoxu Cai, Hui Yu
  • Computer Science, Engineering
  • International Conference on Graphic and Image Processing
  • 2018
TLDR
This paper proposes a new method to detect salient objects by using Conditional Generative Adversarial Network (GAN), which not only learns the mapping from RGB images to salient regions, but also learns a loss function for training the mapping. Expand
Deep Feature Similarity for Generative Adversarial Networks
TLDR
This work proposes a new way to train generative adversarial networks (GANs) based on pretrained deep convolutional neural network (CNN), and enforce the deep feature similarity of the generated and real images to stabilize the training and generate more natural visual images. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 59 REFERENCES
Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks
TLDR
While features learned with this approach cannot compete with class specific features from supervised training on a classification task, it is shown that they are advantageous on geometric matching problems, where they also outperform the SIFT descriptor. Expand
Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
TLDR
A generative parametric model capable of producing high quality samples of natural images using a cascade of convolutional networks within a Laplacian pyramid framework to generate images in a coarse-to-fine fashion. Expand
Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations
TLDR
The convolutional deep belief network is presented, a hierarchical generative model which scales to realistic image sizes and is translation-invariant and supports efficient bottom-up and top-down probabilistic inference. Expand
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
TLDR
This work designs a method to reuse layers trained on the ImageNet dataset to compute mid-level image representation for images in the PASCAL VOC dataset, and shows that despite differences in image statistics and tasks in the two datasets, the transferred representation leads to significantly improved results for object and action classification. Expand
Striving for Simplicity: The All Convolutional Net
TLDR
It is found that max-pooling can simply be replaced by a convolutional layer with increased stride without loss in accuracy on several image recognition benchmarks. Expand
Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion
TLDR
This work clearly establishes the value of using a denoising criterion as a tractable unsupervised objective to guide the learning of useful higher level representations. Expand
Improved Techniques for Training GANs
TLDR
This work focuses on two applications of GANs: semi-supervised learning, and the generation of images that humans find visually realistic, and presents ImageNet samples with unprecedented resolution and shows that the methods enable the model to learn recognizable features of ImageNet classes. Expand
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
TLDR
This work proposes to amplify human effort through a partially automated labeling scheme, leveraging deep learning with humans in the loop, and constructs a new image dataset, LSUN, which contains around one million labeled images for each of 10 scene categories and 20 object categories. Expand
Selecting Receptive Fields in Deep Networks
TLDR
This paper proposes a fast method to choose local receptive fields that group together those low-level features that are most similar to each other according to a pairwise similarity metric, and produces results showing how this method allows even simple unsupervised training algorithms to train successful multi-layered networks that achieve state-of-the-art results on CIFAR and STL datasets. Expand
Generative Adversarial Nets
We propose a new framework for estimating generative models via an adversarial process, in which we simultaneously train two models: a generative model G that captures the data distribution, and aExpand
...
1
2
3
4
5
...