A Neural Algorithm of Artistic Style

@article{Gatys2015ANA,
  title={A Neural Algorithm of Artistic Style},
  author={Leon A. Gatys and Alexander S. Ecker and Matthias Bethge},
  journal={ArXiv},
  year={2015},
  volume={abs/1508.06576}
}
In fine art, especially painting, humans have mastered the skill to create unique visual experiences through composing a complex interplay between the content and style of an image. [] Key Method The system uses neural representations to separate and recombine content and style of arbitrary images, providing a neural algorithm for the creation of artistic images. Moreover, in light of the striking similarities between performance-optimised artificial neural networks and biological vision, our work offers a…

Figures from this paper

Generating Stylistic Images by Extending Neural Style Transfer Method
TLDR
The concept of using a convolutional neural network (ConvNet or CNN) to individually separate and recombine the style and content of arbitrary images to generate perceptually striking “art” is introduced.
Deep Convolutional Nets Learning Classification for Artistic Style Transfer
TLDR
This paper uses Visual Geometry Group (VGG16) neural network to replicate this dormant task performed by humans, and carries out implementations in feature space representing the higher levels of the content image.
Fast Patch-based Style Transfer of Arbitrary Style
TLDR
A simpler optimization objective based on local matching that combines the content structure and style textures in a single layer of the pretrained network is proposed that has desirable properties such as a simpler optimization landscape, intuitive parameter tuning, and consistent frame-by-frame performance on video.
A temporally coherent neural algorithm for artistic style transfer
TLDR
A new artificial system based on an existing neural style transfer method which creates artistically stylized animations that simultaneously reproduce both the motion of the original videos that they are derived from and the unique style of a given artistic work.
Fashioning with Networks: Neural Style Transfer to Design Clothes
TLDR
The neural style transfer algorithm is applied to fashion so as to synthesize new custom clothes based on a users preference and by learning the users fashion choices from a limited set of clothes from their closet.
Deep Learning for Anime Style Transfer
TLDR
A novel anime style transfer algorithm using deep neural network, which treats foreground and background differently, and could transfer the style for video with a style image and combine optical flow to ensure frame coherence in a video.
Recognizing Art Style Automatically in Painting with Deep Learning
TLDR
The use of deep residual neural is investigated to solve the problem of detecting the artistic style of a painting and outperform existing approaches to reach an accuracy of 62 on the Wikipaintings dataset (for 25 different style).
From Pigments to Pixels: A Comparison of Human and AI Painting
From entertainment to medicine and engineering, artificial intelligence (AI) is now being used in a wide range of fields, yet the extent to which AI can be effectively applied to the creative arts
Projecting emotions from artworks to maps using neural style transfer
TLDR
The results confirmed that emotional descriptions remain the same before and after the procedure of neural style transfer, and artworks with variety of line, point and surface depictions were the most suitable algorithm inputs and achieved better visual results in representing the map content.
Artificial Intelligence Artistic Painting Mirror as Interactive Art Using Deep Neural Networks
This paper reports a summary of the project named “Basic research on interactive art using deep learning to create color expression,” which has been adopted as a private university research branding
...
...

References

SHOWING 1-10 OF 27 REFERENCES
Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks
TLDR
A new parametric texture model based on the powerful feature spaces of convolutional neural networks optimised for object recognition is introduced and it is established that constraining a spatial summary statistic over feature maps suffices to synthesise high-quality natural textures.
Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition
TLDR
These evaluations show that, unlike previous bio-inspired models, the latest DNNs rival the representational performance of IT cortex on this visual object recognition task and propose an extension of “kernel analysis” that measures the generalization accuracy as a function of representational complexity.
Understanding deep image representations by inverting them
Image representations, from SIFT and Bag of Visual Words to Convolutional Neural Networks (CNNs), are a crucial component of almost any image understanding system. Nevertheless, our understanding of
Recognizing Image Style
TLDR
An approach to predicting style of images, and a thorough evaluation of different image features for these tasks, find that features learned in a multi-layer network generally perform best -- even when trained with object class (not style) labels.
Feature Guided Texture Synthesis (FGTS) for artistic style transfer
TLDR
A novel Feature Guided Texture Synthesis (FGTS) algorithm for artistic style transfer is proposed and compared with existing example-based methods, the content of a source image is better defined in FGTS with a feature field generated from the source image.
Deep Gaze I: Boosting Saliency Prediction with Feature Maps Trained on ImageNet
TLDR
This work presents a novel way of reusing existing neural networks that have been pretrained on the task of object recognition in models of fixation prediction that significantly outperforms all state-of-the-art models on the MIT Saliency Benchmark.
Image analogies
TLDR
This paper describes a new framework for processing images by example, called “image analogies,” based on a simple multi-scale autoregression, inspired primarily by recent results in texture synthesis.
Image quilting for texture synthesis and transfer
TLDR
This work uses quilting as a fast and very simple texture synthesis algorithm which produces surprisingly good results for a wide range of textures and extends the algorithm to perform texture transfer — rendering an object with a texture taken from a different object.
State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video
TLDR
This paper presents a taxonomy of the 2D NPR algorithms developed over the past two decades, structured according to the design characteristics and behavior of each technique, and describes a chronology of development from the semiautomatic paint systems of the early nineties, through to the automated painterly rendering system of the late nineties driven by image gradient analysis.
Very Deep Convolutional Networks for Large-Scale Image Recognition
TLDR
This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
...
...