Corpus ID: 19163859

The Shape of Art History in the Eyes of the Machine

@inproceedings{Elgammal2018TheSO,
  title={The Shape of Art History in the Eyes of the Machine},
  author={A. Elgammal and Marian Mazzone and Bingchen Liu and Diana Kim and Mohamed Elhoseiny},
  booktitle={AAAI},
  year={2018}
}
How does the machine classify styles in art. [...] Key Method We conducted a comprehensive study of several of the state-of-the-art convolutional neural networks applied to the task of style classification on 77K images of paintings, and analyzed the learned representation through correlation analysis with concepts derived from art history. Surprisingly, the networks could place the works of art in a smooth temporal arrangement mainly based on learning style labels, without any a priori knowledge of time of…Expand
Machine: The New Art Connoisseur
TLDR
This study uses several state-of-the-art CNN architectures to explore how a machine may help perceive and quantify art styles and conducts network analysis on the influences among styles and artists to help identify some previously unknown linkages. Expand
Toward the Automatic Retrieval and Annotation of Outsider Art images: A Preliminary Statement
TLDR
The preliminary experiments have provided motivation to think that, as is the case with traditional styles, Outsider Art can be computationally modelled with objective means by using training datasets and CNN models. Expand
Learning the Principles of Art History with convolutional neural networks
TLDR
The outcome of the analysis suggests that the models learn to discriminate meaningful features that correspond to the visual characteristics of concepts described by Wolfflin, indicating that the presented approach can be used to enable new ways of exploring fine art collections based on image features relevant and well-known within art history. Expand
Computational Analysis of Content in Fine Art Paintings
TLDR
A deep learning algorithm that can detect content and discover co-occurring patterns of the content in fine art paintings and is automatically trained to discover the connective patterns reflecting artists’ creativity, which are latent in the large dataset of paintings. Expand
Compare the performance of the models in art classification
TLDR
This study tested 7 different models on 3 different datasets under the same experimental setup to compare their art classification performances when either using or not using transfer learning, and achieved state-of-the-art performance in all classification tasks with three datasets. Expand
Classification of Style in Fine-Art Paintings Using Transfer Learning and Weighted Image Patches
TLDR
A new efficient method is described that improves the classification accuracy of fine-art paintings compared to the existing baseline methods based on transfer learning and classification of sub-regions or patches of the painting. Expand
A Deep Learning Perspective on Beauty, Sentiment, and Remembrance of Art
TLDR
The presented approach enables new ways of exploring fine art collections based on highly subjective aspects of art, as well as represents one step forward toward bridging the gap between traditional formal analysis and the computational analysis of fine art. Expand
Learning Portrait Style Representations
TLDR
This work aligns the impact of expert human knowledge, statistical, and photo realism priors on style representations with art historical research and uses these representations to perform zero-shot classification of artists. Expand
Recognizing the Style of Visual Arts via Adaptive Cross-layer Correlation
TLDR
This work presents an end-to-end trainable architecture that can adaptively weight features in different spatial locations based on their intrinsic similarity and demonstrates the superiority of the proposed method over several state-of-the-art methods. Expand
Automatic Matching of Paintings and Descriptions in Art-Historic Archives using Multimodal Analysis
TLDR
This work uses machine learning to generate text descriptions for the extracted images, and to detect descriptive phrases and titles of images from the text on the other hand, and uses embeddings to align both, the descriptions and the images. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 22 REFERENCES
Toward automated discovery of artistic influence
TLDR
A comparative study of different classification methodologies for the task of fine-art style classification and a visualization of artists based on the similarity between their works, as well as investigating the question “Who influenced this artist?” by looking at his masterpieces and comparing them to others. Expand
Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Feature
TLDR
A machine is developed that is able to make aesthetic-related semantic-level judgments, such as predicting a painting's style, genre, and artist, as well as providing similarity measures optimized based on the knowledge available in the domain of art historical interpretation. Expand
Recognizing Image Style
TLDR
An approach to predicting style of images, and a thorough evaluation of different image features for these tasks, find that features learned in a multi-layer network generally perform best -- even when trained with object class (not style) labels. Expand
Impressionism, expressionism, surrealism: Automated recognition of painters and schools of art
TLDR
A method for automated recognition of painters and schools of art based on their signature styles is described and its ability to automatically associate different artists that share the same school of art in an unsupervised fashion is described. Expand
Data Science and Digital Art History
I present a number of core concepts from data science that are relevant to digital art history and the use of quantitative methods to study any cultural artifacts or processes in general. TheseExpand
Deep Residual Learning for Image Recognition
TLDR
This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth. Expand
Very Deep Convolutional Networks for Large-Scale Image Recognition
TLDR
This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers. Expand
ImageNet classification with deep convolutional neural networks
TLDR
A large, deep convolutional neural network was trained to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes and employed a recently developed regularization method called "dropout" that proved to be very effective. Expand
ImageNet Large Scale Visual Recognition Challenge
TLDR
The creation of this benchmark dataset and the advances in object recognition that have been possible as a result are described, and the state-of-the-art computer vision accuracy with human accuracy is compared. Expand
Nonlinear dimensionality reduction by locally linear embedding.
TLDR
Locally linear embedding (LLE) is introduced, an unsupervised learning algorithm that computes low-dimensional, neighborhood-preserving embeddings of high-dimensional inputs that learns the global structure of nonlinear manifolds. Expand
...
1
2
3
...