• Corpus ID: 227169530

NICER: Aesthetic Image Enhancement with Humans in the Loop

  title={NICER: Aesthetic Image Enhancement with Humans in the Loop},
  author={Michael Fischer and Konstantin Kobs and Andreas Hotho},
Fully- or semi-automatic image enhancement software helps users to increase the visual appeal of photos and does not require in-depth knowledge of manual image editing. However, fully-automatic approaches usually enhance the image in a black-box manner that does not give the user any control over the optimization process, possibly leading to edited images that do not subjectively appeal to the user. Semi-automatic methods mostly allow for controlling which pre-defined editing step is taken… 

Figures and Tables from this paper

Self-Supervised Multi-Task Pretraining Improves Image Aesthetic Assessment

This work proposes to use self-supervised aesthetic-aware pretext tasks that let the network learn aesthetically relevant features, based on the observation that distorting aesthetic images with image filters usually reduces their appeal.

CLIP knows image aesthetics

Comparing the usefulness of features extracted by CLIP compared to features obtained from the last layer of a comparable ImageNet classification model suggests that CLIP is better suited as a base model for IAA methods than ImageNet pretrained networks.

Scale aware remote sensing image enhancement using rolling guidance

A Survey of Human-in-the-loop for Machine Learning



Automatic Photo Adjustment Using Deep Neural Networks

This article forms automatic photo adjustment in a manner suitable for deep neural networks, and introduces an image descriptor accounting for the local semantics of an image that can model local adjustments that depend on image semantics.

Personalization of image enhancement

The experimental evaluation based on user studies indicates that different users do have different preferences in image enhancement, which suggests that personalization can further help improve the subjective quality of generic image enhancements.

Collaborative Personalization of Image Enhancement

Methods for personalization of image enhancement are presented, which could be deployed in photo editing software and also in cloud-based image sharing services, and can suggest image enhancements more targeted to individual users than commercial tools with global auto-enhancement functionalities.

Learned perceptual image enhancement

This paper shows that adding a learned no-reference image quality metric to the loss can significantly improve enhancement operators and can be effective for tuning a variety of operators such as local tone mapping and dehazing.

Exposure: A White-Box Photo Post-Processing Framework

This paper presents a deep learning approach that is instead trained on unpaired data, namely a set of photographs that exhibits a retouching style the user likes, which is much easier to collect.

Image quality assessment: from error visibility to structural similarity

A structural similarity index is developed and its promise is demonstrated through a set of intuitive examples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000.

NIMA: Neural Image Assessment

The proposed approach relies on the success (and retraining) of proven, state-of-the-art deep object recognition networks and can be used to not only score images reliably and with high correlation to human perception, but also to assist with adaptation and optimization of photo editing/enhancement algorithms in a photographic pipeline.

An empirical evaluation of convolutional neural networks for image enhancement

This work empirically evaluate common architectures and loss functions employed for automatic image enhancement, and proposes an effective architecture-agnostic method for integrating additional contextual information into the enhancement process.

Fast Local Laplacian Filters

This article shows that local Laplacian filters are closely related to anisotropic diffusion and to bilateral filtering, and leads to a variant of the bilateral filter that produces cleaner edges while retaining its speed.

AVA: A large-scale database for aesthetic visual analysis

A new large-scale database for conducting Aesthetic Visual Analysis: AVA, which contains over 250,000 images along with a rich variety of meta-data including a large number of aesthetic scores for each image, semantic labels for over 60 categories as well as labels related to photographic style is introduced.