Image and Video-Based Artistic Stylisation

@article{Rosin2013ImageAV,
  title={Image and Video-Based Artistic Stylisation},
  author={Paul L. Rosin and John P. Collomosse},
  journal={Computational Imaging and Vision},
  year={2013}
}
Non-photorealistic rendering (NPR) is a combination of computer graphics and computer vision that produces renderings in various artistic, expressive or stylized ways such as painting and drawing. This book focuses on image and video based NPR, where the input is a 2D photograph or a video rather than a 3D model. 2D NPR techniques have application in areas as diverse as consumer and professional digital photography and visual effects for TV and film production. The book covers the full range of… 
Image-Based Rendering for Ink Painting
TLDR
A new IBR framework for ink painting is proposed, which could effectively simulate ink diffusion in absorbent paper, and produce various types of black or color ink painting effects.
Video motion stylization by 2D rigidification
TLDR
This paper introduces a video stylization method that increases the apparent rigidity of motion by applying motion segmentation and optimization to best approximate the input optical flow with piecewise-rigid transforms, and re-renders the video such that its content follows the simplified motion.
Line‐Drawing Video Stylization
We present a method to automatically convert videos and CG animations to stylized animated line drawings. Using a data‐driven approach, the animated drawings can follow the sketching style of a
Interactive multi-style pen-and-ink drawings from images
TLDR
This paper introduces an interactive multi-style rendering system in which an image can be stylized with stippling, hatching, and scumbling, and develops novel techniques that allow the user to design any scumbling pattern beyond circles (circulism).
Becasso: artistic image processing and editing on mobile devices
TLDR
The BeCasso app provides tools for both higher-level interaction and low-level control to serve the different needs of non-experts and digital artists.
Portrait drawing from corresponding range and intensity images
TLDR
A real-time rendering system for automatically creating a caricature drawing of a human face based on simultaneous use of a range image and a registered photograph of the same face, giving a pleasing result which preserves not only the shape cues of the geometric description, but also other essential visual characteristics of the facial image that cannot be deduced from geometry alone.
Non-photorealistic rendering of portraits
We describe an image-based non-photorealistic rendering pipeline for creating portraits in two styles: The first is a somewhat "puppet" like rendering, that treats the face like a relatively uniform
An adaptive cartoon-like stylization for color video in real time
TLDR
This video cartoonization framework consists of color space conversion, bilateral filtering, color quantization and edge detection, which uses an adaptive difference of Gaussians filter to detect the edges.
Image Preprocessing for Artistic Robotic Painting
TLDR
An algorithm for aerial perspective amplification based on principles of light scattering using a depth map, an algorithm for gamut compression using nonlinear hue transformation and an algorithms for image gradient filtering for obtaining a well-coherent brushstroke map with a reduced number of brushstrokes, required for practical robotic painting are proposed.
...
...

References

SHOWING 1-10 OF 432 REFERENCES
Viewing progress in non-photorealistic rendering through Heinlein's lens
TLDR
A high level overview of the past and current state of non-photorealistic rendering is provided and a call to arms the community to create the areas of research that make computation ofnon-photorean rendering generate never before realized results.
Non-photorealistic rendering
TLDR
This book provides an overview of the published research on non-photorealistic rendering in order to categorize and distill the current research into a body of usable techniques.
Painterly rendering for video and interaction
TLDR
An interactive painting exhibit is constructed, in which a painting is continually updated and found to be a compelling experience, suggesting the promise of non-photorealistic rendering for creating compelling interactive visual experiences.
Artistic Vision: painterly rendering using computer vision techniques
TLDR
A method that takes a raster image as input and produces a painting-like image composed of strokes rather than pixels, reminiscent of those contemporary representational painters whose work has an abstract or sketchy quality is presented.
Interactive painterly stylization of images, videos and 3D animations
TLDR
A real-time system that converts images, video, or 3D animation sequences to artistic renderings in various painterly styles while allowing the user interactive control over many stylistic parameters such as stroke size, texture and density is introduced.
Non-photorealistic rendering in context: an observational study
TLDR
An observational study with three groups of users to examine their understanding and assessment of hand-drawn pen-and-ink illustrations of objects in comparison with NPR renditions of the same 3D objects shows that people perceive differences between those two types of illustration but that those that look computer-generated are still highly valued as scientific illustrations.
Video Painting with Space-Time-Varying Style Parameters
TLDR
A video painting system that accounts for the spatial support of objects in the images or videos, and uses this information to specify style parameters and stroke orientation for painterly rendering, characterized by style parameters that coherently vary in space and time.
Towards artistic minimal rendering
TLDR
This method uses a combination of refined lines and blocks, as well as a small number of tones, to produce abstracted artistic rendering with sufficient elements from the original image to judge the level of abstraction.
Cubist Style Rendering from Photographs
TLDR
This paper describes a novel nonphotorealistic rendering technique, influenced by the style of Cubist art, and uses salient features identified within the image set, such as eyes, noses, and mouths, as compositional elements to produce a Cubist style painting with minimal user interaction.
Painterly rendering using image salience
TLDR
A novel non-photorealistic rendering technique, capable of producing an artificial 'hand-painted' effect on 2D images, such as photographs, that requires no user interaction, and makes use of image salience and gradient information to determine the implicit ordering and attributes of individual brush strokes.
...
...