The director's lens: an intelligent assistant for virtual cinematography

  title={The director's lens: an intelligent assistant for virtual cinematography},
  author={Christophe Lino and Marc Christie and Roberto Ranon and William H. Bares},
  journal={Proceedings of the 19th ACM international conference on Multimedia},
We present the Director's Lens, an intelligent interactive assistant for crafting virtual cinematography using a motion-tracked hand-held device that can be aimed like a real camera. The system employs an intelligent cinematography engine that can compute, at the request of the filmmaker, a set of suitable camera placements for starting a shot. These suggestions represent semantically and cinematically distinct choices for visualizing the current narrative. In computing suggestions, the system… 

Figures from this paper

VR as a Content Creation Tool for Movie Previsualisation

A VR authoring system which provides intuitive ways of crafting visual sequences, both for expert animators and expert creatives in the animation and film industry, and is complimentary to existing tools, and provides a seamless back-and-forth process between all stages of previsualisation.

Film Ties: An Architecture for Collaborative Data-driven Cinematography

This work introduces Film Ties, a new form of visual communication in which a first artist creates a virtual camera composition whose visual composition properties are stored into a database allowing other artists to adopt that composition for use in their own different virtual scenes.

Design and evaluation of multiple role-playing in a virtual film set

A virtual environment for film shooting is designed, allowing a user to play multiple roles in a virtual film set and emulating the process of the filmmaking, aiming to help novices learn cinematographic concepts, track the progress of filmmaking, and create a personalized movie.

Camera-on-rails: automated computation of constrained camera paths

This paper proposes a method for generating virtual camera rails and computing smooth camera motions on these rails that analyzes characters motion and user-defined framing properties to compute rough camera motions which are further refined using constrained-optimization techniques.

You've Got the Moves, We've Got the Motion - Understanding and Designing for Cinematographic Camera Motion Control

A prototyping platform for sliding camera moves composed of affordable hardware and open source software, and it supports the wireless connection of various types of user interfaces via Bluetooth, which allows the exploration of different interface and control strategies in-the-wild.

DirectorNotation: Artistic and technological system for professional film directing

This article introduces DN, argues its great cultural significance, provides market research results showing directors' interest in using it, and reports on two controlled experiments confirming its effectiveness—including its usability in a practical context and its ability to represent and communicate the necessary information.

A Virtual Director Using Hidden Markov Models

This paper proposes a model for automated cinematography that can compute significant variations in terms of cinematographic style, with the ability to control the duration of shots and the possibility to add specific constraints to the desired sequence.

Immersive previz: VR authoring for film previsualisation

One Man Movie is presented, a VR authoring system which enables the crafting of filmic sequences with no prior knowledge in 3D animation, enabling a fully novel and seamless back-and-forth between all stages of the process thanks to real-time engines.

Techniques for Improving Mobile Video Creation

This thesis explores methods to assist non-professional users with video creation on mobile devices and presents three kinds of assistance systems which help the user avoiding mistakes commonly made by amateur users and follow cinematographic guidelines during recording.

Intelligent Film Assistant for Personalized Video Creation on Mobile Devices

An intelligent film assistant system that supports the creation of professional video content on mobile devices such as smart phones by amateur users and the incorporation of human-centered design principles with usability studies and expert interviews is described.



The virtual cinematographer: a paradigm for automatic real-time camera control and directing

Some basic heuristics of filmmaking are discussed and shown how these ideas are encoded in the Virtual Cinematographer, a paradigm for automatically generating complete camera specifications for capturing events in virtual 3D environments in real-time.

A Cinematography System for Virtual Storytelling

A complete framework to automatically generate ”cinematographic view” of dynamic scenes in real-time to provide a succession of shots and sequences that can be related to pure cinema.

Real-time cinematic camera control for interactive narratives

This paper proposes a hybrid system that uses abstractly defined cinematographic idioms as constraints to choose the best camera placement for any shot at any moment within any geometry.

Virtual 3D camera composition from frame constraints

We have designed a graphical interface that enables 3D visual artists or developers of interactive 3D virtual environments to efficiently define sophisticated camera compositions by creating

Exploration and virtual camera control in virtual three dimensional environments

This paper evaluates three distinct metaphors for exploration and virtual camera control in virtual environments using a six degree of freedom input device that has the capability to record the motion path followed during an exploration session and can be recorded and played back to create a movie.

Longboard: A Sketch Based Intelligent Storyboarding Tool for Creating Machinima

Longboard is an intelligent storyboarding tool that provides content authors access to 3D graphical environments through an intuitive sketch based interface that provides authoring scenarios and sketching 2D storyboard frames that are rendered in 3D on a game engine.

Neuronal editor agent for scene cutting in game cinematography

This article demonstrates an intelligent editor agent that uses neuronal network classifiers to decide shot transition and has an intuitive user interface to the learning mechanism.

A Lightweight Intelligent Virtual Cinematography System for Machinima Production

A lightweight artificial intelligence system, Cambot, is introduced that can be used to assist in machinima production and takes a script as input and produces a cinematic visualization.

Virtual cinematography of group scenes using hierarchical lines of actions

This work presents a method for defining hierarchical lines of action and the identification and use of relevant first principles of cinematography for using these lines of actions in 3D computer graphics cinematic sequences.

Cinematic discourse generation

An end-to-end camera planning system - Darshak - that constructs visual narrative discourse of a given story in a 3D virtual environment that uses a hierarchical partial order causal link planning algorithm to generate narrative plans that contain both story and camera actions.