Expressive autonomous cinematography for interactive virtual environments

@inproceedings{Tomlinson2000ExpressiveAC,
  title={Expressive autonomous cinematography for interactive virtual environments},
  author={Bill Tomlinson and Bruce Blumberg and Delphine Nain},
  booktitle={AGENTS '00},
  year={2000}
}
We have created an automatic cinematography system for interactive virtual environments. This system controls a virtual camera and fights in a three-dimensional virtual world inhabited by a group of autonomous and user-controlled characters. By dynamically changing the camera and the fights, our system facilitates the interaction of human participants with this world and displays the emotional content of the digital scene. Building on the tradition of cinema, modern video games and autonomous… 

Interactive Virtual Cinematography

A new approach to automatic camera control that indirectly includes the player in the camera control loop is proposed and a new optimization algorithm and camera control architecture able to generate real-time, smooth and well composed camera animations is introduced.

A Cinematography System for Virtual Storytelling

A complete framework to automatically generate ”cinematographic view” of dynamic scenes in real-time to provide a succession of shots and sequences that can be related to pure cinema.

A Discourse Planning Approach to Cinematic Camera Control for Narratives in Virtual Environments

A camera planning system that mirrors the film production pipeline is proposed; the formalization of film idioms used to communicate affective information is described, which captures their hierarchical nature, represents the causal motivation for selection of shots, and provides a way for the system designer to specify the ranking of candidate shot sequences.

An Autonomous Real-Time Camera Agent for Interactive Narratives and Games

An autonomous real-time camera agent was developed implementing cinematographic knowledge with respect to dramaturgical means of expressions of cameras to the domain of interactive narratives with the goal of incorporating the camera as an active part into the storytelling process.

A Cinematographic Approach in Interactive Storytelling

A set of tools that can provide cinematic capabilities to a storytelling scenario, where virtual actors generate a story and where a strong narrative is needed, in order to maintain the appeal and the coherence of any given story virtually shown and generated is defined.

A Hybrid System for Interactive 3D Camera and Lighting Control

With the accelerating convergence of cinema and computer games, the importance of the sequence of placements of virtual camera and lights has increased with the growing dramatic expressiveness and

Toward a Narrative Comprehension Model of Cinematic Generation for 3D Virtual Environments

  • B. Cassell
  • Computer Science
    Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment
  • 2021
In this paper a system is proposed which can reason directly about the high-level cognitive and narrative effects of a shot sequence on the viewer’s mental state.

Camera Control through Cinematography for Virtual Environments : A State of the Art Report

This paper looks at what has already been implemented in the domain of camera control through cinematography for virtual environments and outlines the future work.

Neuronal editor agent for scene cutting in game cinematography

This article demonstrates an intelligent editor agent that uses neuronal network classifiers to decide shot transition and has an intuitive user interface to the learning mechanism.

ACT: An Autonomous Drone Cinematography System for Action Scenes

Experimental results in both simulation and real-world scenarios demonstrate that the Autonomous CinemaTography system “ACT” can capture more expressive video footage of human action than that of a state-of-the-art drone camera system.
...

References

SHOWING 1-10 OF 24 REFERENCES

The virtual cinematographer: a paradigm for automatic real-time camera control and directing

Some basic heuristics of filmmaking are discussed and shown how these ideas are encoded in the Virtual Cinematographer, a paradigm for automatically generating complete camera specifications for capturing events in virtual 3D environments in real-time.

Declarative Camera Control for Automatic Cinematography

It is argued that OCCL represents cinematic knowledge at the same level of abstraction as expert directors by encoding 16 idioms from a film textbook by encoding them in a declarative language, called Declarative Camera Control Language (OCCL).

Improv: a system for scripting interactive actors in virtual worlds

The combined system provides an integrated set of tools for authoring the "minds" and "bodies" of interactive actors, using an english−style scripting language so that creative experts who are not primarily programmers can create powerful interactive applications.

Narrative guidance of interactivity

By introducing techniques while allowing the viewer to influence the presentation, a new method and vocabulary for storytelling has been created that allows the presentation to be manipulated while the plot assures that story will find the viewer regardless of his/her actions.

Cinematic primitives for multimedia

The development of robust frameworks in interactive multimedia for representing story elements to the machine so that they can be retrieved in multiple contexts is addressed and it is proposed that content can be represented in layers.

Behavior-friendly graphics

The system described in this paper was the underlying support for "Swamped!", an interactive 3D cartoon demonstrated in the Enhanced Realities section of SIGGRAPH 98 and allowed us to achieve real-time performance in this Java application.

Realtime Generation of Customized 3D Animated Explanations for Knowledge-Based Learning Environments

In this framework, an explanation system selects 3D models and their relevant behaviors, creates camera shots that most clearly depict complex phenomena, constructs a tern poral organization that synchronizes narrative utterances with visual elements, and incorporates specialized visual effects to focus students' attention on the most salient concepts.

The Art and Science of Synthetic Character Design

The goal of the approach is to construct intentional characters that are both compelling, in the sense that people can empathize with them, and understandable, in that their actions can be seen as attempts to satisfy their desires given their beliefs.

Sympathetic interfaces: using a plush toy to direct synthetic characters

We introduce the concept of a sympathetic inter$ace forcontrolling an animated synthetic character in a 3D virtualenvironment. A plush doll embedded with wireless sensors is used tomanipulate the

CamDroid: a system for implementing intelligent camera control

Through this encapsulation, camera modules can be programmed and sequenced, and thus can be used as the underlying framework for controlling the virtual camera in the widely disparate types of graphical environments.