Autonomous drone cinematographer: Using artistic principles to create smooth, safe, occlusion-free trajectories for aerial filming

@inproceedings{Bonatti2018AutonomousDC,
  title={Autonomous drone cinematographer: Using artistic principles to create smooth, safe, occlusion-free trajectories for aerial filming},
  author={Rogerio Bonatti and Yanfu Zhang and Sanjiban Choudhury and Wenshan Wang and Sebastian A. Scherer},
  booktitle={ISER},
  year={2018}
}
Autonomous aerial cinematography has the potential to enable automatic capture of aesthetically pleasing videos without requiring human intervention, empowering individuals with the capability of high-end film studios. Current approaches either only handle off-line trajectory generation, or offer strategies that reason over short time horizons and simplistic representations for obstacles, which result in jerky movement and low real-life applicability. In this work we develop a method for aerial… Expand
Autonomous Aerial Cinematography In Unstructured Environments With Learned Artistic Decision-Making
TLDR
A complete system for real-time aerial cinematography that for the first time combines vision-based target estimation; 3D signed-distance mapping for occlusion estimation; efficient trajectory optimization for long time-horizon camera motion; and learning-based artistic shot selection is proposed. Expand
Autonomous Cinematography using Unmanned Aerial Vehicles
In this paper we present a system to enable autonomous cinematography using UAVs. Aerial cinematography is popular with both professional and amateur film makers due to its capability of composingExpand
Towards a Robust Aerial Cinematography Platform: Localizing and Tracking Moving Targets in Unstructured Environments
TLDR
This work proposes a complete system for aerial cinematography that combines a vision-based algorithm for target localization; a real-time incremental 3D signed-distance map algorithm for occlusion and safety computation; and areal-time camera motion planner that optimizes smoothness, collisions, occlusions and artistic guidelines. Expand
Can a Robot Become a Movie Director? Learning Artistic Principles for Aerial Cinematography
TLDR
A deep reinforcement learning agent is proposed which supervises motion planning of a filming drone by making desirable shot mode selections based on aesthetical values of video shots, unlike most of the current state-of-the-art approaches that require explicit guidance by a human expert. Expand
Integrated Motion Planner for Real-time Aerial Videography with a Drone in a Dense Environment
  • B. Jeon, H. Kim
  • Computer Science
  • 2020 IEEE International Conference on Robotics and Automation (ICRA)
  • 2020
TLDR
This work suggests an integrated approach for a drone (or multirotor) to perform an autonomous videography task in a 3-D obstacle environment by following a moving object by using a hierarchical chasing planner. Expand
3D Human Reconstruction in the Wild with Collaborative Aerial Cameras
TLDR
A real-time aerial system for multi-camera control that can reconstruct human motions in natural environments without the use of special-purpose markers is presented and a multi-robot coordination scheme that maintains the optimal flight formation for target reconstruction quality amongst obstacles is developed. Expand
Aerial Multi-Camera Robotic Jib Crane
TLDR
The proposed scheme, based on the cluster-space formulation, presents an intuitive way of maneuvering the virtual camera fixture while automatically adjusting the motions by imposing artistic and safety constraints, facilitating the operator task. Expand
PinpointFly: An Egocentric Position-control Drone Interface using Mobile AR
TLDR
This work proposes PinpointFly, an egocentric drone interface that allows pilots to arbitrarily position and rotate a drone using position-control direct interactions on a see-through mobile AR where the drone position and direction are visualized with a virtual cast shadow. Expand
PANTHER: Perception-Aware Trajectory Planner in Dynamic Environments
TLDR
PANTHER plans trajectories that avoid dynamic obstacles while also keeping them in the sensor field of view (FOV) and minimizing the blur to aid in object tracking in dynamic environments. Expand
Improved Generalization of Heading Direction Estimation for Aerial Filming Using Semi-Supervised Regression
TLDR
This paper utilizes temporal continuity as the unsupervised signal to regularize the model and achieve better generalization ability, and shows that by leveraging unlabeled sequences, the amount of labeled data required can be significantly reduced. Expand
...
1
2
3
...

References

SHOWING 1-10 OF 39 REFERENCES
Directing Cinematographic Drones
TLDR
This article proposes the Drone Toric Space, a dedicated camera parameter space with embedded constraints, and proposes a dedicated path planning technique that ensures both that cinematographic properties can be enforced along the path and that the path is physically feasible by a quadrotor drone. Expand
Real-time planning for automated multi-view drone cinematography
TLDR
The online nature of the method enables incorporation of feedback into the planning and control loop, makes the algorithm robust to disturbances and extended to include coordination between multiple drones to enable dynamic multi-view shots, typical for action sequences and live TV coverage. Expand
Towards a Drone Cinematographer: Guiding Quadrotor Cameras using Visual Composition Principles
TLDR
This is the first end-to-end system that enables people to leverage the mobility of quadrotors, as well as the knowledge of expert filmmakers, to autonomously capture high-quality footage of people in the real world. Expand
Creating and chaining camera moves for qadrotor videography
TLDR
This paper proposes a higher level tool designed to enable even novice users to easily capture compelling aerial videos of large-scale outdoor scenes, and automatically generates a diverse set of candidate local camera moves for observing each landmark. Expand
Automated Cinematography with Unmanned Aerial Vehicles
TLDR
This research introduces a drone-independent platform for high-level user interactions that integrates cinematographic knowledge and demonstrates the capacities of the tool to capture live movie scenes involving one or two moving actors. Expand
An interactive tool for designing quadrotor camera shots
TLDR
The tool makes it possible for novices and experts to design compelling and challenging shots, and capture them fully autonomously, and is evaluated in a user study with novice and expert cinematographers. Expand
Intuitive and efficient camera control with the toric space
TLDR
This work introduces the Toric space, a novel and compact representation for intuitive and efficient virtual camera control, and derives a novel screen-space manipulation technique that provides intuitive and real-time control of visual properties. Expand
The director's lens: an intelligent assistant for virtual cinematography
TLDR
The Director's Lens, an intelligent interactive assistant for crafting virtual cinematography using a motion-tracked hand-held device that can be aimed like a real camera, enables efficient exploration of a wide range of cinematographic possibilities, and rapid production of computer-generated animated movies. Expand
Optimizing for aesthetically pleasing quadrotor camera motion
TLDR
This paper proposes a method that optimizes positional and temporal reference fit jointly, which allows to generate globally smooth trajectories, while retaining user control over reference timings, and outperforms the state of the art in terms of perceived usability and preference of resulting videos. Expand
Camera Control in Computer Graphics
TLDR
A range of computer graphics applications are presented and insights from cinematographic practice are drawn on in identifying their different requirements with regard to camera control, which range from augmented manual control (semi‐automatic) in interactive applications, to fully automated approaches. Expand
...
1
2
3
4
...