Virtual Cinematography: Relighting through Computation

@article{Debevec2006VirtualCR,
  title={Virtual Cinematography: Relighting through Computation},
  author={P. Debevec},
  journal={Computer},
  year={2006},
  volume={39},
  pages={57-65}
}
Recording how scenes transform incident illumination into radiant light is an active topic in computational photography. Such techniques are making it possible to create virtual images of a person or place from new viewpoints and in any form of illumination. Some of the most interesting virtual relighting applications are in the area of filmmaking. A small crew could capture a real-world location to use it as a virtual film set, and the production's cinematographer could light the set virtually… Expand
Image and Geometry Processing for 3-D Cinematography: An Introduction
TLDR
12 chapters in this book are original contributions by scientists who have contributed to the mathematical foundations of the field and practitioners who have developed working systems of 3-D cinematography. Expand
Free-viewpoint Indoor Neural Relighting from Multi-view Stereo
TLDR
This work takes as input a multi-view capture of a real scene under a single lighting condition and re-renders the scene from novel viewpoints, accounting for view-dependent glossy effects, e.g., on the floor and on the table, allowing free-viewpoint navigation. Expand
Computer Vision Technology Applied to MR-Based Pre-visualization in Filmmaking
TLDR
The outline of gThe MR-PreViz Projecth is introduced and a vision based camera tracking method and a relighting technique for lighting design of MR- PreViz movie are developed. Expand
Levels of realism: from virtual reality to real virtuality
TLDR
This paper surveys promising efforts to date and identifies and discusses future research directions that need to be able to compute virtual environments to be perceptually equivalent as if the authors were "there" in the real world; so called "there-reality" or real virtuality. Expand
Digital inspection: an interactive stage for viewing surface details
TLDR
This work provides a complete system to visualize objects on the spot using photometric and geometric processing, combined with a set of visualization methods tuned to the interactive inspection and analysis of objects. Expand
Separating corneal reflections for illumination estimation
TLDR
The method capitalizes on physical characteristics of human irises to obtain an illumination estimate that encompasses the prominent light contributors in the scene and results are presented for eyes, including light colored eyes for which reflection separation is necessary to determine a valid illumination estimate. Expand
Convergence of Augmented Reality and Scientific Visualization, and its Application to Energy, Medicine and Sports.
TLDR
This study presents some industrydemanded systems developed by the Tecgraf group which reflect the convergence of the Augmented Reality and Scientific Visualization areas. Expand
Toward Full Spectral 3D View Synthesis
TLDR
Spectral capturing and rendering for faithful color reproduction in 3D view synthesis is explored in this paper, which aims to demonstrate the power of spectral capture in3D display synthesis. Expand
Computational Photography : High Dynamic Rangeand Light Fields
TLDR
The introduction and recent advancements of computational photography have revolutionized the imaging industry and spawned a new generation of image analysts and image editors. Expand
Computer Vision - Algorithms and Applications
  • R. Szeliski
  • Computer Science
  • Texts in Computer Science
  • 2011
TLDR
Computer Vision: Algorithms and Applications explores the variety of techniques commonly used to analyze and interpret images and takes a scientific approach to basic vision problems, formulating physical models of the imaging process before inverting them to produce descriptions of a scene. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 21 REFERENCES
Performance geometry capture for spatially varying relighting
TLDR
In image-based relighting, novel illumination on a subject is synthesized based on images acquired in different basis lighting conditions, when the lighting directions are densely distributed throughout the sphere, any distant lighting environment can be simulated accurately. Expand
Light field rendering
TLDR
This paper describes a sampled representation for light fields that allows for both efficient creation and display of inward and outward looking views, and describes a compression system that is able to compress the light fields generated by more than a factor of 100:1 with very little loss of fidelity. Expand
Dual photography
TLDR
A novel photographic technique called dual photography is presented, which exploits Helmholtz reciprocity to interchange the lights and cameras in a scene, and is fundamentally a more efficient way to capture such a 6D dataset than a system based on multiple projectors and one camera. Expand
Performance relighting and reflectance transformation with time-multiplexed illumination
TLDR
The approach is to illuminate the subject with a sequence of time-multiplexed basis lighting conditions, and to record these conditions with a high-speed video camera so that many conditions are recorded in the span of the desired output frame interval. Expand
Plenoptic modeling: an image-based rendering system
TLDR
An image-based rendering system based on sampling, reconstructing, and resampling the plenoptic function is presented and a novel visible surface algorithm and a geometric invariant for cylindrical projections that is equivalent to the epipolar constraint defined for planar projections are introduced. Expand
Image-based modeling, rendering, and lighting
TLDR
This special issue of IEEE Computer Graphics and Applications spotlights both the progress and recent advances in image-based approaches to computer graphics and demonstrates the indelible impact these approaches have had on the field. Expand
Relighting human locomotion with flowed reflectance fields
TLDR
An image-based approach for capturing the appearance of a walking or running person so they can be rendered realistically under variable viewpoint and illumination, and demonstrates realistic composites of several subjects into real and virtual environments using this technique. Expand
Relighting human locomotion with flowed reflectance fields
TLDR
An image-based approach for capturing the appearance of a walking or running person so they can be rendered realistically under variable viewpoint and illumination, and demonstrates realistic composites of several subjects into real and virtual environments using this technique. Expand
Digitizing the Parthenon: Estimating Surface Reflectance Properties of a Complex Scene under Captured Natural Illumination
TLDR
A process for estimating spatially-varying surface reflectance of a complex scene observed under natural illumination conditions is presented, showing that the technique can produce novel illumination renderings consistent with real photographs as well as reflectance properties that are consistent with ground-truth reflectance measurements. Expand
Omnidirectional Vision
TLDR
Results are presented on the software generation of pure perspective images from an omnidirectional image, given any user-selected viewing direction and magnification, on a camera with a hemispherical field of view. Expand
...
1
2
3
...