Acquiring the reflectance field of a human face

@article{Debevec2000AcquiringTR,
  title={Acquiring the reflectance field of a human face},
  author={P. Debevec and T. Hawkins and C. Tchou and H. Duiker and Westley Sarokin and Mark Sagar},
  journal={Proceedings of the 27th annual conference on Computer graphics and interactive techniques},
  year={2000}
}
  • P. Debevec, T. Hawkins, +3 authors Mark Sagar
  • Published 2000
  • Computer Science
  • Proceedings of the 27th annual conference on Computer graphics and interactive techniques
We present a method to acquire the reflectance field of a human face and use these measurements to render the face under arbitrary changes in lighting and viewpoint. We first acquire images of the face from a small set of viewpoints under a dense sampling of incident illumination directions using a light stage. We then construct a reflectance function image for each observed image pixel from its values over the space of illumination directions. From the reflectance functions, we can directly… Expand
Monocular Reconstruction of Neural Face Reflectance Fields
TLDR
This work presents a new neural representation for face reflectance where it is shown that this method outperforms existing monocular reflectance reconstruction methods, in terms of photorealism due to better capturing of physical premitives, such as sub-surface scattering, specularities, self-shadows and other higher-order effects. Expand
Deep reflectance fields
We present a novel technique to relight images of human faces by learning a model of facial reflectance from a database of 4D reflectance field data of several subjects in a variety of expressionsExpand
Acquisition of Human Faces using a Measurement-Based Skin Reflectance Model
TLDR
The skin model decomposes the high-dimensional bidirectional scattering surface reflectance distribution function (BSSRDF) of skin into components that can be estimated from the measured data, and is intuitive, amenable to interactive rendering, and easy to edit. Expand
Real-time illumination estimation from faces for coherent rendering
  • S. Knorr, Daniel Kurz
  • Computer Science
  • 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
  • 2014
TLDR
The approach provides plausible results, which considerably enhance the visual realism in real-time Augmented Reality applications, and recovers the most plausible real-world lighting conditions for measured reflections in a face, represented by a function depending on incident light angle using Spherical Harmonics. Expand
Reflectance from images: a model-based approach for human faces
TLDR
An image-based framework that acquires the reflectance properties of a human face based on a morphable face model that estimates the 3D shape and establishes point-to-point correspondence across images taken from different viewpoints and across different individuals' faces, providing a common parameterization of all reconstructed surfaces. Expand
Faces as light probes for relighting
TLDR
This work constructs a statistical reflectance model for faces and uses this model to extract the lighting and the reflectance field of an input face and shows that the proposed algorithm is an effective tool for many practical applications. Expand
Recovering Illumination and Texture Using Ratio Images
  • A. Troccoli, P. Allen
  • Computer Science
  • Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
  • 2006
TLDR
This paper uses the ratio of the images and the geometry information to compute the relative incident irradiance of one image with respect to the other, and builds a spatially varying albedo map, which can then be used to render the object under different illumination conditions. Expand
Realistic inverse lighting from a single 2D image of a face, taken under unknown and complex lighting
  • Davoud Shahlaei, V. Blanz
  • Mathematics, Computer Science
  • 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
  • 2015
TLDR
Modeling the lighting separately from the face model enhances the face modeling and analysis, provides information about the environment of the face, and facilitates realistic rendering of the faces in novel pose and lighting. Expand
Reflectance and Light Source Position Estimation from a Sparse Set of Images
  • F. Li, Y. Qi, Xukun Shen
  • Computer Science
  • Second Workshop on Digital Media and its Application in Museum & Heritages (DMAMH 2007)
  • 2007
TLDR
A new method to estimate the surface reflectance property of an object, as well as the position of a light source, by using an iterative separating-fitting technique is presented. Expand
Re-rendering from a Sparse Set of Images
We present a method to accomplish photorealistic rendering of real-world objects from their sparsely sampled appearance variation. Using a 3D model and a small set of images of an object, we recoverExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 60 REFERENCES
Inverse global illumination: recovering reflectance models of real scenes from photographs
TLDR
A lighting-independent model of the scene’s geometry and reflectance properties can be rendered with arbitrary modifications to structure and lighting via traditional rendering methods, and allows diffuse albedo to vary arbitrarily over surfaces while assuming that non-diffuse characteristics remain constant across particular regions. Expand
Reflectance and Texture of Real-World Surfaces Authors
TLDR
The visual appearance of real-world surfaces and the dependence of appearance on imaging conditions is investigated and a BRDF (bidirectional reflectance distribution function) database with reflectance measurements for over 60 different samples, each observed with over 200 different combinations of viewing and source directions is presented. Expand
Reflectance and texture of real-world surfaces
TLDR
A new texture representation called the BTF (bidirectional texture function) which captures the variation in texture with illumination and viewing direction is discussed, and a BTF database with image textures from over 60 different samples, each observed with over 200 different combinations of viewing and illumination directions is presented. Expand
Image-Based BRDF Measurement Including Human Skin
TLDR
This work presents a new image-based process for measuring the bidirectional reflectance of homogeneous surfaces rapidly, completely, and accurately and demonstrates its ability to achieve high resolution and accuracy over a large domain of illumination and reflection directions. Expand
Light field rendering
TLDR
This paper describes a sampled representation for light fields that allows for both efficient creation and display of inward and outward looking views, and describes a compression system that is able to compress the light fields generated by more than a factor of 100:1 with very little loss of fidelity. Expand
Synthesizing realistic facial expressions from photographs
We present new techniques for creating photorealistic textured 3D facial models from photographs of a human subject, and for creating smooth transitions between different facial expressions byExpand
Making faces
TLDR
The primary emphasis of the work is not compression but the use of a novel method to compress the geometric data based on principal components analysis, which eliminates much of the variance in the image data due to motion, which increases compression ratios. Expand
Image-based Rendering with Controllable Illumination
TLDR
A new image-based rendering method, based on the light field and Lumigraph system, allows illumination to be changed interactively, and the resulting images are physically correct. Expand
A morphable model for the synthesis of 3D faces
TLDR
A new technique for modeling textured 3D faces by transforming the shape and texture of the examples into a vector space representation, which regulates the naturalness of modeled faces avoiding faces with an “unlikely” appearance. Expand
Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography
TLDR
A method that uses measured scene radiance and global illumination in order to add new objects to light-based models with correct lighting and the relevance of the technique to recovering surface reflectance properties in uncontrolled lighting situations is discussed. Expand
...
1
2
3
4
5
...