Acquiring the reflectance field of a human face

@article{Debevec2000AcquiringTR,
  title={Acquiring the reflectance field of a human face},
  author={Paul E. Debevec and Tim Hawkins and Chris Tchou and Haarm-Pieter Duiker and Westley Sarokin and Mark Sagar},
  journal={Proceedings of the 27th annual conference on Computer graphics and interactive techniques},
  year={2000}
}
  • P. DebevecT. Hawkins Mark Sagar
  • Published 1 July 2000
  • Mathematics
  • Proceedings of the 27th annual conference on Computer graphics and interactive techniques
We present a method to acquire the reflectance field of a human face and use these measurements to render the face under arbitrary changes in lighting and viewpoint. We first acquire images of the face from a small set of viewpoints under a dense sampling of incident illumination directions using a light stage. We then construct a reflectance function image for each observed image pixel from its values over the space of illumination directions. From the reflectance functions, we can directly… 

Deep reflectance fields

We present a novel technique to relight images of human faces by learning a model of facial reflectance from a database of 4D reflectance field data of several subjects in a variety of expressions

Monocular Reconstruction of Neural Face Reflectance Fields

This work presents a new neural representation for face reflectance where all components of the reflectance responsible for the final appearance from a monocular image are estimated, and outperforms existing monocular reflectance reconstruction methods due to better capturing of physical effects, such as sub-surface scattering, specularities, self-shadows and other higher-order effects.

Acquisition of Human Faces using a Measurement-Based Skin Reflectance Model

The skin model decomposes the high-dimensional bidirectional scattering surface reflectance distribution function (BSSRDF) of skin into components that can be estimated from the measured data, and is intuitive, amenable to interactive rendering, and easy to edit.

Real-time illumination estimation from faces for coherent rendering

  • S. KnorrDaniel Kurz
  • Computer Science
    2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
  • 2014
The approach provides plausible results, which considerably enhance the visual realism in real-time Augmented Reality applications, and recovers the most plausible real-world lighting conditions for measured reflections in a face, represented by a function depending on incident light angle using Spherical Harmonics.

Reflectance from images: a model-based approach for human faces

An image-based framework that acquires the reflectance properties of a human face based on a morphable face model that estimates the 3D shape and establishes point-to-point correspondence across images taken from different viewpoints and across different individuals' faces, providing a common parameterization of all reconstructed surfaces.

Faces as light probes for relighting

This work constructs a statistical reflectance model for faces and uses this model to extract the lighting and the reflectance field of an input face and shows that the proposed algorithm is an effective tool for many practical applications.

Recovering Illumination and Texture Using Ratio Images

  • Alejandro J. TroccoliP. Allen
  • Mathematics, Computer Science
    Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
  • 2006
This paper uses the ratio of the images and the geometry information to compute the relative incident irradiance of one image with respect to the other, and builds a spatially varying albedo map, which can then be used to render the object under different illumination conditions.

Realistic inverse lighting from a single 2D image of a face, taken under unknown and complex lighting

  • Davoud ShahlaeiV. Blanz
  • Mathematics
    2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
  • 2015
Modeling the lighting separately from the face model enhances the face modeling and analysis, provides information about the environment of the face, and facilitates realistic rendering of the faces in novel pose and lighting.

Reflectance and Light Source Position Estimation from a Sparse Set of Images

  • Fasheng LiYue QiXukun Shen
  • Mathematics
    Second Workshop on Digital Media and its Application in Museum & Heritages (DMAMH 2007)
  • 2007
A new method to estimate the surface reflectance property of an object, as well as the position of a light source, by using an iterative separating-fitting technique is presented.

Re-rendering from a Sparse Set of Images

We present a method to accomplish photorealistic rendering of real-world objects from their sparsely sampled appearance variation. Using a 3D model and a small set of images of an object, we recover
...

References

SHOWING 1-10 OF 45 REFERENCES

Inverse global illumination: recovering reflectance models of real scenes from photographs

A lighting-independent model of the scene’s geometry and reflectance properties can be rendered with arbitrary modifications to structure and lighting via traditional rendering methods, and allows diffuse albedo to vary arbitrarily over surfaces while assuming that non-diffuse characteristics remain constant across particular regions.

Reflectance and texture of real-world surfaces

The visual appearance of real-world surfaces and the dependence of appearance on imaging conditions is investigated and a BRDF (bidirectional reflectance distribution function) database with reflectance measurements for over 60 different samples, each observed with over 200 different combinations of viewing and source directions is presented.

Reflectance and Texture of Real-World Surfaces Authors

The visual appearance of real-world surfaces and the dependence of appearance on imaging conditions is investigated and a BRDF (bidirectional reflectance distribution function) database with reflectance measurements for over 60 different samples, each observed with over 200 different combinations of viewing and source directions is presented.

Image-Based BRDF Measurement Including Human Skin

This work presents a new image-based process for measuring the bidirectional reflectance of homogeneous surfaces rapidly, completely, and accurately and demonstrates its ability to achieve high resolution and accuracy over a large domain of illumination and reflection directions.

Light field rendering

This paper describes a sampled representation for light fields that allows for both efficient creation and display of inward and outward looking views, and describes a compression system that is able to compress the light fields generated by more than a factor of 100:1 with very little loss of fidelity.

Synthesizing realistic facial expressions from photographs

We present new techniques for creating photorealistic textured 3D facial models from photographs of a human subject, and for creating smooth transitions between different facial expressions by

Making faces

The primary emphasis of the work is not compression but the use of a novel method to compress the geometric data based on principal components analysis, which eliminates much of the variance in the image data due to motion, which increases compression ratios.

A morphable model for the synthesis of 3D faces

A new technique for modeling textured 3D faces by transforming the shape and texture of the examples into a vector space representation, which regulates the naturalness of modeled faces avoiding faces with an “unlikely” appearance.

Effic ient Re-rendering of Naturally Illuminated Environments

We present a method for the efficient re-rendering of a scene under a directional illuminant at an arbitrary orientation. We take advantage of the linearity of the rendering operator with respect to

The lumigraph

This paper discusses a new method for capturing the complete appearanceof both synthetic and real world objects and scenes, representing this information, and then using this representation to render