Faces as Lighting Probes via Unsupervised Deep Highlight Extraction

@inproceedings{Yi2018FacesAL,
  title={Faces as Lighting Probes via Unsupervised Deep Highlight Extraction},
  author={Renjiao Yi and Chenyang Zhu and Ping Tan and Stephen Lin},
  booktitle={ECCV},
  year={2018}
}
We present a method for estimating detailed scene illumination using human faces in a single image. In contrast to previous works that estimate lighting in terms of low-order basis functions or distant point lights, our technique estimates illumination at a higher precision in the form of a non-parametric environment map. Based on the observation that faces can exhibit strong highlight reflections from a broad range of lighting directions, we propose a deep neural network for extracting… CONTINUE READING
BETA
3
Twitter Mentions

Citations

Publications citing this paper.

References

Publications referenced by this paper.
SHOWING 1-10 OF 50 REFERENCES

Reflectance and Illumination Recovery in the Wild

  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2016
VIEW 9 EXCERPTS
HIGHLY INFLUENTIAL

Direct Intrinsics: Learning Albedo-Shading Decomposition by Convolutional Regression

  • 2015 IEEE International Conference on Computer Vision (ICCV)
  • 2015
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Face detection, pose estimation, and landmark localization in the wild

  • 2012 IEEE Conference on Computer Vision and Pattern Recognition
  • 2012
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

A 3D Face Model for Pose and Illumination Invariant Face Recognition

  • 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance
  • 2009
VIEW 6 EXCERPTS
HIGHLY INFLUENTIAL

Specular Highlight Removal in Facial Images

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2017
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Deep Outdoor Illumination Estimation

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2016
VIEW 10 EXCERPTS
HIGHLY INFLUENTIAL

Learning Detailed Face Reconstruction from a Single Image

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2016
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Similar Papers