What Camera Motion Reveals about Shape with Unknown BRDF

@article{Chandraker2014WhatCM,
  title={What Camera Motion Reveals about Shape with Unknown BRDF},
  author={Manmohan Chandraker},
  journal={2014 IEEE Conference on Computer Vision and Pattern Recognition},
  year={2014},
  pages={2179-2186}
}
  • Manmohan Chandraker
  • Published 23 June 2014
  • Mathematics
  • 2014 IEEE Conference on Computer Vision and Pattern Recognition
Psychophysical studies show motion cues inform about shape even with unknown reflectance. Recent works in computer vision have considered shape recovery for an object of unknown BRDF using light source or object motions. This paper addresses the remaining problem of determining shape from the (small or differential) motion of the camera, for unknown isotropic BRDFs. Our theory derives a differential stereo relation that relates camera motion to depth of a surface with unknown isotropic BRDF… 
The Information Available to a Moving Observer on Shape with Unknown, Isotropic BRDFs
  • Manmohan Chandraker
  • Mathematics
    IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2016
TLDR
A theory that addresses the remaining problem of determining shape from the (small or differential) motion of the camera, for unknown isotropic BRDFs is proposed, which derives a differential stereo relation that relates camera motion to surface depth, which generalizes traditional Lambertian assumptions.
On Shape and Material Recovery from Motion
TLDR
The theory yields conditions for the joint estimability of shape, albedo, BRDF and directional lighting using motion cues, and Surprisingly, such problems are shown to be well-posed even for some non-Lambertian material types.
SVBRDF-Invariant Shape and Reflectance Estimation from a Light-Field Camera
TLDR
A spatially-varying (SV)BRDF-invariant theory for recovering 3D shape and reflectance from light-field cameras and proposes using a polynomial (quadratic) shape prior to resolve the shape ambiguity.
SVBRDF-Invariant Shape and Reflectance Estimation from Light-Field Cameras
TLDR
A spatially-varying (SV)BRDF-invariant theory for recovering 3D shape and reflectance from light-field cameras and proposes using a polynomial shape prior to resolve the shape ambiguity.
Robust Energy Minimization for BRDF-Invariant Shape from Light Fields
TLDR
This work presents a variational energy minimization framework for robust recovery of shape in multiview stereo with complex, unknown BRDFs and albedos that consistently achieves errors lower than Lambertian baselines and is more robust than prior BRDF-invariant reconstruction methods.
Shape and Reflectance Reconstruction Using Concentric Multi-Spectral Light Field
TLDR
A novel concentric multi-spectral light field design that is able to recover the shape and reflectance of surfaces of various materials in one shot and outperforms the state-of-the-art shape reconstruction methods, especially for non-Lambertian surfaces is introduced.
Beyond Photo-Consistency: Shape, Reflectance, and Material Estimation Using Light-Field Cameras
TLDR
By looking beyond photo-consistency, this thesis is able to estimate better depths and recover reflectance and material types, which can be useful for a variety of vision and graphics applications.
Shape Estimation from Shading, Defocus, and Correspondence Using Light-Field Angular Coherence
TLDR
This work presents a principled algorithm for dense depth estimation that combines defocus and correspondence metrics, and shows that combining all three sources of information: defocus, correspondence, and shading, outperforms state-of-the-art light-field depth estimation algorithms in multiple scenarios.
A Theory of Depth From Differential Defocus
This document describes a class of computationally-efficient visual depth sensors. Inspired by the visual system of the jumping spider, these sensors are thin lens cameras that observe small changes
Depth from shading, defocus, and correspondence using light-field angular coherence
TLDR
This work develops an improved technique for local shape estimation from defocus and correspondence cues, and shows how shading can be used to further refine the depth, and proposes a new framework that uses angular coherence to optimize depth and shading.
...
1
2
3
...

References

SHOWING 1-10 OF 25 REFERENCES
What Object Motion Reveals about Shape with Unknown BRDF and Lighting
TLDR
A theory that addresses the problem of determining shape from the (small or differential) motion of an object with unknown isotropic reflectance, under arbitrary unknown distant illumination, for both orthographic and perpsective projection and derives a general stratification that relates hardness of shape recovery to scene complexity.
What an image reveals about material reflectance
TLDR
This work derives precise conditions under which material reflectance properties may be estimated from a single image of a homogeneous curved surface, lit by a directional source, and proposes a semiparametric BRDF abstraction that lies between purely parametric and purely data-driven models.
Example-Based Stereo with General BRDFs
TLDR
This paper presents an algorithm for voxel-based reconstruction of objects with general reflectance properties from multiple calibrated views, and is the first stereo method to handle general, unknown, spatially-varying BRDFs under possibly varying, distant lighting, and shadows.
A theory of differential photometric stereo for unknown isotropic BRDFs
TLDR
A photometric invariant is discovered that relates image derivatives to the surface geometry, regardless of the form of isotropic BRDF, and it is proved that specification of the surface normal at a single point completely determines the surface depth from these isocontours.
Local Shape from Mirror Reflections
TLDR
It is proved that surface position and shape up to third order can be derived as a function of local position, orientation and local scale measurements in the image when two orientations are available at the same point.
Shape Reconstruction Based on Similarity in Radiance Changes under Varying Illumination
TLDR
A technique for determining an object's shape based on the similarity of radiance changes observed at points on its surface under varying illumination using an observation vector that represents a sequence of pixel intensities of a point on the surface under different lighting conditions.
Revised Definition of Optical Flow: Integration of Radiometric and Geometric Cues for Dynamic Scene Analysis
TLDR
A revised definition of optical flow is proposed to overcome shortcomings in interpreting optical flow merely as a geometric transformation field and leads to a general framework for the investigation of problems in dynamic scene analysis, based on the integration and unified treatment of both geometric and radiometric cues in time-varying imagery.
On a Constraint Equation for the Estimation of Displacement Rates in Image Sequences
  • H. Nagel
  • Mathematics
    IEEE Trans. Pattern Anal. Mach. Intell.
  • 1989
TLDR
The present author derives a constraint equation based on a combination of perspective projection and notions from differential geometry based on the use of Lambertian reflection properties and isotropic illumination in scene space and demonstrates the quantitive effects of taking into account radiometric considerations.
Active photometric stereo
  • James J. Clark
  • Geology
    Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
  • 1992
TLDR
An active vision technique for determining the absolute depth of surfaces using a very general model for the reflectance properties of the surface, and is valid for most of the shading models commonly used in computer vision work.
Effects of Texture, Illumination, and Surface Reflectance on Stereoscopic Shape Perception
TLDR
The results revealed a strong linear correlation between the judged patterns of relief and the actual depicted objects, though there were systematic differences in the magnitude of depth scaling in the different conditions.
...
1
2
3
...