Reconstruction of hidden 3D shapes using diffuse reflections

@article{Gupta2012ReconstructionOH,
  title={Reconstruction of hidden 3D shapes using diffuse reflections},
  author={Otkrist Gupta and A. Velten and T. Willwacher and A. Veeraraghavan and R. Raskar},
  journal={Optics express},
  year={2012},
  volume={20 17},
  pages={
          19096-108
        }
}
We analyze multi-bounce propagation of light in an unknown hidden volume and demonstrate that the reflected light contains sufficient information to recover the 3D structure of the hidden scene. We formulate the forward and inverse theory of secondary scattering using ideas from energy front propagation and tomography. We show that using Fresnel approximation greatly simplifies this problem and the inversion can be achieved via a backpropagation process. We study the invertibility, uniqueness… Expand
Pose estimation using time-resolved inversion of diffuse light.
TLDR
It is experimentally shown that for a given geometry, a single incident illumination point yields enough information for pose estimation and tracking after multiple scattering events to result in accurate estimation of object pose. Expand
Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors
TLDR
This paper forms the reconstruction task as a linear inverse problem on the transient response of a scene, which they acquire using an affordable setup consisting of a modulated light source and a time-of-flight image sensor, and achieves resolutions in the order of a few centimeters for object shape and albedo. Expand
Non-Line-of-Sight Surface Reconstruction Using the Directional Light-Cone Transform
TLDR
It is demonstrated that surfaces fitted non-parametrically using the recovered normals are more accurate than those produced with NLOS surface reconstruction methods recently proposed, and are 1,000 times faster to compute than using inverse rendering. Expand
Recovering three-dimensional shape through a small hole using three laser scatterings.
TLDR
An approach was proposed and developed to recover the 3D shape concealed in a shelter with a small hole only using three laser scatterings using a nanosecond laser and a single-photon APD. Expand
Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging.
TLDR
This work employs a computational imaging technique that opportunistically exploits the presence of occluding objects, which obstruct probe-light propagation in the hidden scene, to undo the mixing and greatly improve scene recovery and represents an instance of a rich and promising new imaging modality. Expand
Beyond Volumetric Albedo — A Surface Optimization Framework for Non-Line-Of-Sight Imaging
TLDR
An analysis-by-synthesis framework that can reconstruct complex shape and reflectance of an NLOS object at a level of detail significantly exceeding what is possible with previous volumetric reconstruction methods is introduced. Expand
Fast Back-Projection for Non-Line of Sight Reconstruction
TLDR
This work proposes a new back-projection technique for NLOS reconstruction, up to a thousand times faster than previous work, with almost no quality loss, and demonstrates the efficiency and quality of the technique compared against previous methods. Expand
A Theory of Fermat Paths for Non-Line-Of-Sight Shape Reconstruction
TLDR
This work presents a novel theory of Fermat paths of light between a known visible scene and an unknown object not in the line of sight of a transient camera, and presents an algorithm, called Fermat Flow, to estimate the shape of the non-line-of-sight object. Expand
On the Effect of Reflectance on Phasor Field Non-Line-of-Sight Imaging
TLDR
This work experimentally studies the reconstruction of hidden scenes composed of objects with increasingly specular materials, and empirically analyzed the effect of reflectance of the hidden scenes on reconstruction, to characterize the imaging capabilities of this promising new framework, and foster new NLOS imaging modalities. Expand
Reconstructing rooms using photon echoes: A plane based model and reconstruction algorithm for looking around the corner
TLDR
It is demonstrated that a plane-based model for the hidden surfaces results in much higher SBR while simultaneously being amenable to larger spatial scales and high-fidelity reconstructions both of individual planes in a hidden volume and for reconstructing entire polygonal rooms composed of multiple planar walls. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 15 REFERENCES
Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging.
TLDR
A three-dimensional range camera able to look around a corner using diffusely reflected light that achieves sub-millimetre depth precision and centimetre lateral precision over 40 cm×40cm×40 cm of hidden space is demonstrated. Expand
Shape from Second-Bounce of Light Transport
TLDR
This paper develops a method to recover scene geometry from the second-bounce of light transport up to a scaling ambiguity from the form factors by optimization and demonstrates the correctness of the proposed theory of shape recovery from light transport. Expand
Looking around the corner using transient imaging
We show that multi-path analysis using images from a timeof-flight (ToF) camera provides a tantalizing opportunity to infer about 3D geometry of not only visible but hidden parts of a scene. WeExpand
A theory of inverse light transport
TLDR
The problem of inverse light transport is introduced - given a photograph of an unknown scene, decompose it into a sum of n-bounce images, where each image records the contribution of light that bounces exactly n times before reaching the camera. Expand
Time-resolved 3d capture of non-stationary gas flows
TLDR
This paper presents the first time-resolved Schlieren tomography system for capturing full 3D, non-stationary gas flows on a dense volumetric grid, and derives a new solution for this reconstruction problem that lends itself to efficient algorithms that robustly work with relatively small numbers of cameras. Expand
Time-resolved 3d capture of non-stationary gas flows
TLDR
This paper presents the first time-resolved Schlieren tomography system for capturing full 3D, non-stationary gas flows on a dense volumetric grid, and derives a new solution for this reconstruction problem that lends itself to efficient algorithms that robustly work with relatively small numbers of cameras. Expand
5d time-light transport matrix: What can we reason about scene properties?
Can time-of-flight cameras be used for performing multi-path analysis of global light transport? Traditional cameras estimate intensity per pixel, I(x,y,). In this position paper, we argue thatExpand
Dual photography
TLDR
A novel photographic technique called dual photography is presented, which exploits Helmholtz reciprocity to interchange the lights and cameras in a scene, and is fundamentally a more efficient way to capture such a 6D dataset than a system based on multiple projectors and one camera. Expand
Fast separation of direct and global components of a scene using high frequency illumination
TLDR
Fast methods for separating the direct and global illumination components of a scene measured by a camera and illuminated by a light source for scenes that include complex interreflections, subsurface scattering and volumetric scattering are presented. Expand
Estimating Motion and size of moving non-line-of-sight objects in cluttered environments
TLDR
A technique for motion and size estimation of non-line-of-sight (NLOS) moving objects in cluttered environments using a time of flight camera and multipath analysis and compute the upper bound on the size of the target by backprojecting the extremas of the time profiles. Expand
...
1
2
...