Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging.

@article{Xu2018RevealingHS,
  title={Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging.},
  author={F. Xu and G. Shulkind and Christos Thrampoulidis and J. Shapiro and A. Torralba and F. Wong and G. Wornell},
  journal={Optics express},
  year={2018},
  volume={26 8},
  pages={
          9945-9962
        }
}
The ability to see around corners, i.e., recover details of a hidden scene from its reflections in the surrounding environment, is of considerable interest in a wide range of applications. However, the diffuse nature of light reflected from typical surfaces leads to mixing of spatial information in the collected light, precluding useful scene reconstruction. Here, we employ a computational imaging technique that opportunistically exploits the presence of occluding objects, which obstruct probe… Expand
Exploiting Occlusion in Non-Line-of-Sight Active Imaging
TLDR
It is demonstrated that the presence of occluders in the hidden scene can obviate the need for collecting time-resolved measurements, and an accompanying analysis for such systems and their generalizations is developed. Expand
Steady-State Non-Line-Of-Sight Imaging
TLDR
This work departs from temporal probing and demonstrates steady-state NLOS imaging using conventional intensity sensors and continuous illumination, and proposes a trainable architecture which learns to map diffuse indirect reflections to scene reflectance using only synthetic training data. Expand
Non-line-of-sight Imaging with Partial Occluders and Surface Normals
TLDR
This work introduces a factored NLOS light transport representation that accounts for partial occlusions and surface normals and develops a factorization approach for inverse time-resolved light transport and demonstrates high-fidelity NLOS reconstructions for challenging scenes both in simulation and with an experimental NLOS imaging system. Expand
Two-Dimensional Non-Line-of-Sight Scene Estimation From a Single Edge Occluder
TLDR
A new forward model is derived, accounting for radial falloff, and two inversion algorithms are proposed to form 2D reconstructions from a single photograph of the penumbra to demonstrate the feasibility (and utility) of the 2D corner camera. Expand
Efficient non-line-of-sight imaging with computational single-photon imaging
Single-photon detectors time-stamp incident photon events with picosecond accuracy. When combined with pulsed light sources, these emerging detectors record transient measurements of a sceneExpand
Real-time Non-line-of-sight Imaging with Two-step Deep Remapping
TLDR
This work proposes a new NLOS solution to address the above defects, with innovations on both detection equipment and reconstruction algorithm, and applies inexpensive commercial Lidar for detection, with much higher scanning speed and better compatibility to real-world imaging tasks. Expand
Computational periscopy with an ordinary digital camera
TLDR
This work introduces a two-dimensional computational periscopy technique that requires only a single photograph captured with an ordinary digital camera to recover the position of an opaque object and the scene behind (but not completely obscured by) the object, when both the object and scene are outside the line of sight of the camera, without requiring controlled or time-varying illumination. Expand
Single photon imaging and sensing of obscured objects around the corner
Non-line-of-sight (NLOS) optical imaging and sensing of objects imply new capabilities valuable to autonomous technology, machine vision, and other applications. Existing NLOS imaging methods relyExpand
Non-line-of-sight imaging
TLDR
A summarizes existing NLOS imaging techniques and discusses which directions show most promise for future developments, including methods for reconstructing hidden scenes from time-resolved measurements. Expand
Seeing around corners with edge-resolved transient imaging
TLDR
This work introduces an acquisition strategy, scene response model, and reconstruction algorithm that enable the formation of 2.5-dimensional representations—a plan view plus heights—and a 180∘ field of view for large-scale scenes. Expand
...
1
2
3
4
...

References

SHOWING 1-10 OF 24 REFERENCES
Exploiting Occlusion in Non-Line-of-Sight Active Imaging
TLDR
It is demonstrated that the presence of occluders in the hidden scene can obviate the need for collecting time-resolved measurements, and an accompanying analysis for such systems and their generalizations is developed. Expand
Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging.
TLDR
A three-dimensional range camera able to look around a corner using diffusely reflected light that achieves sub-millimetre depth precision and centimetre lateral precision over 40 cm×40cm×40 cm of hidden space is demonstrated. Expand
Looking around the corner using transient imaging
We show that multi-path analysis using images from a timeof-flight (ToF) camera provides a tantalizing opportunity to infer about 3D geometry of not only visible but hidden parts of a scene. WeExpand
Photon-Efficient Computational 3-D and Reflectivity Imaging With Single-Photon Detectors
TLDR
A robust method for estimating depth and reflectivity using fixed dwell time per pixel and on the order of one detected photon per pixel averaged over the scene, which increases photon efficiency 100-fold over traditional processing and also improves, somewhat, upon first-photon imaging under a total acquisition time constraint in raster-scanned operation. Expand
Photon-efficient imaging with a single-photon camera
TLDR
An array-specific algorithm is developed that converts coarsely time-binned photon detections to highly accurate scene depth and reflectivity by exploiting both the transverse smoothness and longitudinal sparsity of natural scenes and uniquely achieves high photon efficiency in a relatively short acquisition time. Expand
Tracking objects outside the line of sight using 2D intensity images
TLDR
This work demonstrates that occluded objects can be tracked in real time using much simpler means, namely a standard 2D camera and a laser pointer, and fundamentally differs from previous solutions by approaching the problem in an analysis-by-synthesis sense. Expand
See around the corner using active imaging
This paper investigates the prospects of "seeing around the corner" using active imaging. A monostatic active imaging system offers interesting capabilities in the presence of glossy reflectingExpand
3D Computational Imaging with Single-Pixel Detectors
TLDR
A computational imaging method is used to reconstruct a three-dimensional scene, without the need for lenses, and this simplified approach to 3D imaging can readily be extended to nonvisible wavebands. Expand
First-Photon Imaging
TLDR
First-photon imaging is introduced, which is a computational imager that exploits spatial correlations found in real-world scenes and the physics of low-flux measurements, and recovers 3D structure and reflectivity from the first detected photon at each pixel. Expand
Reconstruction of hidden 3D shapes using diffuse reflections
We analyze multi-bounce propagation of light in an unknown hidden volume and demonstrate that the reflected light contains sufficient information to recover the 3D structure of the hidden scene. WeExpand
...
1
2
3
...