Time-multiplexed Neural Holography: A Flexible Framework for Holographic Near-eye Displays with Fast Heavily-quantized Spatial Light Modulators

@article{Choi2022TimemultiplexedNH,
  title={Time-multiplexed Neural Holography: A Flexible Framework for Holographic Near-eye Displays with Fast Heavily-quantized Spatial Light Modulators},
  author={Suyeon Choi and Manu Gopakumar and Yifan Peng and Jonghyun Kim and Matthew O'Toole and Gordon Wetzstein},
  journal={ACM SIGGRAPH 2022 Conference Proceedings},
  year={2022}
}
Holographic near-eye displays offer unprecedented capabilities for virtual and augmented reality systems, including perceptually important focus cues. Although artificial intelligence–driven algorithms for computer-generated holography (CGH) have recently made much progress in improving the image quality and synthesis efficiency of holograms, these algorithms are not directly applicable to emerging phase-only spatial light modulators (SLM) that are extremely fast but offer phase control with… 

Figures and Tables from this paper

Waveguide Holography: Towards True 3D Holographic Glasses

We present a novel near-eye display concept which consists of a waveguide combiner, a spatial light modulator, and a laser light source. The proposed system can display true 3D holographic images

Analyzing phase masks for wide étendue holographic displays

Spatial light modulator (SLM) technology forms the centerpiece of digital holographic displays. However, an inherent limitation of these devices is that their etendue, defined as the product of the

Holographic Glasses for Virtual Reality

We present Holographic Glasses, a holographic near-eye display system with an eyeglasses-like form factor for virtual reality. Holographic Glasses are composed of a pupil-replicating waveguide, a

References

SHOWING 1-10 OF 60 REFERENCES

Neural holography with camera-in-the-loop training

This work develops an algorithmic CGH framework that achieves unprecedented image fidelity and real-time framerates and represents the first CGH algorithm capable of generating full-color high-quality holographic images at 1080p resolution in real time.

Wirtinger holography for near-eye displays

The proposed Wirtinger Holography is flexible and facilitates the use of different loss functions, including learned perceptual losses parametrized by deep neural networks, as well as stochastic optimization methods, and extends the framework to render 3D volumetric scenes.

Towards real-time photorealistic 3D holography with deep neural networks

A deep-learning-based CGH pipeline capable of synthesizing a photorealistic colour 3D hologram from a single RGB-depth image in real time is demonstrated and an anti-aliasing phase-only encoding method is experimentally demonstrated, demonstrating speckle-free, natural-looking, high-resolution3D holograms.

Holographic near-eye displays based on overlap-add stereograms

The overlap-add stereogram (OLAS) is developed as the correct method of "inverting" the light field into a hologram via the STFT, making the OLAS not only a hogel size-invariant method, but also nearly scene independent.

Holographic near-eye displays for virtual and augmented reality

A unified focus, aberration correction, and vision correction model, along with a user calibration process, accounts for any optical defects between the light source and retina to enable truly compact, eyeglasses-like displays with wide fields of view that would be inaccessible through conventional means.

Neural 3D Holography: Learning Accurate Wave Propagation Models for 3D Holographic Virtual and Augmented Reality Displays

The authors' wave propagation model enables accurate 3D holographic display with significantly improved image quality for in-focus 3D scene parts and the phase regularization strategy additionally improves strong out-of-focus speckle artifacts observed with other approaches.

Learned holographic light transport

This work addresses this mismatch by learning the holographic light transport in holographic displays by using a camera and a holographic display to capture the image reconstructions of optimized holograms that rely on ideal simulations to generate a dataset.

Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3D computer graphics

A light field-based CGH rendering pipeline is presented allowing for reproduction of high-definition 3D scenes with continuous depth and support of intra-pupil view-dependent occlusion and it is shown that the rendering accurately models the spherical illumination introduced by the eye piece and produces the desired 3D imagery at the designated depth.

High-contrast, speckle-free, true 3D holography via binary CGH optimization

This work adopts the random phase for the true 3D implementation to achieve the maximum axial resolution and develops the high-performance binary hologram optimization framework to minimize the binary quantization noise, which provides accurate and high-contrast reconstructions for 2D as well as 3D cases.

Holographic Glasses for Virtual Reality

We present Holographic Glasses, a holographic near-eye display system with an eyeglasses-like form factor for virtual reality. Holographic Glasses are composed of a pupil-replicating waveguide, a
...