Dual-coded compressive hyperspectral imaging.

  title={Dual-coded compressive hyperspectral imaging.},
  author={Xing Lin and Gordon Wetzstein and Yebin Liu and Qionghai Dai},
  journal={Optics letters},
  volume={39 7},
This Letter presents a new snapshot approach to hyperspectral imaging via dual-optical coding and compressive computational reconstruction. We demonstrate that two high-speed spatial light modulators, located conjugate to the image and spectral plane, respectively, can code the hyperspectral datacube into a single sensor image such that the high-resolution signal can be recovered in postprocessing. We show various applications by designing different optical modulation functions, including… 

Figures from this paper

Snapshot Hyperspectral Light Field Imaging

Hardware experimental results demonstrate that, for the first time to the authors' knowledge, a 5D hyperspectral light field containing 9x9 angular views and 27 spectral bands can be acquired in a single shot.

Compressive ultraspectral imaging using multiscale structured illumination.

A novel compressive spectral imaging technique that attains spatially resolved ultraspectral resolution by employing a multiscale sampling technique based on the Hadamard basis for the single pixel hyperspectral imager.

Spatial-spectral encoded compressive hyperspectral imaging

This paper proposes a novel compressive hyperspectral (HS) imaging approach that allows for high-resolution HS images to be captured in a single image and demonstrates other applications for the over-complete HS dictionary and sparse coding techniques, including 3D HS images compression and denoising.

Fast Hyperspectral Image Recovery via Non-iterative Fusion of Dual-Camera Compressive Hyperspectral Imaging

This paper investigates the spectral low-rank property of HSI composed of a spectral basis and spatial coefficients and proposes a new fusion model for the HSI reconstruction that outperforms previous state-of-the-art not only in quality but also speeds up the reconstruction more than 5000 times.

Compressive Sensing Hyperspectral Imaging by Spectral Multiplexing with Liquid Crystal

The outstanding advantage of the CS-MUSI camera is that the entire HS image is captured from an order of magnitude fewer measurements of the sensor array, compared to conventional HS imaging methods.

Optimized coded aperture for frugal hyperspectral image recovery using a dual-disperser system.

We present a novel acquisition scheme based on a dual-disperser architecture, which can reconstruct a hyperspectral datacube using many times fewer acquisitions than spectral bands. The

Programmable Spectral Filter Arrays for Hyperspectral Imaging

A computational camera that implements a spatially-varying programmable spectral filter array is proposed that can capture intensity images under a wide configuration of spectral filters and computationally recover the hyperspectral image of the scene from one or more such spectrally filtered images.

KRISM—Krylov Subspace-based Optical Computing of Hyperspectral Images

An adaptive imaging technique that optically computes a low-rank approximation of a scene’s hyperspectral image, conceptualized as a matrix by iterating between the two measurement operators.

Sparse Recovery of Hyperspectral Signal from Natural RGB Images

This work presents a low cost and fast method to recover high quality hyperspectral images directly from RGB using a novel, larger-than-ever database of hyperspectRAL images serves as a hyperspectrals prior.

Extended-field coverage hyperspectral camera based on a single-pixel technique.

A hyperspectral camera that allows extended-field coverage to be collected by one detector is presented, which can be extended to near-infrared or infrared spectral monitoring and applied to monitoring fruit freshness nondestructively by differentiating a banana's ripeness over time.



Compressive hyperspectral imaging by random separable projections in both the spatial and the spectral domains.

An efficient method and system for compressive sensing of hyperspectral data is presented, which enables optimizing the ratio between the spatial and the spectral compression sensing ratios.

Higher-order computational model for coded aperture spectral imaging.

This paper develops a higher-order precision model for the optical sensing in CASSI that includes a more accurate discretization of the underlying signals, leading to image reconstructions less dependent on calibration.

Multiframe image estimation for coded aperture snapshot spectral imagers.

For less spectrally sparse scenes, it is shown that the use of multiple nondegenerate snapshots can make data cube recovery less ill-posed, yielding improved spatial and spectral reconstruction fidelity.

Snapshot Image Mapping Spectrometer (IMS) with high sampling density for hyperspectral microscopy

A snapshot Image Mapping Spectrometer (IMS) with high sampling density is developed for hyperspectral microscopy, measuring a datacube of dimensions 285 × 285 × 60 (x, y, λ). The spatial resolution

Video rate spectral imaging using a coded aperture snapshot spectral imager.

NeAREst, an algorithm for estimating the instantaneous three-dimensional spatio-spectral data cube from CASSI's two-dimensional array of encoded and compressed measurements is described.

Development of a digital-micromirror-device-based multishot snapshot spectral imaging system.

The DMD-SSI system is versatile in nature as it can be used to implement independent CS measurement patterns in addition to spatially shifted patterns that piezostage-based systems can offer.

Agile Spectrum Imaging: Programmable Wavelength Modulation for Cameras and Projectors

An optical relay system that allows mechanical or electronic color spectrum control and use it to modify a conventional camera and projector is presented, and applications such as adaptive color primaries, metamer detection, scene contrast enhancement, photographing fluorescent objects, and high dynamic range photography are proposed.

Development of four-dimensional imaging spectrometers (4D-IS)

The incentive for the 4D-IS concept was driven by the need to adequately resolve all four dimensions of data (2D spatial, spectral, and temporal) with a single, radiometrically calibrated sensor.

Compressed sensing

  • D. Donoho
  • Mathematics
    IEEE Transactions on Information Theory
  • 2006
It is possible to design n=O(Nlog(m)) nonadaptive measurements allowing reconstruction with accuracy comparable to that attainable with direct knowledge of the N most important coefficients, and a good approximation to those N important coefficients is extracted from the n measurements by solving a linear program-Basis Pursuit in signal processing.

Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum

A comprehensive optimization method to arrive at the spatial and spectral layout of the color filter array of a GAP camera is presented and a novel algorithm for reconstructing the under-sampled channels of the image while minimizing aliasing artifacts is developed.