Multispectral Compressive Imaging Strategies Using Fabry–Pérot Filtered Sensors

  title={Multispectral Compressive Imaging Strategies Using Fabry–P{\'e}rot Filtered Sensors},
  author={K{\'e}vin Degraux and Valerio Cambareri and Bert Geelen and Laurent Jacques and Gauthier Lafruit},
  journal={IEEE Transactions on Computational Imaging},
In this paper, we introduce two novel acquisition schemes for multispectral compressive imaging. Unlike most existing methods, the proposed computational imaging techniques do not include any dispersive element, as they use a dedicated sensor that integrates narrowband Fabry–Pérot spectral filters at the pixel level. The first scheme leverages joint inpainting and superresolution to fill in those voxels that are missing due to the device's limited pixel count. The second scheme introduces… 

Figures and Tables from this paper

Compressive spectral imaging via deformable mirror and colored-mosaic detector.
This work introduces a novel and compact CSI architecture based on a deformable mirror and a colored-filter detector to produce compressive spatio-spectral projections without the need of a grating or prism and proposes a tensor-based reconstruction algorithm to recover the spatial-spectrals information from the compressed measurements.
A Variable Density Sampling Scheme for Compressive Fourier Transform Interferometry
Leveraging a variable density sampling strategy recently introduced in CS, this work provides near-optimal illumination strategies, so that the light exposure imposed on a biological specimen is minimized while the spectral resolution is preserved.
Neural network-based on-chip spectroscopy using a scalable plasmonic encoder
A deep learning-based spectral reconstruction framework using a compact and low-cost on-chip sensing scheme that is not constrained by many of the design trade-offs inherent to grating-based spectroscopy, making it ideal for applications that demand cost-effective, field-portable, and sensitive high-resolutionSpectroscopy tools.
A Low-Memory Compressive Image Sensor Architecture for Embedded Object Recognition
This work presents a compact image sensor architecture with end-of-column digital processing dedicated to perform embedded object recognition and the signal independent dimensionality reduction performed by the dedicated sensing scheme allows to dramatically reduce memory requirements.
Skin-Based Identification From Multispectral Image Data Using CNNs
This paper is the first to describe a pose-invariant and robust to overlapping real-time human identification system using hands and provides a framework to optimize the required spectral bands for the given spatial resolution limitations.
Machine learning and computation-enabled intelligent sensor design
A new generation of computational sensing systems that reduce the data burden while also improving sensing capabilities are envisioned, enabling low-cost and compact sensor implementations engineered through iterative analysis of data-driven sensing outcomes.


Generalized inpainting method for hyperspectral image acquisition
This work forms their superresolution and demosaicing task as a 3-D generalized inpainting problem and shows that a random arrangement of the spectral filters on the sensor is preferable to regular mosaic layout as it improves the quality of the reconstruction.
Compressive coded aperture imaging
This work proposes compressive imaging techniques for improving the performance of video imaging systems in the presence of constraints on the focal plane array size that combines coded aperture imaging to enhance pixel resolution with superimposing subframes of a scene onto a single focal plane arrays to increase field of view.
A parallel compressive imaging architecture for one-shot acquisition
A novel architecture that uses fewer detectors than the number of reconstructed pixels and is able to acquire the image in a single acquisition is presented, paving the way for the development of video architectures that acquire several frames per second.
Single-shot compressive spectral imaging with a dual-disperser architecture.
A single-shot spectral imaging approach based on the concept of compressive sensing with primary features of two dispersive elements, arranged in opposition and surrounding a binary-valued aperture code, which results in easily-controllable, spatially-varying, spectral filter functions with narrow features.
A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic
The adoption of spectral imaging by industry has so far been limited due to the lack of high speed, low cost and compact spectral cameras. Moreover most state-of-the-art spectral cameras utilize some
Compressive Coded Aperture Spectral Imaging: An Introduction
The remarkable advantage of CASSI is that the entire data cube is sensed with just a few FPA measurements and, in some cases, with as little as a single FPA shot.
Snapshot colored compressive spectral imager.
A compact snapshot colored compressive spectral imager (SCCSI) that exploits the benefits of the colored mosaic FPA detectors and the compression capabilities of CSI sensing techniques and can capture the spatiospectral information of a scene in a single snapshot.
A snapshot multispectral imager with integrated tiled filters and optical duplication
Although the potential of spectral imaging has been demonstrated in research environments, its adoption by industry has so far been limited due to the lack of high speed, low cost and compact
Compressed sensing for practical optical imaging systems: A tutorial
This tutorial discusses compressed sensing in the context of optical imaging devices, emphasizing the practical hurdles related to building such devices and offering suggestions for overcoming these hurdles.
Sparse MRI: The application of compressed sensing for rapid MR imaging
Practical incoherent undersampling schemes are developed and analyzed by means of their aliasing interference and demonstrate improved spatial resolution and accelerated acquisition for multislice fast spin‐echo brain imaging and 3D contrast enhanced angiography.