Super-resolution reconstruction in a computational compound-eye imaging system

  title={Super-resolution reconstruction in a computational compound-eye imaging system},
  author={Wai-San Chan and Edmund Y. Lam and Michael K. Ng and Giuseppe Y. Mak},
  journal={Multidimensional Systems and Signal Processing},
From consumer electronics to biomedical applications, device miniaturization has shown to be highly desirable. This often includes reducing the size of some optical systems. However, diffraction effects impose a constraint on image quality when we simply scale down the imaging parameters. Over the past few years, compound-eye imaging system has emerged as a promising architecture in the development of compact visual systems. Because multiple low-resolution (LR) sub-images are captured, post… 
Title High-resolution lightfield photography using two masks
A major theme of computational photography is the acquisition of lightfield, which opens up new imaging capabilities, such as focusing after image capture. However, to capture the lightfield, one
Compact and thin multi-lens system for machine vision applications
  • E. Lam
  • Physics
    Electronic Imaging
  • 2008
A multi-lens optical architecture that allows for unconventional optical systems that require further image processing to reconstruct the images, but can be made to satisfy more stringent design constraints such as size, power, and cost is proposed.
High-resolution lightfield photography using two masks.
A new design for lightfield acquisition is presented, which allows for the capture of a higher resolution lightfield by using two attenuation masks, positioned at the aperture stop and the optical path respectively, so that the four-dimensional lightfield spectrum is encoded and sampled by a two-dimensional camera sensor in a single snapshot.
Design and replication of a six-channel foveated imaging system
Multichannel imaging systems consist of multiple channels which could have different imaging characteristics (field-of- view and angular resolution). The different imaging characteristics would
Nano-Structured Optics for 3 D Superresolution Imaging
and Introduction: Superresolution microscopy is an imaging technique capable of resolution beyond the diffraction limit [1]. One way to overcome the diffraction limit is by imaging a sparse group of
Light Field Spatial Super-Resolution Using Deep Efficient Spatial-Angular Separable Convolution
This paper proposes effective and efficient end-to-end convolutional neural network models for spatially super-resolving LF images with an hourglass shape, which allows feature extraction to be performed at the low-resolution level to save both the computational and memory costs.
Light field superresolution
This work forms this method in a variational Bayesian framework and performs the reconstruction of both the surface of the scene and the (superresolved) light field.
Computational photography with plenoptic camera and light field capture: tutorial.
  • E. Lam
  • Physics
    Journal of the Optical Society of America. A, Optics, image science, and vision
  • 2015
This tutorial paper illustrates the concept of plenoptic function and light field from the perspective of geometric optics, and describes the imaging model and computational algorithms that can reconstruct images at different focus points, using mathematical tools from ray optics and Fourier optics.
Light Field Image Processing: An Overview
A comprehensive overview and discussion of research in light field image processing, including basic light field representation and theory, acquisition, super-resolution, depth estimation, compression, editing, processing algorithms for light field display, and computer vision applications of light field data are presented.


Reconstruction of a high-resolution image on a compound-eye image-capturing system.
A new method for high-resolution image reconstruction, called a pixel rearrange method, is proposed, where the relation between the target object and the captured signals is estimated and utilized to rearrange the original pixel information.
High‐resolution imaging using integrated optical systems
This article discusses a novel and effective multiple‐design‐parameter approach for optimizing the processes of encoding and decoding the wavefront phase in integrated optical‐digital imaging systems and involves the use of information metrics, such as the Strehl ratio and Fisher information, for determining the optimal pupil‐phase distribution.
Artificial compound eyes: different concepts and their application for ultraflat image acquisition sensors
Two different approaches for ultra flat image acquisition sensors on the basis of artificial compound eyes are examined and measurements of the angular sensitivity function are compared to calculations using commercial raytracing software.
High-resolution image reconstruction with multisensors
The task of shown that the computation-intensive MAP formulation can be dehigh-resolution image reconstruction reduces to a single image composed into a set of smaller matrix equations by using the tworestoration problem with linear shift-invariant [(LSI) also linear dimensional discrete Fourier transform] blur operator].
Analysis of displacement errors in high-resolution image reconstruction with multisensors
An image-acquisition system composed of an array of sensors, where each sensor has a subarray of sensing elements of suitable size, has recently been popular for increasing the spatial resolution
Microoptical telescope compound eye.
A new optical concept for compact digital image acquisition devices with large field of view is developed and proofed experimentally and anamorphic lenses, where the parameters are a function of the considered optical channel, are used to achieve a homogeneous optical performance over the whole field of sight.
Thin compound-eye camera.
An artificial compound-eye objective fabricated by micro-optics technology is adapted and attached to a CMOS sensor array and the lithographic generation of opaque walls between channels for optical isolation is experimentally demonstrated.
Mathematical analysis of super-resolution methodology
The attainment of super resolution (SR) from a sequence of degraded undersampled images could be viewed as reconstruction of the high-resolution (HR) image from a finite set of its projections on a
Phase plate to extend the depth of field of incoherent hybrid imaging systems.
A spatial-domain method for designing a pupil phase plate to extend the depth of field of an incoherent hybrid imaging system with a rectangular aperture is described and the performance of the logarithmic phase plate with that of a cubic phase plate is compared.
Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images
A hybrid method combining the simplicity of theML and the incorporation of nonellipsoid constraints is presented, giving improved restoration performance, compared with the ML and the POCS approaches.