Penrose Pixels for Super-Resolution

  title={Penrose Pixels for Super-Resolution},
  author={Moshe Ben-Ezra and Zhouchen Lin and Bennett Wilburn and Wayne Zhang},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
We present a novel approach to reconstruction-based super-resolution that uses aperiodic pixel tilings, such as a Penrose tiling or a biological retina, for improved performance. To this aim, we develop a new variant of the well-known error back projection super-resolution algorithm that makes use of the exact detector model in its back projection operator for better accuracy. Pixels in our model can vary in shape and size, and there may be gaps between adjacent pixels. The algorithm applies… 
Sub-pixel Layout for Super-Resolution with Images in the Octic Group
It is shown that recording multiple images, transformed in the octic group, with a sensor of asymmetric sub-pixel layout increases the spatial sampling compared to a conventional sensor with a rectilinear grid of pixels and hence increases the image resolution.
Penrose Demosaicking
This work develops a sparse representation-based method for Penrose demosaicking, which outperforms regular pixel layouts in terms of both perceptual evaluation and S-CIELAB.
Anamorphic pixels for multi-channel superresolution
It is shown that simply changing the pixel aspect ratio from square to anamorphic is sufficient to achieve superresolution from plenoptic cameras or camera arrays, as long as each camera has a unique aspect ratio.
Penrose high-dynamic-range imaging
Both quantitative and qualitative results show the superiority of Penrose pixel layout over square pixel layout in HDR imaging, using a Gaussian mixture model for regularization.
Image Super-Resolution Using T-Tetromino Pixels
This work proposes a novel binning concept using tetromino-shaped pixels that achieves superior image quality in terms of PSNR, SSIM, and visually compared to conventional single-image super- resolution using the very deep super-resolution (VDSR) network.
Super-resolution image reconstruction algorithm based on sub-pixel shift
This paper studies the problem of multi-frame image super-resolution reconstruction. The process of image degradation is modeled by using the first-order Taylor expansion based on sub-pixel. Then the
A Digital Gigapixel Large-Format Tile-Scan Camera
  • M. Ben-Ezra
  • Environmental Science, Physics
    IEEE Computer Graphics and Applications
  • 2011
This digital large-format tile scan camera can acquire high-quality, high-resolution images of static scenes and employs unique calibration techniques and a simple algorithm for focal-stack processing of very large images with significant magnification variations.
Non-Parametric Super-Resolution Using a Bi-Sensor Camera
This work proposes sampling rate diversity, where a secondary LR image, acquired by a secondary sensor of different (lower) sampling rate, is used as a reference to make known portions (subpolyphase components) of the PPCs of the reconstructed HR image.


Penrose Pixels Super-Resolution in the Detector Layout Domain
A novel approach to reconstruction based super- resolution that explicitly models the detector's pixel layout and it is demonstrated that, in principle, this structure is better for super-resolution than the regular pixel array used in today's sensors.
Fundamental limits of reconstruction-based superresolution algorithms under local translation
  • Zhouchen Lin, H. Shum
  • Mathematics
    IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2004
This paper is the first attempt to determine the explicit limits of reconstruction-based algorithms, under both real and synthetic conditions, based on the perturbation theory of linear systems.
A Fast Image Super-Resolution Algorithm Using an Adaptive Wiener Filter
  • R. Hardie
  • Environmental Science
    IEEE Transactions on Image Processing
  • 2007
A computationally simple super-resolution algorithm using a type of adaptive Wiener filter that produces an improved resolution image from a sequence of low-resolution video frames with overlapping field of view and lends itself to parallel implementation.
Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time
Experimental results with real video demonstrate that a significant increase in the image resolution can be achieved by taking the motion blurring into account especially when there exists large interframe motion.
Bayesian Image Super-resolution, Continued
This paper develops a multi-frame image super-resolution approach from a Bayesian view-point by marginalizing over the unknown registration parameters relating the set of input low-resolution views, allowing for more realistic prior distributions and reduces the dimension of the integral considerably, removing the main computational bottleneck of the other algorithm.
Super-resolution image reconstruction: a technical overview
The goal of this article is to introduce the concept of SR algorithms to readers who are unfamiliar with this area and to provide a review for experts to present the technical review of various existing SR methodologies which are often employed.
Exploiting the sparse derivative prior for super-resolution
This work introduces an efficient representation for finding candidate values for patches of the image being estimated, avoiding combinatorial explosion, and shows how the super resolution system produces noticeably sharper images, with few significant artifacts.
A new compressive imaging camera architecture using optical-domain compression
A new camera architecture is developed that employs a digital micromirror array to perform optical calculations of linear projections of an image onto pseudorandom binary patterns that can be adapted to image at wavelengths that are currently impossible with conventional CCD and CMOS imagers.
Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images
A hybrid method combining the simplicity of theML and the incorporation of nonellipsoid constraints is presented, giving improved restoration performance, compared with the ML and the POCS approaches.
Video super-resolution using controlled subpixel detector shifts
By applying an adaptive super-resolution algorithm to the video produced by the jitter camera, it is shown that resolution can be notably enhanced for stationary or slowly moving objects, while it is improved slightly or left unchanged for objects with fast and complex motions.