Blind image fusion for hyperspectral imaging with the directional total variation

  title={Blind image fusion for hyperspectral imaging with the directional total variation},
  author={Leon Bungert and David Anthony Coomes and Matthias Joachim Ehrhardt and Jennifer Rasch and Rafael Reisenhofer and Carola-Bibiane Sch{\"o}nlieb},
  journal={Inverse Problems},
Hyperspectral imaging is a cutting-edge type of remote sensing used for mapping vegetation properties, rock minerals and other materials. A major drawback of hyperspectral imaging devices is their intrinsic low spatial resolution. In this paper, we propose a method for increasing the spatial resolution of a hyperspectral image by fusing it with an image of higher spatial resolution that was obtained with a different imaging modality. This is accomplished by solving a variational problem in… 
Variational Fusion of Hyperspectral Data by Non-Local Filtering
A variational fusion model with a nonlocal regularization term that encodes patch-based filtering conditioned to the geometry of the multispectral data and a radiometric constraint that injects the high frequencies of the scene into the fused product with a band per band modulation according to the energy levels of the multi-spectral and hyperspectral images is proposed.
Robust Blind Image Fusion for Misaligned Hyperspectral Imaging Data
The low spatial resolution of hyperspectral imaging can be significantly improved by fusing the hyperspectral image with a high resolution photograph. In most practical cases, however, the exact
Total Variation Regularized Low-Rank Model With Directional Information for Hyperspectral Image Restoration
A novel HSIs restoration approach is proposed that integrates low-rank (LR) prior and spatial-spectral total variation with directional information, and an extended alternating direction method of multipliers algorithm is designed to achieve simple and fast implementation.
Blind Hyperspectral-Multispectral Image Fusion via Graph Laplacian Regularization
This paper super-resolves the HSI using the graph Laplacian defined on the MSI, and progressively alternates between finding the blur kernel and fusing HSI with MSI, generating accurate estimations of the blur Kernel and the SRI at convergence.
Modified SSR-NET: A Shallow Convolutional Neural Network for Efficient Hyperspectral Image Super-Resolution
A fast and shallow convolutional neural network is proposed for hyperspectral image super-resolution inspired by Spatial-Spectral Reconstruction Network (SSR-NET). The feature extraction ability is
Hyperspectral Image Super-Resolution in Arbitrary Input-Output Band Settings
A single Meta-Learning-Based Super-Resolution (MLSR) model is proposed, which can take in HSI images at an arbitrary number of input bands’ peak wavelengths and generate SR HSIs with an arbitrarily number of output bands‘ peak wavelengths.
Hyperspectral Super-Resolution Via Joint Regularization of Low-Rank Tensor Decomposition
The hyperspectral image super-resolution problem is transformed into a joint regularization optimization problem based on tensor decomposition and solved by a hybrid framework between the alternating direction multiplier method (ADMM) and the proximal alternate optimization (PAO) algorithm.
Variational model with nonstandard growth conditions for restoration of satellite optical images using synthetic aperture radar
In this paper, the problem of restoration of cloud contaminated optical images is studied in the case when we have no information about brightness of such images in the damage region. We propose a
Robust Image Reconstruction With Misaligned Structural Information
Numerical results on simulated and real data show the potential of the proposed variational framework for various applications in multi-contrast MRI, PET-MR, and hyperspectral imaging: typical misalignments between modalities such as rotations, translations, zooms can be effectively corrected during the reconstruction process.
Model Inspired Autoencoder for Unsupervised Hyperspectral Image Super-Resolution
This article makes the first attempt to design a model-inspired deep network for HSI super-resolution in an unsupervised manner that is similar to a manifold prior-based model and can be trained patch by patch rather than the entire images.


A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization
The split augmented Lagrangian shrinkage algorithm (SALSA), which is an instance of the alternating direction method of multipliers (ADMM), is added to this optimization problem, by means of a convenient variable splitting, and an effective algorithm is obtained that outperforms the state of the art.
A variational approach to hyperspectral image fusion
A wavelet-based variational method for fusing a high resolution image and a hyperspectral image with an arbitrary number of bands to ensure that the fused image can be used for tasks such as classification and detection.
Hyperspectral Pansharpening: A Review
This work compares new pansharpening techniques designed for hyperspectral data with some of the state-of-the-art methods for multispectral panshARPening, which have been adapted for hypersittral data.
A Variational Approach for Sharpening High Dimensional Images
A new variational method for sharpening high dimensional spectral images with the help of a high resolution gray-scale image while preserving the spectral characteristics used for classification and identification tasks is proposed.
A Variational Model for P+XS Image Fusion
We propose an algorithm to increase the resolution of multispectral satellite images knowing the panchromatic image at high resolution and the spectral channels at lower resolution. Our algorithm is
A survey of classical methods and new trends in pansharpening of multispectral images
A review of the pan-sharpening methods proposed in the literature giving a clear classification of them and a description of their main characteristics and how the quality of the pansharpened images can be assessed both visually and quantitatively is analyzed.
Joint Image Registration and Fusion for Panchromatic and Multispectral Images
An iterative optimization approach, which jointly considers the registration and fusion processes, is proposed for panchromatic (PAN) and multispectral (MS) images, using the downhill simplex algorithm to refine the registration parameters iteratively.
Compressive Blind Image Deconvolution
A novel blind image deconvolution (BID) regularization framework for compressive sensing (CS) based imaging systems capturing blurred images that relies on a constrained optimization technique, and allows the incorporation of existing CS reconstruction algorithms in compressive BID problems.
Pansharpening Image Fusion Using Cross-Channel Correlation: A Framelet-Based Approach
A new regularization technique that explores the cross-channel correlation of different spectral channels in wavelet tight frame (or framelet) domain is proposed that outperforms some state-of-the-art algorithms in comparison.
Blind image deconvolution
The problem of blind deconvolution for images is introduced, the basic principles and methodologies behind the existing algorithms are provided, and the current trends and the potential of this difficult signal processing problem are examined.