Blind image fusion for hyperspectral imaging with the directional total variation
@article{Bungert2017BlindIF, title={Blind image fusion for hyperspectral imaging with the directional total variation}, author={Leon Bungert and David Anthony Coomes and Matthias Joachim Ehrhardt and Jennifer Rasch and Rafael Reisenhofer and Carola-Bibiane Sch{\"o}nlieb}, journal={Inverse Problems}, year={2017}, volume={34} }
Hyperspectral imaging is a cutting-edge type of remote sensing used for mapping vegetation properties, rock minerals and other materials. A major drawback of hyperspectral imaging devices is their intrinsic low spatial resolution. In this paper, we propose a method for increasing the spatial resolution of a hyperspectral image by fusing it with an image of higher spatial resolution that was obtained with a different imaging modality. This is accomplished by solving a variational problem in…
Figures from this paper
36 Citations
Variational Fusion of Hyperspectral Data by Non-Local Filtering
- Mathematics, Environmental ScienceMathematics
- 2021
A variational fusion model with a nonlocal regularization term that encodes patch-based filtering conditioned to the geometry of the multispectral data and a radiometric constraint that injects the high frequencies of the scene into the fused product with a band per band modulation according to the energy levels of the multi-spectral and hyperspectral images is proposed.
Robust Blind Image Fusion for Misaligned Hyperspectral Imaging Data
- Environmental SciencePAMM
- 2018
The low spatial resolution of hyperspectral imaging can be significantly improved by fusing the hyperspectral image with a high resolution photograph. In most practical cases, however, the exact…
Total Variation Regularized Low-Rank Model With Directional Information for Hyperspectral Image Restoration
- Computer ScienceIEEE Access
- 2021
A novel HSIs restoration approach is proposed that integrates low-rank (LR) prior and spatial-spectral total variation with directional information, and an extended alternating direction method of multipliers algorithm is designed to achieve simple and fast implementation.
Blind Hyperspectral-Multispectral Image Fusion via Graph Laplacian Regularization
- Mathematics, Environmental ScienceArXiv
- 2019
This paper super-resolves the HSI using the graph Laplacian defined on the MSI, and progressively alternates between finding the blur kernel and fusing HSI with MSI, generating accurate estimations of the blur Kernel and the SRI at convergence.
Modified SSR-NET: A Shallow Convolutional Neural Network for Efficient Hyperspectral Image Super-Resolution
- Environmental ScienceFrontiers in Remote Sensing
- 2022
A fast and shallow convolutional neural network is proposed for hyperspectral image super-resolution inspired by Spatial-Spectral Reconstruction Network (SSR-NET). The feature extraction ability is…
Hyperspectral Image Super-Resolution in Arbitrary Input-Output Band Settings
- Computer Science2022 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)
- 2022
A single Meta-Learning-Based Super-Resolution (MLSR) model is proposed, which can take in HSI images at an arbitrary number of input bands’ peak wavelengths and generate SR HSIs with an arbitrarily number of output bands‘ peak wavelengths.
Hyperspectral Super-Resolution Via Joint Regularization of Low-Rank Tensor Decomposition
- Environmental Science, MathematicsRemote. Sens.
- 2021
The hyperspectral image super-resolution problem is transformed into a joint regularization optimization problem based on tensor decomposition and solved by a hybrid framework between the alternating direction multiplier method (ADMM) and the proximal alternate optimization (PAO) algorithm.
Variational model with nonstandard growth conditions for restoration of satellite optical images using synthetic aperture radar
- Mathematics, Environmental ScienceEuropean Journal of Applied Mathematics
- 2022
In this paper, the problem of restoration of cloud contaminated optical images is studied in the case when we have no information about brightness of such images in the damage region. We propose a…
Robust Image Reconstruction With Misaligned Structural Information
- Computer ScienceIEEE Access
- 2020
Numerical results on simulated and real data show the potential of the proposed variational framework for various applications in multi-contrast MRI, PET-MR, and hyperspectral imaging: typical misalignments between modalities such as rotations, translations, zooms can be effectively corrected during the reconstruction process.
Model Inspired Autoencoder for Unsupervised Hyperspectral Image Super-Resolution
- Computer ScienceIEEE Transactions on Geoscience and Remote Sensing
- 2022
This article makes the first attempt to design a model-inspired deep network for HSI super-resolution in an unsupervised manner that is similar to a manifold prior-based model and can be trained patch by patch rather than the entire images.
References
SHOWING 1-10 OF 75 REFERENCES
A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization
- MathematicsIEEE Transactions on Geoscience and Remote Sensing
- 2015
The split augmented Lagrangian shrinkage algorithm (SALSA), which is an instance of the alternating direction method of multipliers (ADMM), is added to this optimization problem, by means of a convenient variable splitting, and an effective algorithm is obtained that outperforms the state of the art.
A variational approach to hyperspectral image fusion
- Environmental Science, MathematicsDefense + Commercial Sensing
- 2009
A wavelet-based variational method for fusing a high resolution image and a hyperspectral image with an arbitrary number of bands to ensure that the fused image can be used for tasks such as classification and detection.
Hyperspectral Pansharpening: A Review
- Mathematics, Environmental ScienceIEEE Geoscience and Remote Sensing Magazine
- 2015
This work compares new pansharpening techniques designed for hyperspectral data with some of the state-of-the-art methods for multispectral panshARPening, which have been adapted for hypersittral data.
A Variational Approach for Sharpening High Dimensional Images
- Mathematics, Environmental ScienceSIAM J. Imaging Sci.
- 2012
A new variational method for sharpening high dimensional spectral images with the help of a high resolution gray-scale image while preserving the spectral characteristics used for classification and identification tasks is proposed.
A Variational Model for P+XS Image Fusion
- Mathematics, Environmental ScienceInternational Journal of Computer Vision
- 2006
We propose an algorithm to increase the resolution of multispectral satellite images knowing the panchromatic image at high resolution and the spectral channels at lower resolution. Our algorithm is…
A survey of classical methods and new trends in pansharpening of multispectral images
- Mathematics, Environmental ScienceEURASIP J. Adv. Signal Process.
- 2011
A review of the pan-sharpening methods proposed in the literature giving a clear classification of them and a description of their main characteristics and how the quality of the pansharpened images can be assessed both visually and quantitatively is analyzed.
Joint Image Registration and Fusion for Panchromatic and Multispectral Images
- Environmental ScienceIEEE Geoscience and Remote Sensing Letters
- 2015
An iterative optimization approach, which jointly considers the registration and fusion processes, is proposed for panchromatic (PAN) and multispectral (MS) images, using the downhill simplex algorithm to refine the registration parameters iteratively.
Compressive Blind Image Deconvolution
- MathematicsIEEE Transactions on Image Processing
- 2013
A novel blind image deconvolution (BID) regularization framework for compressive sensing (CS) based imaging systems capturing blurred images that relies on a constrained optimization technique, and allows the incorporation of existing CS reconstruction algorithms in compressive BID problems.
Pansharpening Image Fusion Using Cross-Channel Correlation: A Framelet-Based Approach
- Computer ScienceJournal of Mathematical Imaging and Vision
- 2015
A new regularization technique that explores the cross-channel correlation of different spectral channels in wavelet tight frame (or framelet) domain is proposed that outperforms some state-of-the-art algorithms in comparison.
Blind image deconvolution
- Computer ScienceIEEE Signal Process. Mag.
- 1996
The problem of blind deconvolution for images is introduced, the basic principles and methodologies behind the existing algorithms are provided, and the current trends and the potential of this difficult signal processing problem are examined.