Learning Multiscale Convolutional Dictionaries for Image Reconstruction

@article{Liu2022LearningMC,
  title={Learning Multiscale Convolutional Dictionaries for Image Reconstruction},
  author={Tianlin Liu and Anadi Chaman and David Belius and Ivan Dokmani'c},
  journal={IEEE Transactions on Computational Imaging},
  year={2022},
  volume={8},
  pages={425-437}
}
Convolutional neural networks (CNNs) have been tremendously successful in solving imaging inverse problems. To understand their success, an effective strategy is to construct simpler and mathematically more tractable convolutional sparse coding (CSC) models that share essential ingredients with CNNs. Existing CSC methods, however, underperform leading CNNs in challenging inverse problems. We hypothesize that the performance gap may be attributed in part to how they process images at different… 
[PDF] Semantic Reader
3 Citations
Highly Influential Citations
1
Background Citations
2
Methods Citations
2

3 Citations

Sinogram upsampling using Primal-Dual UNet for undersampled CT and radial MRI reconstruction

The proposed Primal-Dual UNet improves the overall image quality, but also improves the image quality for the regions-of-interest: liver, kidneys, and spleen; as well as generalises better than the baselines in presence of a needle.

Enhanced artificial intelligence-based diagnosis using CBCT with internal denoising: Clinical validation for discrimination of fungal ball, sinusitis, and normal cases in the maxillary sinus

An AI-based computer-aided diagnosis method using CBCT with a denoising module is proposed, implemented before diagnosis to reconstruct the internal ground-truth full-dose scan corresponding to an input CBCT image and thereby improve the diagnostic performance.

Conditional Injective Flows for Bayesian Imaging

C-Trumpets are proposed—conditional injective flows specifically designed for imaging problems, which greatly diminish these challenges of ill-posedness, nonlinearity, model mismatch, and noise and enable fast approximation of point estimates like MMSE or MAP as well as physically-meaningful uncertainty quantiflcation.

References

SHOWING 1-10 OF 82 REFERENCES

When to Use Convolutional Neural Networks for Inverse Problems

This work argues that for some types of inverse problems the CNN approximation breaks down leading to poor performance, and argues that the CSC approach should be used instead and validate this argument with empirical evidence.

Denoising Prior Driven Deep Neural Network for Image Restoration

A convolutional neural network (CNN) based denoiser that can exploit the multi-scale redundancies of natural images is proposed, which not only exploits the powerful denoising ability of DNNs, but also leverages the prior of the observation model.

Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution

This paper proposes the Laplacian Pyramid Super-Resolution Network (LapSRN) to progressively reconstruct the sub-band residuals of high-resolution images and generates multi-scale predictions in one feed-forward pass through the progressive reconstruction, thereby facilitates resource-aware applications.

Understanding Geometry of Encoder-Decoder CNNs

A unified mathematical framework shows that encoder-decoder CNN architecture is closely related to nonlinear basis representation using combinatorial convolution frames, whose expressibility increases exponentially with the network depth, and the importance of skipped connection in terms of expressibility, and optimization landscape.

Variations on the Convolutional Sparse Coding Model

This work expands the range of formulations for the CSC model by proposing two convex alternatives that merge global norms with local penalties and constraints and derivation of efficient and provably converging algorithms to solve these new sparse coding formulations.

Removing Rain from Single Images via a Deep Detail Network

A deep detail network is proposed to directly reduce the mapping range from input to output, which makes the learning process easier and significantly outperforms state-of-the-art methods on both synthetic and real-world images in terms of both qualitative and quantitative measures.

Convolutional Kernel Networks

This paper proposes a new type of convolutional neural network (CNN) whose invariance is encoded by a reproducing kernel, and bridges a gap between the neural network literature and kernels, which are natural tools to model invariance.

Learning Deep Analysis Dictionaries for Image Super-Resolution

Simulation results show that the proposed deep analysis dictionary model achieves better performance compared to a deep neural network that has the same structure and is optimized using back-propagation when training datasets are small.

Image super-resolution by learning weighted convolutional sparse coding

An end-to-end trainable unfolding network which leverages both DL- and prior-based methods and presents a SISR model by learning weighted convolutional sparse coding, in which the channel attention is resorted to learn the weight.

Online convolutional dictionary learning for multimodal imaging

This paper proposes a new method that reconstructs multimodal images from their linear measurements by exploiting redundancies across different modalities, and develops an online algorithm that enables the unsupervised learning of convolutional dictionaries on large-scale datasets that are typical in such applications.
...