Virtual organelle self-coding for fluorescence imaging via adversarial learning

  title={Virtual organelle self-coding for fluorescence imaging via adversarial learning},
  author={Thanh Nguyen and Vy Bui and Anh Thai and Van Lam and Christopher B. Raub and Lin-Ching Chang and George Nehmetallah},
  journal={Journal of Biomedical Optics},
Abstract. Significance: Our study introduces an application of deep learning to virtually generate fluorescence images to reduce the burdens of cost and time from considerable effort in sample preparation related to chemical fixation and staining. Aim: The objective of our work was to determine how successfully deep learning methods perform on fluorescence prediction that depends on structural and/or a functional relationship between input labels and output labels. Approach: We present a… Expand
1 Citations


Deep learning enables cross-modality super-resolution in fluorescence microscopy
This data-driven approach does not require numerical modeling of the imaging process or the estimation of a point-spread-function, and is based on training a generative adversarial network to transform diffraction-limited input images into super-resolved ones, and could serve to democratize super-resolution imaging. Expand
PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning
Using a deep neural network, a digital staining technique is demonstrated to transform the quantitative phase images (QPI) of label-free tissue sections into images that are equivalent to the brightfield microscopy images of the same samples that are histologically stained. Expand
Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning
It is shown that a convolutional neural network trained using a generative adversarial-network model can transform wide-field autofluorescence images of unlabelled tissue sections into images that are equivalent to the bright-field images of histologically stained versions of the same samples. Expand
Label-free prediction of three-dimensional fluorescence images from transmitted light microscopy
A label-free method for predicting three-dimensional fluorescence directly from transmitted-light images is presented and it is demonstrated that it can be used to generate multi-structure, integrated images. Expand
Deep Learning Microscopy
It is demonstrated that a deep neural network can significantly improve optical microscopy, enhancing its spatial resolution over a large field-of-view and depth of field, and can be used to design computational imagers that get better and better as they continue to image specimen and establish new transformations among different modes of imaging. Expand
In Silico Labeling: Predicting Fluorescent Labels in Unlabeled Images
It is shown that a computational machine-learning approach, which is called "in silico labeling" (ISL), reliably predicts some fluorescent labels from transmitted-light images of unlabeled fixed or live biological samples. Expand
Content-aware image restoration: pushing the limits of fluorescence microscopy
This work shows how content-aware image restoration based on deep learning extends the range of biological phenomena observable by microscopy by bypassing the trade-offs between imaging speed, resolution, and maximal light exposure that limit fluorescence imaging to enable discovery. Expand
Deep-STORM: super-resolution single-molecule microscopy by deep learning
Deep-STORM uses a deep convolutional neural network that can be trained on simulated data or experimental measurements, both of which are demonstrated, and achieves state-of-the-art resolution under challenging signal-to-noise conditions and high emitter densities. Expand
U-Net: Convolutional Networks for Biomedical Image Segmentation
It is shown that such a network can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks. Expand
Deep learning massively accelerates super-resolution localization microscopy
Simulations and experimental imaging of microtubules, nuclear pores, and mitochondria show that high-quality, super-resolution images can be reconstructed from up to two orders of magnitude fewer frames than usually needed, without compromising spatial resolution. Expand