Non-isomorphic Inter-modality Graph Alignment and Synthesis for Holistic Brain Mapping

  title={Non-isomorphic Inter-modality Graph Alignment and Synthesis for Holistic Brain Mapping},
  author={Islem Mhiri and Ahmed Nebli and Mohamed Ali Mahjoub and Islem Rekik},
Brain graph synthesis marked a new era for predicting a target brain graph from a source one without incurring the high acquisition cost and processing time of neuroimaging data. However, works on recovering a brain graph in one modality (e.g., functional brain imaging) from a brain graph in another (e.g., structural brain imaging) remain largely scarce. Besides, existing multimodal graph synthesis frameworks have several limitations. First, they mainly focus on generating graphs from the same… 
1 Citations

Figures from this paper


Brain graph synthesis by dual adversarial domain alignment and target graph prediction from a source graph
Results on morphological brain graphs synthesis showed that the proposed LG-DADA method produces better prediction accuracy and visual quality as compared to other graph synthesis methods.
Topology-Aware Generative Adversarial Network for Joint Prediction of Multiple Brain Graphs from a Single Brain Graph
This work introduces MultiGraphGAN architecture, which not only predicts multiple brain graphs from a single brain graph but also preserves the topological structure of each target graph to predict, and significantly outperformed its variants thereby showing its great potential in multi-view brain graph generation from asingle graph.
Deep EvoGraphNet Architecture For Time-Dependent Brain Graph Data Synthesis From a Single Timepoint
The EvoGraphNet architecture cascades a set of time-dependent gGANs, where each gGAN communicates its predicted brain graphs at a particular timepoint to train the next gGAN in the cascade at follow-up timepoint, and can achieve the lowest brain graph evolution prediction error using a single baseline timepoint.
Deep Representation Learning For Multimodal Brain Networks
This work proposes a novel end-to-end deep graph representation learning (Deep Multimodal Brain Networks - DMBN) to fuse multimodal brain networks and decipher the cross-modality relationship through a graph encoding and decoding process.
New Graph-Blind Convolutional Network for Brain Connectome Data Analysis
This paper proposed a method to address the problem of extracting the graph embeddings using graph convolutional network (GCN), and using multi-layer perceptron for the regression, and showed that with naive complete graph structure, GCN can get meaningful results.
Recovering Brain Structural Connectivity from Functional Connectivity via Multi-GCN Based Generative Adversarial Network
The proposed multi-GCN based generative adversarial network (MGCN-GAN) can generate reliable individual SC based on corresponding FC and implies that there may exist a common regulation between specific brain structural and functional architectures across different individuals.
GSR-Net: Graph Super-Resolution Network for Predicting High-Resolution from Low-Resolution Functional Brain Connectomes
The proposed GSR-Net framework outperformed its variants for predicting high-resolution brain functional connectomes from low-resolution connectomes and broke the symmetry of the U-Net architecture by topping it up with a graph super-resolution (GSR) layer and two graph convolutional network layers to predict a HR graph while preserving the characteristics of the LR input.
Hi-Net: Hybrid-Fusion Network for Multi-Modal MR Image Synthesis
A novel Hybrid-fusion Network (Hi-Net) is proposed for multi-modal MR image synthesis, which learns a mapping from multi- modal source images to target images, and effectively exploits the correlations among multiple modalities.
MRI Cross-Modality Image-to-Image Translation
A cross-modality generation framework that learns to generate translated modalities from given modalities in MR images by means of a deep learning model that leverages conditional generative adversarial networks (cGANs).
Joint Neuroimage Synthesis and Representation Learning for Conversion Prediction of Subjective Cognitive Decline
Experimental results show that the proposed JSRL can synthesize reasonable PET scans and is superior to several state-of-the-art methods in SCD conversion prediction.