• Corpus ID: 235755356

Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis

  title={Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis},
  author={Yanqiao Zhu and Hejie Cui and Lifang He and Lichao Sun and Carl Yang},
—Multimodal brain networks characterize complex connectivities among different brain regions from both structural and functional aspects and provide a new means for mental disease analysis. Recently, Graph Neural Networks (GNNs) have become a de facto model for analyzing graph-structured data. However, how to employ GNNs to extract effective representations from brain networks in multiple modalities remains rarely explored. Moreover, as brain networks provide no initial node features, how to… 

Figures and Tables from this paper

BrainGB: A Benchmark for Brain Network Analysis with Graph Neural Networks
BrainGB is presented, a benchmark for brain network analysis with GNNs and standardizes the process by summarizing brain network construction pipelines for both functional and structural neuroimaging modalities and modularizing the implementation of GNN designs.
Data-Efficient Brain Connectome Analysis via Multi-Task Meta-Learning
This paper proposes to meta-train the model on datasets of large sample sizes and transfer the knowledge to small datasets and explores two brain-network-oriented designs, including atlas transformation and adaptive task reweighing.
BrainNNExplainer: An Interpretable Graph Neural Network Framework for Brain Network based Disease Analysis
The proposed BrainNNExplainer is an interpretable GNN framework for brain network analysis mainly composed of two jointly learned modules: a backbone prediction model that is specifically designed for brain networks and an explanation generator that highlights disease-specific prominent brain network connections.
Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis
. Human brains lie at the core of complex neurobiological systems, where the neurons, circuits, and subsystems interact in enigmatic ways. Understanding the structural and functional mechanisms of


Multi-View Multi-Graph Embedding for Brain Network Clustering Analysis
This work proposes Multi-view Multi-graph Embedding M2E by stacking multi-graphs into multiple partially-symmetric tensors and using tensor techniques to simultaneously leverage the dependencies and correlations among multi-view and multi- graph brain networks.
Identifying HIV-induced subgraph patterns in brain networks with side information
Empirical studies on graph classification tasks for neurological disorders using brain networks demonstrate that subgraph patterns selected by the multi-side-view-guided subgraph selection approach can effectively boost graph classification performances and are relevant to disease diagnosis.
Multi-view Graph Embedding with Hub Detection for Brain Network Analysis
An auto-weighted framework of Multi-view Graph Embedding with Hub Detection (MVGE-HD) for brain network analysis that learns a unified graph embedding across all the views while reducing the potential influence of the hubs on blurring the boundaries between node clusters in the graph, thus leading to a clear and discriminative node clustering structure for the graph.
Multimodal analysis of functional and structural disconnection in Alzheimer's disease using multiple kernel SVM
Combined multimodal imaging data did not significantly improve classification accuracy compared to the best single measures alone and the support vector machine (SVM) algorithm ran the SVM algorithm and validated the results using leave‐one‐out cross‐validation.
Multi-View Graph Convolutional Network and Its Applications on Neuroimage Analysis for Parkinson's Disease
A deep learning method based on Graph Convolutional Networks (GCN) for fusing multiple modalities of brain images in relationship prediction which is useful for distinguishing PD cases from controls is proposed.
How Powerful are Graph Neural Networks?
This work characterize the discriminative power of popular GNN variants, such as Graph Convolutional Networks and GraphSAGE, and show that they cannot learn to distinguish certain simple graph structures, and develops a simple architecture that is provably the most expressive among the class of GNNs.
Graph Attention Networks
We present graph attention networks (GATs), novel neural network architectures that operate on graph-structured data, leveraging masked self-attentional layers to address the shortcomings of prior
Hierarchical Graph Representation Learning with Differentiable Pooling
DiffPool is proposed, a differentiable graph pooling module that can generate hierarchical representations of graphs and can be combined with various graph neural network architectures in an end-to-end fashion.
GPT-GNN: Generative Pre-Training of Graph Neural Networks
The GPT-GNN framework to initialize GNNs by generative pre-training introduces a self-supervised attributed graph generation task to pre-train a GNN so that it can capture the structural and semantic properties of the graph.
Heterogeneous Network Representation Learning: A Unified Framework with Survey and Benchmark
This work provides a generic paradigm for the systematic categorization and analysis over the merits of various existing HNE algorithms, and creates four benchmark datasets with various properties regarding scale, structure, attribute/label availability, and \etc.~from different sources towards handy and fair evaluations of H NE algorithms.