A Comprehensive Survey on Graph Neural Networks

@article{Wu2019ACS,
  title={A Comprehensive Survey on Graph Neural Networks},
  author={Zonghan Wu and Shirui Pan and Fengwen Chen and Guodong Long and Chengqi Zhang and Philip S. Yu},
  journal={IEEE Transactions on Neural Networks and Learning Systems},
  year={2019},
  volume={32},
  pages={4-24}
}
Deep learning has revolutionized many machine learning tasks in recent years, ranging from image classification and video processing to speech recognition and natural language understanding. The data in these tasks are typically represented in the Euclidean space. However, there is an increasing number of applications, where data are generated from non-Euclidean domains and are represented as graphs with complex relationships and interdependency between objects. The complexity of graph data has… 

Survey of Graph Neural Networks and Applications

TLDR
The artificial neural networks and GNNs are reviewed, ways to extend deep learning models to deal with datasets in non-Euclidean space are presented, and the GNN-based approaches based on spectral and spatial strategies are introduced.

Graph Neural Networks: Methods, Applications, and Opportunities

TLDR
This article provides a comprehensive survey of graph neural networks (GNNs) in each learning setting: supervised, unsupervised, semi- supervised, and self-supervised learning.

Review Article Survey of Graph Neural Networks and Applications

TLDR
This study presents ways to extend deep learning models to deal with datasets in non-Euclidean space and introduces the GNN-based approaches based on spectral and spatial strategies.

Graph Neural Networks for Node-Level Predictions

TLDR
This work aims to provide an overview of early and modern graph neural network based machine learning methods for node-level prediction tasks and explains the core concepts and detailed explanations for convolutional methods that have had strong impact.

Bridging the Gap between Spatial and Spectral Domains: A Survey on Graph Neural Networks

TLDR
This paper surveys and categorizes existing GNN models into the spatial and spectral domains, and reveals connections among subcategories in each domain, and proposes a unified framework that can widely fitexisting GNNs into this framework methodologically.

Deep Learning on Graphs: A Survey

TLDR
This survey comprehensively review the different types of deep learning methods on graphs by dividing the existing methods into five categories based on their model architectures and training strategies: graph recurrent neural networks, graph convolutional networks,graph autoencoders, graph reinforcement learning, and graph adversarial methods.

Graph Deep Learning: State of the Art and Challenges

TLDR
A review of the state of graph representation learning from the perspective of deep learning and identifies four major challenges in graph deep learning: dynamic and evolving graphs, learning with edge signals and information, graph estimation, and the generalization of graph models.

Graph Neural Network and its applications

TLDR
An overview of the current research status of graph neural networks and proposed improved algorithms to further promote breakthroughs in more applications of GNNs are provided.

GraphMDN: Leveraging graph structure and deep learning to solve inverse problems

TLDR
A Graph Mixture Density Network is developed, which combines graph neural networks with mixture density network outputs and has the advantage of naturally being able to incorporate graph structured information into a neural architecture, as well as the ability to model multi-modal regression targets.
...

References

SHOWING 1-10 OF 193 REFERENCES

Deep Learning on Graphs: A Survey

TLDR
This survey comprehensively review the different types of deep learning methods on graphs by dividing the existing methods into five categories based on their model architectures and training strategies: graph recurrent neural networks, graph convolutional networks,graph autoencoders, graph reinforcement learning, and graph adversarial methods.

Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs

TLDR
This paper proposes a unified framework allowing to generalize CNN architectures to non-Euclidean domains (graphs and manifolds) and learn local, stationary, and compositional task-specific features and test the proposed method on standard tasks from the realms of image-, graph-and 3D shape analysis and show that it consistently outperforms previous approaches.

Hierarchical Graph Representation Learning with Differentiable Pooling

TLDR
DiffPool is proposed, a differentiable graph pooling module that can generate hierarchical representations of graphs and can be combined with various graph neural network architectures in an end-to-end fashion.

An End-to-End Deep Learning Architecture for Graph Classification

TLDR
This paper designs a localized graph convolution model and shows its connection with two graph kernels, and designs a novel SortPooling layer which sorts graph vertices in a consistent order so that traditional neural networks can be trained on the graphs.

Multi-dimensional Graph Convolutional Networks

TLDR
This paper proposes a multi-dimensional convolutional neural network model mGCN aiming to capture rich information in learning node-level representations formulti-dimensional graphs and demonstrates the effectiveness of the proposed framework on real-world multi- dimensional graphs.

Deep Convolutional Networks on Graph-Structured Data

TLDR
This paper develops an extension of Spectral Networks which incorporates a Graph Estimation procedure, that is test on large-scale classification problems, matching or improving over Dropout Networks with far less parameters to estimate.

How Powerful are Graph Neural Networks?

TLDR
This work characterize the discriminative power of popular GNN variants, such as Graph Convolutional Networks and GraphSAGE, and show that they cannot learn to distinguish certain simple graph structures, and develops a simple architecture that is provably the most expressive among the class of GNNs.

Large-Scale Learnable Graph Convolutional Networks

TLDR
The proposed LGCL automatically selects a fixed number of neighboring nodes for each feature based on value ranking in order to transform graph data into grid-like structures in 1-D format, thereby enabling the use of regular convolutional operations on generic graphs.

Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning

TLDR
It is shown that the graph convolution of the GCN model is actually a special form of Laplacian smoothing, which is the key reason why GCNs work, but it also brings potential concerns of over-smoothing with many convolutional layers.

Robust Spatial Filtering With Graph Convolutional Neural Networks

TLDR
A novel neural learning framework that is capable of handling both homogeneous and heterogeneous data while retaining the benefits of traditional CNN successes is proposed, which is term Graph-CNNs, which can handle both heterogeneous and homogeneous graph data.
...