# A Gentle Introduction to Deep Learning for Graphs

@article{Bacciu2020AGI, title={A Gentle Introduction to Deep Learning for Graphs}, author={Davide Bacciu and Federico Errica and Alessio Micheli and Marco Podda}, journal={Neural networks : the official journal of the International Neural Network Society}, year={2020}, volume={129}, pages={ 203-221 } }

## Figures and Tables from this paper

## 98 Citations

Catastrophic Forgetting in Deep Graph Networks: an Introductory Benchmark for Graph Classification

- Computer ScienceArXiv
- 2021

It is found that replay is the most effective strategy in so far, which also benefits the most from the use of regularization, and a flexible software framework is provided to reproduce the results.

Deep Learning for Graphs

- Computer ScienceINNSBDDL
- 2019

We introduce an overview of methods for learning in structured domains covering foundational works developed within the last twenty years to deal with a whole range of complex data representations,…

Probabilistic Learning on Graphs via Contextual Architectures

- Computer ScienceJ. Mach. Learn. Res.
- 2020

A novel methodology for representation learning on graph-structured data, in which a stack of Bayesian Networks learns different distributions of a vertex’s neighbourhood, finds that a broader context generally improves performances.

Ring Reservoir Neural Networks for Graphs

- Computer Science2020 International Joint Conference on Neural Networks (IJCNN)
- 2020

Machine Learning for graphs is nowadays a research topic of consolidated relevance. Common approaches in the field typically resort to complex deep neural network architectures and demanding training…

Network Representation Learning: From Traditional Feature Learning to Deep Learning

- Computer ScienceIEEE Access
- 2020

Network representation learning (NRL) is an effective graph analytics technique and promotes users to deeply understand the hidden characteristics of graph data. It has been successfully applied in…

Graph Neural Networks: Taxonomy, Advances, and Trends

- Computer ScienceACM Trans. Intell. Syst. Technol.
- 2022

A novel taxonomy for the graph neural networks is provided, and up to 327 relevant literatures are referred to to show the panorama of the graph Neural networks.

Adaptive Propagation Graph Convolutional Network

- Computer ScienceIEEE Transactions on Neural Networks and Learning Systems
- 2021

It is shown that the proposed adaptive propagation GCN (AP-GCN) achieves superior or similar results to the best proposed models so far on a number of benchmarks while requiring a small overhead in terms of additional parameters.

Deep Graph Generators: A Survey

- Computer ScienceIEEE Access
- 2021

A comprehensive survey on deep learning-based graph generation approaches is conducted and classifies them into five broad categories, namely, autoregressive, autoencoder-based, reinforcement learning- based, adversarial, and flow- based graph generators, providing the readers a detailed description of the methods in each class.

Accelerating the identification of informative reduced representations of proteins with deep learning for graphs

- Computer ScienceArXiv
- 2020

It is shown that deep graph networks are accurate and remarkably efficient, with a speedup factor as large as $10^5$ with respect to the algorithmic computation of the mapping entropy.

## References

SHOWING 1-10 OF 164 REFERENCES

Representation Learning on Graphs with Jumping Knowledge Networks

- Computer ScienceICML
- 2018

This work explores an architecture -- jumping knowledge (JK) networks -- that flexibly leverages, for each node, different neighborhood ranges to enable better structure-aware representation in graphs.

An End-to-End Deep Learning Architecture for Graph Classification

- Computer ScienceAAAI
- 2018

This paper designs a localized graph convolution model and shows its connection with two graph kernels, and designs a novel SortPooling layer which sorts graph vertices in a consistent order so that traditional neural networks can be trained on the graphs.

Fast and Deep Graph Neural Networks

- Computer ScienceAAAI
- 2020

It is shown that even without training of the recurrent connections, the architecture of small deep GNN is surprisingly able to achieve or improve the state-of-the-art performance on a significant set of tasks in the field of graphs classification.

Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning

- Computer ScienceAAAI
- 2018

It is shown that the graph convolution of the GCN model is actually a special form of Laplacian smoothing, which is the key reason why GCNs work, but it also brings potential concerns of over-smoothing with many convolutional layers.

Deep Learning on Graphs: A Survey

- Computer ScienceIEEE Transactions on Knowledge and Data Engineering
- 2022

This survey comprehensively review the different types of deep learning methods on graphs by dividing the existing methods into five categories based on their model architectures and training strategies: graph recurrent neural networks, graph convolutional networks,graph autoencoders, graph reinforcement learning, and graph adversarial methods.

Pitfalls of Graph Neural Network Evaluation

- Computer ScienceArXiv
- 2018

This paper performs a thorough empirical evaluation of four prominent GNN models and suggests that simpler GNN architectures are able to outperform the more sophisticated ones if the hyperparameters and the training procedure are tuned fairly for all models.

Graph convolutional networks: a comprehensive review

- Computer ScienceComputational Social Networks
- 2019

A comprehensive review specifically on the emerging field of graph convolutional networks, which is one of the most prominent graph deep learning models, is conducted and several open challenges are presented and potential directions for future research are discussed.

Hierarchical Graph Representation Learning with Differentiable Pooling

- Computer ScienceNeurIPS
- 2018

DiffPool is proposed, a differentiable graph pooling module that can generate hierarchical representations of graphs and can be combined with various graph neural network architectures in an end-to-end fashion.

Self-Attention Graph Pooling

- Computer ScienceICML
- 2019

This paper proposes a graph pooling method based on self-attention using graph convolution, which achieves superior graph classification performance on the benchmark datasets using a reasonable number of parameters.

Neural Network for Graphs: A Contextual Constructive Approach

- Computer ScienceIEEE Transactions on Neural Networks
- 2009

The new model allows the extension of the input domain for supervised neural networks to a general class of graphs including both acyclic/cyclic, directed/undirected labeled graphs and can realize adaptive contextual transductions, learning the mapping from graphs for both classification and regression tasks.