A Gentle Introduction to Deep Learning for Graphs

@article{Bacciu2020AGI,
  title={A Gentle Introduction to Deep Learning for Graphs},
  author={Davide Bacciu and Federico Errica and Alessio Micheli and Marco Podda},
  journal={Neural networks : the official journal of the International Neural Network Society},
  year={2020},
  volume={129},
  pages={
          203-221
        }
}
Catastrophic Forgetting in Deep Graph Networks: an Introductory Benchmark for Graph Classification
TLDR
It is found that replay is the most effective strategy in so far, which also benefits the most from the use of regularization, and a flexible software framework is provided to reproduce the results.
Deep Learning for Graphs
We introduce an overview of methods for learning in structured domains covering foundational works developed within the last twenty years to deal with a whole range of complex data representations,
Probabilistic Learning on Graphs via Contextual Architectures
TLDR
A novel methodology for representation learning on graph-structured data, in which a stack of Bayesian Networks learns different distributions of a vertex’s neighbourhood, finds that a broader context generally improves performances.
Ring Reservoir Neural Networks for Graphs
Machine Learning for graphs is nowadays a research topic of consolidated relevance. Common approaches in the field typically resort to complex deep neural network architectures and demanding training
Network Representation Learning: From Traditional Feature Learning to Deep Learning
Network representation learning (NRL) is an effective graph analytics technique and promotes users to deeply understand the hidden characteristics of graph data. It has been successfully applied in
Graph Neural Networks: Taxonomy, Advances, and Trends
TLDR
A novel taxonomy for the graph neural networks is provided, and up to 327 relevant literatures are referred to to show the panorama of the graph Neural networks.
Adaptive Propagation Graph Convolutional Network
TLDR
It is shown that the proposed adaptive propagation GCN (AP-GCN) achieves superior or similar results to the best proposed models so far on a number of benchmarks while requiring a small overhead in terms of additional parameters.
Community enhanced graph convolutional networks
Deep Graph Generators: A Survey
TLDR
A comprehensive survey on deep learning-based graph generation approaches is conducted and classifies them into five broad categories, namely, autoregressive, autoencoder-based, reinforcement learning- based, adversarial, and flow- based graph generators, providing the readers a detailed description of the methods in each class.
Accelerating the identification of informative reduced representations of proteins with deep learning for graphs
TLDR
It is shown that deep graph networks are accurate and remarkably efficient, with a speedup factor as large as $10^5$ with respect to the algorithmic computation of the mapping entropy.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 164 REFERENCES
Representation Learning on Graphs with Jumping Knowledge Networks
TLDR
This work explores an architecture -- jumping knowledge (JK) networks -- that flexibly leverages, for each node, different neighborhood ranges to enable better structure-aware representation in graphs.
An End-to-End Deep Learning Architecture for Graph Classification
TLDR
This paper designs a localized graph convolution model and shows its connection with two graph kernels, and designs a novel SortPooling layer which sorts graph vertices in a consistent order so that traditional neural networks can be trained on the graphs.
Fast and Deep Graph Neural Networks
TLDR
It is shown that even without training of the recurrent connections, the architecture of small deep GNN is surprisingly able to achieve or improve the state-of-the-art performance on a significant set of tasks in the field of graphs classification.
Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning
TLDR
It is shown that the graph convolution of the GCN model is actually a special form of Laplacian smoothing, which is the key reason why GCNs work, but it also brings potential concerns of over-smoothing with many convolutional layers.
Deep Learning on Graphs: A Survey
TLDR
This survey comprehensively review the different types of deep learning methods on graphs by dividing the existing methods into five categories based on their model architectures and training strategies: graph recurrent neural networks, graph convolutional networks,graph autoencoders, graph reinforcement learning, and graph adversarial methods.
Pitfalls of Graph Neural Network Evaluation
TLDR
This paper performs a thorough empirical evaluation of four prominent GNN models and suggests that simpler GNN architectures are able to outperform the more sophisticated ones if the hyperparameters and the training procedure are tuned fairly for all models.
Graph convolutional networks: a comprehensive review
TLDR
A comprehensive review specifically on the emerging field of graph convolutional networks, which is one of the most prominent graph deep learning models, is conducted and several open challenges are presented and potential directions for future research are discussed.
Hierarchical Graph Representation Learning with Differentiable Pooling
TLDR
DiffPool is proposed, a differentiable graph pooling module that can generate hierarchical representations of graphs and can be combined with various graph neural network architectures in an end-to-end fashion.
Self-Attention Graph Pooling
TLDR
This paper proposes a graph pooling method based on self-attention using graph convolution, which achieves superior graph classification performance on the benchmark datasets using a reasonable number of parameters.
Neural Network for Graphs: A Contextual Constructive Approach
  • A. Micheli
  • Computer Science
    IEEE Transactions on Neural Networks
  • 2009
TLDR
The new model allows the extension of the input domain for supervised neural networks to a general class of graphs including both acyclic/cyclic, directed/undirected labeled graphs and can realize adaptive contextual transductions, learning the mapping from graphs for both classification and regression tasks.
...
1
2
3
4
5
...