• Corpus ID: 233423603

Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges

  title={Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges},
  author={Michael M. Bronstein and Joan Bruna and Taco Cohen and Petar Velivckovi'c},
The last decade has witnessed an experimental revolution in data science and machine learning, epitomised by deep learning methods. Indeed, many high-dimensional learning tasks previously thought to be beyond reach -- such as computer vision, playing Go, or protein folding -- are in fact feasible with appropriate computational scale. Remarkably, the essence of deep learning is built from two simple algorithmic principles: first, the notion of representation or feature learning, whereby adapted… 

Geometry-Complete Diffusion for 3D Molecule Generation

GCDM, a geometry-complete diffusion model that achieves new state-of-the-art results for 3D molecule diffusion generation by leveraging the representation learning strengths offered by GNNs that perform geometry- complete message-passing, is proposed.

Convolutional Learning on Simplicial Complexes

We propose a simplicial complex convolutional neural network (SCCNN) to learn data representations on simplicial complexes. It performs convolutions based on the multi-hop simplicial adjacencies via

A Structural Approach to the Design of Domain Specific Neural Network Architectures

This thesis aims to provide a theoretical evaluation of geometric deep learning, compiling theoretical results that characterize the properties of invariant neural networks with respect to learning performance.

Bridging Graph Position Encodings for Transformers with Weighted Graph-Walking Automata

A new graph PE is introduced, Graph Automaton PE (GAPE), based on weighted graph-walking automata (a novel extension of graph- walking automata), and it is shown that it generalizes several other PEs.

Benign Autoencoders

It is proved that BAE projects data onto a manifold whose dimension is the compressibility dimension of the learning model, and by compressing “malignant” data dimensions, BAE makes learning more stable and robust.

Neural Graph Databases

LPG2vec enables combining predictive power of the most powerful GNNs with the full scope of information encoded in the LPG model, paving the way for neural graph databases, a class of systems where the vast complexity of maintained data will benefit from modern and future graph machine learning methods.

Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps

A selector model is introduced that predicts real-time smooth saliency masks for pruned models and leverages the interpretations of a model to steer the pruning process, thereby utilizing information from both inputs and outputs of the model.

Unsupervised Representation Learning in Deep Reinforcement Learning: A Review

This review provides a comprehensive and complete overview of unsupervised representation learning in DRL by describing the main Deep Learning tools used for learning representations of the world, providing a systematic view of the method and principles, summarizing applications, benchmarks and evaluation strategies, and discussing open challenges and future directions.

Integrating Symmetry into Differentiable Planning with Steerable Convolutions

This work extends Value Iteration Networks (VINs) on using convolutional networks for path planning with additional rotation and reflection symmetry and shows that value iteration in this case is a linear equivariant operator, which is a (steerable) convolution .

Deep Normed Embeddings for Patient Representation

A novel contrastive representation learning objective and a training scheme for clinical time series that avoids the need to compute data augmentations to create similar pairs and shows how the learned embedding can be used for online patient monitoring, can supplement clinicians and improve performance of downstream machine learning tasks.