MolGAN: An implicit generative model for small molecular graphs
- Nicola De Cao, Thomas Kipf
- Computer SciencearXiv.org
- 30 May 2018
MolGAN is introduced, an implicit, likelihood-free generative model for small molecular graphs that circumvents the need for expensive graph matching procedures or node ordering heuris-tics of previous likelihood-based methods.
Autoregressive Entity Retrieval
- Nicola De Cao, Gautier Izacard, Sebastian Riedel, Fabio Petroni
- Computer ScienceInternational Conference on Learning…
- 2 October 2020
Entities are at the center of how we represent and aggregate knowledge. For instance, Encyclopedias such as Wikipedia are structured by entities (e.g., one per article). The ability to retrieve such…
Hyperspherical Variational Auto-Encoders
- Tim R. Davidson, Luca Falorsi, Nicola De Cao, Thomas Kipf, Jakub M. Tomczak
- Computer ScienceConference on Uncertainty in Artificial…
- 3 April 2018
This work proposes using a von Mises-Fisher distribution instead of a Gaussian distribution for both the prior and posterior of the Variational Auto-Encoder, leading to a hyperspherical latent space.
KILT: a Benchmark for Knowledge Intensive Language Tasks
- Fabio Petroni, Aleksandra Piktus, Sebastian Riedel
- Computer ScienceNorth American Chapter of the Association for…
- 4 September 2020
It is found that a shared dense vector index coupled with a seq2seq model is a strong baseline, outperforming more tailor-made approaches for fact checking, open-domain question answering and dialogue, and yielding competitive results on entity linking and slot filling, by generating disambiguated text.
Editing Factual Knowledge in Language Models
- Nicola De Cao, Wilker Aziz, Ivan Titov
- Computer ScienceConference on Empirical Methods in Natural…
- 16 April 2021
This work presents KnowledgeEditor, a method which can be used to edit factual knowledge and, thus, fix ‘bugs’ or unexpected predictions without the need for expensive re-training or fine-tuning.
Question Answering by Reasoning Across Documents with Graph Convolutional Networks
- Nicola De Cao, Wilker Aziz, Ivan Titov
- Computer ScienceNorth American Chapter of the Association for…
- 29 August 2018
A neural model which integrates and reasons relying on information spread within documents and across multiple documents is introduced, which achieves state-of-the-art results on a multi-document question answering dataset, WikiHop.
Interpreting Graph Neural Networks for NLP With Differentiable Edge Masking
- M. Schlichtkrull, Nicola De Cao, Ivan Titov
- Computer ScienceInternational Conference on Learning…
- 1 October 2020
This work introduces a post-hoc method for interpreting the predictions of GNNs which identifies unnecessary edges and uses this technique as an attribution method to analyze GNN models for two tasks -- question answering and semantic role labeling -- providing insights into the information flow in these models.
Block Neural Autoregressive Flow
- Nicola De Cao, Ivan Titov, Wilker Aziz
- Computer ScienceConference on Uncertainty in Artificial…
- 9 April 2019
Normalising flows (NFS) map two density functions via a differentiable bijection whose Jacobian determinant can be computed efficiently. Recently, as an alternative to hand-crafted bijections, Huang…
Explorations in Homeomorphic Variational Auto-Encoding
- Luca Falorsi, P. D. Haan, Taco Cohen
- Computer SciencearXiv.org
- 12 July 2018
The exper-iments show that choosing manifold-valued latent variables that match the topology of the latent data manifold, is crucial to preserve the topological structure and learn a well-behaved latent space.
How Do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking
- Nicola De Cao, M. Schlichtkrull, Wilker Aziz, Ivan Titov
- Computer ScienceConference on Empirical Methods in Natural…
- 30 April 2020
Differentiable Masking relies on learning sparse stochastic gates to completely mask-out subsets of the input while maintaining end-to-end differentiability and is used to study BERT models on sentiment classification and question answering.
...
...