• Corpus ID: 3656972

Natural Language Inference over Interaction Space: ICLR 2018 Reproducibility Report

  title={Natural Language Inference over Interaction Space: ICLR 2018 Reproducibility Report},
  author={Martin Mirakyan and Karen Hambardzumyan and Hrant Khachatrian},
We have tried to reproduce the results of the paper "Natural Language Inference over Interaction Space" submitted to ICLR 2018 conference as part of the ICLR 2018 Reproducibility Challenge. Initially, we were not aware that the code was available, so we started to implement the network from scratch. We have evaluated our version of the model on Stanford NLI dataset and reached 86.38% accuracy on the test set, while the paper claims 88.0% accuracy. The main difference, as we understand it, comes… 

Figures and Tables from this paper

When data permutations are pathological: the case of neural natural language inference

It is shown that for the two central NLI corpora today, the learning process of neural systems is far too sensitive to permutations of the data.

ParaCap: paraphrase detection model using capsule network

The ParaCap model outperforms many state-of-art methods, and also proves to be comparable to other techniques by achieving the accuracy of 89.19%.

The Inception Team at NSURL-2019 Task 8: Semantic Question Similarity in Arabic

This paper describes the method for the task of Semantic Question Similarity in Arabic in the workshop on NLP Solutions for Under-Resourced Languages (NSURL), which ranks the first among nine participants teams.

Multi-Level Matching Networks for Text Matching

A multi-level matching network (MMN) is proposed in this paper for text matching, which utilizes multiple levels of word representations to obtain multiple word level matching results for final text level matching decision.

Attribute-wise Explainable Fashion Compatibility Modeling

An attribute-wise explainable FCM solution, named ExFCM, which can simultaneously generate the item-level compatibility evaluation for input fashion items and the attribute-level explanations for the evaluation result, together with reasonable explanations.



Natural Language Inference over Interaction Space

DIIN, a novel class of neural network architectures that is able to achieve high-level understanding of the sentence pair by hierarchically extracting semantic features from interaction space, shows that an interaction tensor (attention weight) contains semantic information to solve natural language inference.

A large annotated corpus for learning natural language inference

The Stanford Natural Language Inference corpus is introduced, a new, freely available collection of labeled sentence pairs, written by humans doing a novel grounded task based on image captioning, which allows a neural network-based model to perform competitively on natural language inference benchmarks for the first time.

A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference

The Multi-Genre Natural Language Inference corpus is introduced, a dataset designed for use in the development and evaluation of machine learning models for sentence understanding and shows that it represents a substantially more difficult task than does the Stanford NLI corpus.

Densely Connected Convolutional Networks

The Dense Convolutional Network (DenseNet), which connects each layer to every other layer in a feed-forward fashion, and has several compelling advantages: they alleviate the vanishing-gradient problem, strengthen feature propagation, encourage feature reuse, and substantially reduce the number of parameters.