Ishan Misra

Publications56
h-index26
Citations6,428
Highly Influential Citations977
Claim Author Page
Author pages are created from data sourced from our academic publisher partnerships and public sources.

Recommended Authors

  • Ross B. Girshick
  • 120 Publications • 177,965 Citations
  • Andrew Zisserman
  • 810 Publications • 222,164 Citations
  • Kaiming He
  • 89 Publications • 237,457 Citations
  • A. Torralba
  • 363 Publications • 78,299 Citations
  • Publications
  • Influence
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
TLDR
This paper proposes an online algorithm, SwAV, that takes advantage of contrastive methods without requiring to compute pairwise comparisons, and uses a swapped prediction mechanism where it predicts the cluster assignment of a view from the representation of another view.
View PDF on arXiv
Emerging Properties in Self-Supervised Vision Transformers
TLDR
This paper questions if self-supervised learning provides new properties to Vision Transformer (ViT) that stand out compared to convolutional networks (convnets) and implements DINO, a form of self-distillation with no labels, which implements the synergy between DINO and ViTs.
View on IEEE
Cross-Stitch Networks for Multi-task Learning
TLDR
This paper proposes a principled approach to learn shared representations in Convolutional Networks using multitask learning using a new sharing unit: "cross-stitch" unit that combines the activations from multiple networks and can be trained end-to-end.
View on IEEE
Barlow Twins: Self-Supervised Learning via Redundancy Reduction
TLDR
This work proposes an objective function that naturally avoids collapse by measuring the cross-correlation matrix between the outputs of two identical networks fed with distorted versions of a sample, and making it as close to the identity matrix as possible.
View PDF on arXiv
Shuffle and Learn: Unsupervised Learning Using Temporal Order Verification
TLDR
This paper forms an approach for learning a visual representation from the raw spatiotemporal signals in videos using a Convolutional Neural Network, and shows that this method captures information that is temporally varying, such as human pose.
View via Publisher
Self-Supervised Learning of Pretext-Invariant Representations
TLDR
This work develops Pretext-Invariant Representation Learning (PIRL), a new state-of-the-art in self-supervised learning from images that learns invariant representations based on pretext tasks that substantially improves the semantic quality of the learned image representations.
View on IEEE
Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection
TLDR
This paper proposes a simple approach to generate large annotated instance datasets with minimal effort and outperforms existing synthesis approaches and when combined with real images improves relative performance by more than 21% on benchmark datasets.
View on IEEE
Visual Storytelling
TLDR
Modelling concrete description as well as figurative and social language, as provided in this dataset and the storytelling task, has the potential to move artificial intelligence from basic understandings of typical visual scenes towards more and more human-like understanding of grounded event structure and subjective expression.
View on ACL
From Red Wine to Red Tomato: Composition with Context
TLDR
This paper presents a simple method that respects contextuality in order to compose classifiers of known visual concepts and builds upon the intuition that classifiers lie in a smooth space where compositional transforms can be modeled.
View on IEEE
In Defense of Grid Features for Visual Question Answering
TLDR
This paper revisits grid features for VQA, and finds they can work surprisingly well -- running more than an order of magnitude faster with the same accuracy (e.g. if pre-trained in a similar fashion).
View on IEEE
...
...