Tanmay Gupta

Allen Institute for Artificial Intelligence
http://tanmaygupta.info/
Publications13
h-index7
Citations303
Highly Influential Citations28
Author pages are created from data sourced from our academic publisher partnerships and public sources.

Recommended Authors

  • Devi Parikh
  • 230 Publications • 27,630 Citations
  • C. L. Zitnick
  • 130 Publications • 40,882 Citations
  • Kaiming He
  • 87 Publications • 204,529 Citations
  • Piotr Dollár
  • 70 Publications • 72,380 Citations
  • Publications
  • Influence
No-Frills Human-Object Interaction Detection: Factorization, Layout Encodings, and Training Techniques
We show that for human-object interaction detection a relatively simple factorized model with appearance and layout encodings constructed from pre-trained object detectors outperforms more… Expand
Contrastive Learning for Weakly Supervised Phrase Grounding
TLDR
It is shown that phrase grounding can be learned by optimizing word-region attention to maximize a lower bound on mutual information between images and caption words. Expand
Completing 3D object shape from one depth image
TLDR
This work takes an exemplar-based approach: retrieve similar objects in a database of 3D models using view-based matching and transfer the symmetries and surfaces from retrieved models to fully automatically reconstruct a 3D model from any category. Expand
No-Frills Human-Object Interaction Detection: Factorization, Appearance and Layout Encodings, and Training Techniques
We show that with an appropriate factorization, and encodings of layout and appearance constructed from outputs of pretrained object detectors, a relatively simple model outperforms more… Expand
ViCo: Word Embeddings From Visual Co-Occurrences
TLDR
This work extracts four types of visual co-occurrences between object and attribute words from large-scale, textually-annotated visual databases like VisualGenome and ImageNet and trains a multi-task log-bilinear model that compactly encodes word ``meanings'' represented by each co- Occurrence type into a single visual word-vector. Expand
Learning Curves for Analysis of Deep Networks
TLDR
A method is proposed to robustly estimate learning curves, abstract their parameters into error and data-reliance, and evaluate the effectiveness of different parameterizations for a variety of image classification models. Expand
Towards General Purpose Vision Systems
TLDR
This work proposes a task-agnostic vision-language system that accepts an image and a natural language task description and outputs bounding boxes, confidences, and text and evaluates the system’s ability to learn multiple skills simultaneously, to perform tasks with novel skillconcept combinations, and to learn new skills efficiently and without forgetting. Expand
Imagine This! Scripts to Compositions to Videos
TLDR
This work presents the Composition, Retrieval, and Fusion Network (CRAFT), a model capable of learning knowledge from video-caption data and applying it while generating videos from novel captions, and evaluates CRAFT on semantic fidelity to caption, composition consistency, and visual quality. Expand
Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Tasks
TLDR
This paper investigates a vision-language embedding as a core representation and shows that it leads to better cross-task transfer than standard multitask learning and improves visual recognition, especially for categories that have relatively few recognition training labels but appear often in the VQA setting. Expand
3DFS: Deformable Dense Depth Fusion and Segmentation for Object Reconstruction from a Handheld Camera
TLDR
The approach is to perform dense depth map estimation for multiple views using a proposed objective function that preserves detail to perform 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Expand
...
1
2
...