Yuke Zhu

Suggest Changes
Li Fei-Fei20
Abhinav Gupta16
Devi Parikh15
C. Lawrence Zitnick14
Alex Graves14
14Abhinav Gupta
14Li Fei-Fei
13Ali Farhadi
10Mario Fritz
10Zhiyong Lu

Filter Results:

  • Full text PDF available (16)

Publication Year

2012
2017
  • This year (4)
  • Last five years (18)

Publication Type

Co-author

Publication Venue

Data Set Used

Key Phrases

Learn More
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Despite progress in perceptual tasks such as image classification, computers still perform poorly on cognitive tasks such as image description and question answering. Cognition is core to tasks that involve not just recognizing, but reasoning about our visual world. However, models used to tackle the rich content in images for cognitive tasks are still… (More)
Visual7W: Grounded Question Answering in Images
We have seen great progress in basic perceptual tasks such as object recognition and detection. However, AI models still fail to match humans in high-level vision tasks due to the lack of capacities for deeper reasoning. Recently the new task of visual question answering (QA) has been proposed to evaluate a model's capacity for deep image understanding.… (More)
Action Recognition by Hierarchical Mid-Level Action Elements
Realistic videos of human actions exhibit rich spatiotemporal structures at multiple levels of granularity: an action can always be decomposed into multiple finer-grained elements in both space and time. To capture this intuition, we propose to represent videos by a hierarchy of mid-level action elements (MAEs), where each MAE corresponds to an… (More)
Scene Graph Generation by Iterative Message Passing
Understanding a visual scene goes beyond recognizing individual objects in isolation. Relationships between objects also constitute rich semantic information about the scene. In this work, we explicitly model the objects and their relationships using scene graphs, a visually-grounded graphical structure of an image. We propose a novel end-to-end model that… (More)
Reasoning about Object Affordances in a Knowledge Base Representation
Reasoning about objects and their affordances is a fundamental problem for visual intelligence. Most of the previous work casts this problem as a classification task where separate classifiers are trained to label objects, recognize attributes, or assign affordances. In this work, we consider the problem of object affordance reasoning using a knowledge base… (More)
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning
— Two less addressed issues of deep reinforcement learning are (1) lack of generalization capability to new goals, and (2) data inefficiency, i.e., the model requires several (and often costly) episodes of trial and error to converge, which makes it impractical to be applied to real-world scenarios. In this paper, we address these two issues and apply our… (More)
Modelling relational statistics with Bayes Nets
Class-level models capture relational statistics over object attributes and their connecting links, answering questions such as “what is the percentage of friendship pairs where both friends are women?” Class-level relationships are important in themselves, and they support applications like policy making, strategic planning, and query optimization. We… (More)
Building a Large-scale Multimodal Knowledge Base System for Answering Visual Queries
The complexity of the visual world creates significant challenges for comprehensive visual understanding. In spite of recent successes in visual recognition, today's vision systems would still struggle to deal with visual queries that require a deeper reasoning. We propose a knowledge base (KB) framework to handle an assortment of visual queries, without… (More)