Skip to search formSkip to main contentSkip to account menu

AI2-THOR: An Interactive 3D Environment for Visual AI

AI2-THOR consists of near photo-realistic 3D indoor scenes, where AI agents can navigate in the scenes and interact with objects to perform tasks and facilitate building visually intelligent models.
View PDF on arXiv (opens in a new tab)

RoboTHOR: An Open Simulation-to-Real Embodied AI Platform

RoboTHOR offers a framework of simulated environments paired with physical counterparts to systematically explore and overcome the challenges of simulation-to-real transfer, and a platform where researchers across the globe can remotely test their embodied models in the physical world.
View on IEEE (opens in a new tab)

ManipulaTHOR: A Framework for Visual Object Manipulation

This work proposes a framework for object manipulation built upon the physics-enabled, visually rich AI2-THOR framework and presents a new challenge to the Embodied AI community known as ArmPointNav, which extends the popular point navigation task to object manipulation and offers new challenges including 3D obstacle avoidance.
View on IEEE (opens in a new tab)

ProcTHOR: Large-Scale Embodied AI Using Procedural Generation

The proposed PROCTHOR, a framework for procedural generation of Embodied AI environments, enables us to sample arbitrarily large datasets of diverse, interactive, customizable, and performant virtual environments to train and evaluate embodied agents across navigation, interaction, and manipulation tasks.
View PDF on arXiv (opens in a new tab)

Learning Generalizable Visual Representations via Interactive Gameplay

View Paper (opens in a new tab)

Beyond Sentential Semantic Parsing: Tackling the Math SAT with a Cascade of Tree Transducers

We present an approach for answering questions that span multiple sentences and exhibit sophisticated cross-sentence anaphoric phenomena, evaluating on a rich source of such questions – the math…
View on ACL (opens in a new tab)

Artificial Agents Learn Flexible Visual Representations by Playing a Hiding Game

This work is the first to show that embodied adversarial reinforcement learning agents playing cache, a variant of hide-and-seek, in a high fidelity, interactive, environment, learn representations of their observations encoding information such as occlusion, object permanence, free space, and containment.
View PDF on arXiv (opens in a new tab)

Interactive Visualization for Linguistic Structure

The library is not tied to any particular linguistic representation, but provides a general-purpose API for the interactive exploration of hierarchical linguistic structure, and offers several important features, including expand/collapse functionality, positional and color cues, and explicit visual support for sequential structure.
View on ACL (opens in a new tab)

Iconary: A Pictionary-Based Game for Testing Multimodal Communication with Drawings and Text

This work proposes models to play Iconary, a collaborative game of drawing and guessing based on Pictionary, that poses a novel challenge for the research community and proposes models that are skillful players and able to employ world knowledge in language models toplay with words unseen during training.
View on ACL (opens in a new tab)

A Case Study in Hybrid Multi-threading and Hierarchical Reinforcement Learning Approach for Cooperative Multi-agent Systems

Experimental results show that this multi-agent system can reduce the time process and still maintain independence of agents.
View on IEEE (opens in a new tab)
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy (opens in a new tab), Terms of Service (opens in a new tab), and Dataset License (opens in a new tab)