Corpus ID: 236881204

RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecasting

  title={RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecasting},
  author={Jiachen Li and Fan Yang and Hengbo Ma and Srikanth Malla and Masayoshi Tomizuka and Chiho Choi},
  • Jiachen Li, Fan Yang, +3 authors Chiho Choi
  • Published 3 August 2021
  • Computer Science
  • ArXiv
Motion forecasting plays a significant role in various domains (e.g., autonomous driving, human-robot interaction), which aims to predict future motion sequences given a set of historical observations. However, the observed elements may be of different levels of importance. Some information may be irrelevant or even distracting to the forecasting in certain situations. To address this issue, we propose a generic motion forecasting framework (named RAIN) with dynamic key information selection… Expand
Trajectory Prediction with Linguistic Representations
A novel trajectory prediction model that uses linguistic intermediate representations to forecast trajectories, and is trained using trajectory samples with partially-annotated captions, which can aid model development and can aid in building confidence in the model before deploying it. Expand
Dyadic Human Motion Prediction
Prior work on human motion forecasting has mostly focused on predicting the future motion of single subjects in isolation from their past pose sequence. In the presence of closely interacting people,Expand
LOKI: Long Term and Key Intentions for Trajectory Prediction
The LOKI dataset is created to discover several factors that may affect intention, including i) agent’s own will, ii) social interactions, iii) environmental constraints, and iv) contextual information, and a model that jointly performs trajectory and intention prediction is proposed, showing that recurrently reasoning about intention can assist with trajectory prediction. Expand
Multi-Person Extreme Motion Prediction
Human motion prediction aims to forecast future poses given a sequence of past 3D skeletons. While this problem has recently received increasing attention, it has mostly been tackled for singleExpand
StarNet: Joint Action-Space Prediction with Star Graphs and Implicit Global Frame Self-Attention
In this work, we present a novel multi-modal multi-agent trajectory prediction architecture, focusing on map and interaction modeling using graph representation. For the purposes of map modeling, weExpand


Multiple Futures Prediction
A probabilistic framework that efficiently learns latent variables to jointly model the multi-step future motions of agents in a scene and can be used for planning via computing a conditional probability density over the trajectories of other agents given a hypothetical rollout of the ego agent. Expand
DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents
The proposed Deep Stochastic IOC RNN Encoder-decoder framework, DESIRE, for the task of future predictions of multiple interacting agents in dynamic scenes significantly improves the prediction accuracy compared to other baseline methods. Expand
Trajectron++: Multi-Agent Generative Trajectory Forecasting With Heterogeneous Data for Control
Trajectron++ is a modular, graph-structured recurrent model that forecasts the trajectories of a general number of agents with distinct semantic classes while incorporating heterogeneous data (e.g. semantic maps and camera images) and is designed to be tightly integrated with robotic planning and control frameworks. Expand
Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking
A generic generative neural system (called STG-DAT) for multi-agent trajectory prediction involving heterogeneous agents takes a step forward to explicit interaction modeling by incorporating relational inductive biases with a dynamic graph representation and leverages both trajectory and scene context information. Expand
History Repeats Itself: Human Motion Prediction via Motion Attention
An attention-based feed-forward network is introduced that explicitly leverages the observation that human motion tends to repeat itself to capture motion attention to capture the similarity between the current motion context and the historical motion sub-sequences. Expand
Continual Multi-Agent Interaction Behavior Prediction With Conditional Generative Memory
This work proposes a multi-agent interaction behavior prediction framework with a graph-neural-network-based conditional generative memory system to mitigate catastrophic forgetting and empirically shows that several approaches in literature indeed suffer from catastrophic forgetting. Expand
Multi-Agent Driving Behavior Prediction across Different Scenarios with Self-Supervised Domain Knowledge
A graph-neural-network-based framework for multi-agent interaction-aware trajectory prediction is introduced and human's prior knowledge such as the comprehension of pairwise relations between agents and pairwise context information extracted by self-supervised learning approaches are proposed to attain an effective Frenét-based representation. Expand
Conditional Generative Neural System for Probabilistic Trajectory Prediction
This paper proposes a conditional generative neural system (CGNS) for probabilistic trajectory prediction to approximate the data distribution, with which realistic, feasible and diverse future trajectory hypotheses can be sampled. Expand
Social LSTM: Human Trajectory Prediction in Crowded Spaces
This work proposes an LSTM model which can learn general human movement and predict their future trajectories and outperforms state-of-the-art methods on some of these datasets. Expand
Learning Trajectory Dependencies for Human Motion Prediction
A simple feed-forward deep network for motion prediction, which takes into account both temporal smoothness and spatial dependencies among human body joints, and design a new graph convolutional network to learn graph connectivity automatically. Expand