Corpus ID: 236881204

RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecasting

  title={RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecasting},
  author={Jiachen Li and Fan Yang and Hengbo Ma and Srikanth Malla and Masayoshi Tomizuka and Chiho Choi},
  • Jiachen Li, Fan Yang, +3 authors Chiho Choi
  • Published 2021
  • Computer Science
  • ArXiv
Motion forecasting plays a significant role in various domains (e.g., autonomous driving, human-robot interaction), which aims to predict future motion sequences given a set of historical observations. However, the observed elements may be of different levels of importance. Some information may be irrelevant or even distracting to the forecasting in certain situations. To address this issue, we propose a generic motion forecasting framework (named RAIN) with dynamic key information selection… Expand
LOKI: Long Term and Key Intentions for Trajectory Prediction
The LOKI dataset is created to discover several factors that may affect intention, including i) agent’s own will, ii) social interactions, iii) environmental constraints, and iv) contextual information, and a model that jointly performs trajectory and intention prediction is proposed, showing that recurrently reasoning about intention can assist with trajectory prediction. Expand


Multiple Futures Prediction
A probabilistic framework that efficiently learns latent variables to jointly model the multi-step future motions of agents in a scene and can be used for planning via computing a conditional probability density over the trajectories of other agents given a hypothetical rollout of the ego agent. Expand
DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents
The proposed Deep Stochastic IOC RNN Encoder-decoder framework, DESIRE, for the task of future predictions of multiple interacting agents in dynamic scenes significantly improves the prediction accuracy compared to other baseline methods. Expand
Trajectron++: Multi-Agent Generative Trajectory Forecasting With Heterogeneous Data for Control
Trajectron++ is a modular, graph-structured recurrent model that forecasts the trajectories of a general number of agents with distinct semantic classes while incorporating heterogeneous data (e.g. semantic maps and camera images) and is designed to be tightly integrated with robotic planning and control frameworks. Expand
Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking
A generic generative neural system (called STG-DAT) for multi-agent trajectory prediction involving heterogeneous agents takes a step forward to explicit interaction modeling by incorporating relational inductive biases with a dynamic graph representation and leverages both trajectory and scene context information. Expand
History Repeats Itself: Human Motion Prediction via Motion Attention
An attention-based feed-forward network is introduced that explicitly leverages the observation that human motion tends to repeat itself to capture motion attention to capture the similarity between the current motion context and the historical motion sub-sequences. Expand
Continual Multi-Agent Interaction Behavior Prediction With Conditional Generative Memory
This work proposes a multi-agent interaction behavior prediction framework with a graph-neural-network-based conditional generative memory system to mitigate catastrophic forgetting and empirically shows that several approaches in literature indeed suffer from catastrophic forgetting. Expand
Conditional Generative Neural System for Probabilistic Trajectory Prediction
This paper proposes a conditional generative neural system (CGNS) for probabilistic trajectory prediction to approximate the data distribution, with which realistic, feasible and diverse future trajectory hypotheses can be sampled. Expand
Social LSTM: Human Trajectory Prediction in Crowded Spaces
This work proposes an LSTM model which can learn general human movement and predict their future trajectories and outperforms state-of-the-art methods on some of these datasets. Expand
Learning Trajectory Dependencies for Human Motion Prediction
A simple feed-forward deep network for motion prediction, which takes into account both temporal smoothness and spatial dependencies among human body joints, and design a new graph convolutional network to learn graph connectivity automatically. Expand
Convolutional Social Pooling for Vehicle Trajectory Prediction
  • Nachiket Deo, M. Trivedi
  • Computer Science
  • 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  • 2018
This paper proposes an LSTM encoder-decoder model that uses convolutional social pooling as an improvement to social Pooling layers for robustly learning interdependencies in vehicle motion and outputs a multi-modal predictive distribution over future trajectories based on maneuver classes. Expand