NEMO: Future Object Localization Using Noisy Ego Priors

  title={NEMO: Future Object Localization Using Noisy Ego Priors},
  author={Srikanth Malla and Chiho Choi},
  journal={2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC)},
  • Srikanth MallaChiho Choi
  • Published 17 September 2019
  • Computer Science
  • 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC)
Predicting the future trajectory of agents from visual observations is an important problem for realization of safe and effective navigation of autonomous systems in dynamic environments. This paper focuses on two important aspects of future trajectory forecast which are particularly relevant for mobile platforms: 1) modeling uncertainty of the predictions, particularly from egocentric views, where uncertainty in the interactive reactions and behaviors of other agents must consider the… 

Figures and Tables from this paper

Multimodal Future Localization and Emergence Prediction for Objects in Egocentric View With a Reachability Prior

Experiments show that the reachability prior combined with multi-hypotheses learning improves multimodal prediction of the future location of tracked objects and, for the first time, the emergence of new objects.

TITAN: Future Forecast Using Action Priors

Titan (Trajectory Inference using Targeted Action priors Network), a new model that incorporates prior positions, actions, and context to forecast future trajectory of agents and future ego-motion, is introduced.

SSP: Single Shot Future Trajectory Prediction

A robust solution to future trajectory forecast, which can be practically applicable to autonomous agents in highly crowded environments and validated using the ETH, UCY, and SDD datasets and highlighted its practical functionality compared to the current state-of-the-art methods.

Multiple Trajectory Prediction of Moving Agents with Memory Augmented Networks.

This paper proposes MANTRA, a model that exploits memory augmented networks to effectively predict multiple trajectories of other agents, observed from an egocentric perspective, and shows how once trained the system can continuously improve by ingesting novel patterns.

Shared Cross-Modal Trajectory Prediction for Autonomous Driving

  • Chiho Choi
  • Computer Science
    2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2021
A Cross-Modal Embedding framework that aims to benefit from the use of multiple input modalities and learns to embed a set of complementary features in a shared latent space by jointly optimizing the objective functions across different types of input data.

DROGON: A Trajectory Prediction Model based on Intention-Conditioned Behavior Reasoning

The proposed framework for accurate vehicle trajectory prediction by considering behavioral intentions of vehicles in traffic scenes is extended to the pedestrian trajectory prediction task, showing the potential applicability toward general trajectory prediction.

On Exposing the Challenging Long Tail in Future Prediction of Traffic Actors

This paper proposes to supplement the usual loss with a loss that places challenging cases closer to each other and shows that this leads to improved performance on the challenging scenarios while the overall performance stays stable.

Indoor Future Person Localization from an Egocentric Wearable Camera

A new LSTM-based encoder-decoder framework was designed to predict the future location and movement trajectory of the targeted person in this egocentric setting and it is shown that the proposed method is able to reliably and better predict future person location and trajectory in Egocentric videos captured by the wearable camera.



Egocentric Future Localization

A method for future localization to predict plausible future trajectories of ego-motion in egocentric stereo images using first person experience of walking around in a variety of scenes to show predictive validity and apply to various real world daily activities including walking, shopping, and social interactions.

Egocentric Vision-based Future Vehicle Localization for Intelligent Driving Assistance Systems

A novel approach to simultaneously predict both the location and scale of target vehicles in the first-person (egocentric) view of an ego-vehicle using a multi-stream recurrent neural network encoder-decoder model that separately captures both object location and Scale and pixel-level observations for future vehicle localization is introduced.

SSP: Single Shot Future Trajectory Prediction

A robust solution to future trajectory forecast, which can be practically applicable to autonomous agents in highly crowded environments and validated using the ETH, UCY, and SDD datasets and highlighted its practical functionality compared to the current state-of-the-art methods.

Long-Term On-board Prediction of People in Traffic Scenes Under Uncertainty

It is argued that it is necessary to predict at least 1 second and a new model is proposed that jointly predicts ego motion and people trajectories over such large time horizons and it is shown that both sequence modeling of trajectories as well as the novel method of long term odometry prediction are essential for best performance.

High-speed autonomous navigation with motion prediction for unknown moving obstacles

An iterative planning approach that addresses vehicle navigation in dynamic environments by combining a motion prediction method which learns typical behaviours of objects in a given environment and an iterative motion planning technique based on the concept of velocity obstacles.

Looking to Relations for Future Trajectory Forecast

  • Chiho ChoiB. Dariush
  • Computer Science
    2019 IEEE/CVF International Conference on Computer Vision (ICCV)
  • 2019
A relation-aware framework for future trajectory forecast that constructs pair-wise relations from spatio-temporal interactions and identifies more descriptive relations that highly influence future motion of the target road user by considering its past trajectory is proposed.

DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents

The proposed Deep Stochastic IOC RNN Encoder-decoder framework, DESIRE, for the task of future predictions of multiple interacting agents in dynamic scenes significantly improves the prediction accuracy compared to other baseline methods.

DROGON: A Causal Reasoning Framework for Future Trajectory Forecast

This work proposes DROGON (Deep RObust Goal-Oriented trajectory prediction Network) for accurate vehicle trajectory forecast by considering behavioral intention of vehicles in traffic scenes, and builds a conditional prediction model to forecast goal-oriented trajectories.

Social Attention: Modeling Attention in Human Crowds

This work proposes Social Attention, a novel trajectory prediction model that captures the relative importance of each person when navigating in the crowd, irrespective of their proximity, and demonstrates the performance against a state-of-the-art approach on two publicly available crowd datasets.

What the Constant Velocity Model Can Teach Us About Pedestrian Motion Prediction

This work shows how neural networks for pedestrian motion prediction can be thoroughly evaluated and which research directions for neural motion prediction are promising in future and clarifies false assumptions about the problem itself.