Corpus ID: 235421842

Multi-modal Scene-compliant User Intention Estimation for Navigation

  title={Multi-modal Scene-compliant User Intention Estimation for Navigation},
  author={Kavindie Katuwandeniya and Stefan H. Kiss and Lei Shi and J. V. Mir{\'o}},
A multi-modal framework to generated user intention distributions when operating a mobile vehicle is proposed in this work. The model learns from past observed trajectories and leverages traversability information derived from the visual surroundings to produce a set of future trajectories, suitable to be directly embedded into a perception-action shared control strategy on a mobile agent, or as a safety layer to supervise the prudent operation of the vehicle. We base our solution on a… Expand

Figures and Tables from this paper


Conditional Generative Neural System for Probabilistic Trajectory Prediction
This paper proposes a conditional generative neural system (CGNS) for probabilistic trajectory prediction to approximate the data distribution, with which realistic, feasible and diverse future trajectory hypotheses can be sampled. Expand
Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories With GANs
This paper proposes a novel approach for predicting the motion of pedestrians interacting with others that uses a Generative Adversarial Network to sample plausible predictions for any agent in the scene and shows that the proposed method leads to generate more diverse samples and to preserve the modes of the predictive distribution. Expand
Social LSTM: Human Trajectory Prediction in Crowded Spaces
This work proposes an LSTM model which can learn general human movement and predict their future trajectories and outperforms state-of-the-art methods on some of these datasets. Expand
End-to-End Joint Intention Estimation for Shared Control Personal Mobility Navigation
A user driven navigation framework is proposed in this work to complement end-to-end sensing-only solutions to estimate controls as joint intention from vehicle states and user inputs and is proven to be an improvement over similar strategies that rely on exteroceptive data and omit inputs from the driving agent. Expand
The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction
A new model to generate multiple plausible future trajectories, which contains novel designs of using multi-scale location encodings and convolutional RNNs over graphs, is introduced, referred to as Multiverse. Expand
Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
A recurrent sequence-to-sequence model observes motion histories and predicts future behavior, using a novel pooling mechanism to aggregate information across people, and outperforms prior work in terms of accuracy, variety, collision avoidance, and computational complexity. Expand
MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction
This work presents MultiPath, which leverages a fixed set of future state-sequence anchors that correspond to modes of the trajectory distribution, which is efficient, requiring only one forward inference pass to obtain multi-modal future distributions, and the output is parametric, allowing compact communication and analytical probabilistic queries. Expand
CoverNet: Multimodal Behavior Prediction Using Trajectory Sets
CoverNet is presented, a new method for multimodal, probabilistic trajectory prediction for urban driving that demonstrates its approach on public, real world self-driving datasets, and shows that it outperforms state-of-the-art methods. Expand
r2p2: A ReparameteRized Pushforward Policy for Diverse, Precise Generative Path Forecasting
A method to forecast a vehicle’s ego-motion as a distribution over spatiotemporal paths, conditioned on features embedded in an overhead map, and obtains expressions for the cross-entropy metrics that can be efficiently evaluated and differentiated, enabling stochastic-gradient optimization. Expand
A semi-autonomous framework for human-aware and user intention driven wheelchair mobility assistance
A semi-autonomous framework for assistive wheelchair navigation in human environments, which is driven by the intention of the wheelchair user, that is adaptable in order to be deployed in real world systems is introduced. Expand