End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perceptions

@article{Yang2018EndtoendMM,
  title={End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perceptions},
  author={Zhengyuan Yang and Yixuan Zhang and Jerry Yu and Junjie Cai and Jiebo Luo},
  journal={2018 24th International Conference on Pattern Recognition (ICPR)},
  year={2018},
  pages={2289-2294}
}
  • Zhengyuan Yang, Yixuan Zhang, +2 authors Jiebo Luo
  • Published in
    24th International Conference…
    2018
  • Computer Science
  • Convolutional Neural Networks (CNN) have been successfully applied to autonomous driving tasks, many in an end-to-end manner. Previous end-to-end steering control methods take an image or an image sequence as the input and directly predict the steering angle with CNN. Although single task learning on steering angles has reported good performances, the steering angle alone is not sufficient for vehicle control. In this work, we propose a multi-task learning framework to predict the steering… CONTINUE READING

    Citations

    Publications citing this paper.
    SHOWING 1-10 OF 30 CITATIONS

    A Systematic Comparison of Deep Learning Architectures in an Autonomous Vehicle

    VIEW 4 EXCERPTS
    CITES BACKGROUND
    HIGHLY INFLUENCED

    Learning to Steer by Mimicking Features from Heterogeneous Auxiliary Networks

    VIEW 5 EXCERPTS
    CITES BACKGROUND & METHODS
    HIGHLY INFLUENCED

    Autonomous Driving Control Using End-to-End Deep Learning

    VIEW 1 EXCERPT
    CITES BACKGROUND

    Imitation learning for agile autonomous driving

    VIEW 3 EXCERPTS

    AI-Enabled Emotion Communication

    VIEW 1 EXCERPT
    CITES BACKGROUND

    AILiveSim: An Extensible Virtual Environment for Training Autonomous Vehicles

    VIEW 1 EXCERPT
    CITES BACKGROUND

    Accurate Trajectory Prediction for Autonomous Vehicles

    VIEW 1 EXCERPT
    CITES METHODS

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 28 REFERENCES

    End to End Learning for Self-Driving Cars

    VIEW 10 EXCERPTS
    HIGHLY INFLUENTIAL

    Brain-Inspired Cognitive Model With Attention for Self-Driving Cars

    VIEW 1 EXCERPT

    Event-Based Vision Meets Deep Learning on Steering Prediction for Self-Driving Cars

    VIEW 1 EXCERPT

    End-to-End Learning of Driving Models from Large-Scale Video Datasets

    VIEW 2 EXCERPTS

    Interpretable Learning for Self-Driving Cars by Visualizing Causal Attention

    Deep Learning

    VIEW 1 EXCERPT