Adaptive Video Configuration and Bitrate Allocation for Teleoperated Vehicles

  title={Adaptive Video Configuration and Bitrate Allocation for Teleoperated Vehicles},
  author={Andreas Schimpe and Simon Hoffmann and Frank Diermeyer},
  journal={2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops)},
Vehicles with autonomous driving capabilities are present on public streets. However, edge cases remain that still require a human in-vehicle driver. Assuming the vehicle manages to come to a safe state in an automated fashion, teleoperated driving technology enables a human to resolve the situation remotely by a control interface connected via a mobile network. While this is a promising solution, it also introduces technical challenges, one of them being the necessity to transmit video data of… 

Figures from this paper

Open Source Software for Teleoperated Driving
This paper presents an open source ToD software stack, which was developed for the purpose of carrying out this research, and can be deployed with minor overheads to control various vehicle systems remotely.
Taxonomy and Survey on Remote Human Input Systems for Driving Automation Systems
This paper provides a survey on recent terminologies and proposes a taxonomy for remote human input systems, classifying the different approaches based on their complexity.


ROS: an open-source Robot Operating System
This paper discusses how ROS relates to existing robot software frameworks, and briefly overview some of the available application software which uses ROS.
Image quality assessment: from error visibility to structural similarity
A structural similarity index is developed and its promise is demonstrated through a set of intuitive examples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000.
Sensor and Actuator Latency during Teleoperation of Automated Vehicles
This paper is measuring and reducing the end-to-end latency for a teleoperation setup, separated into actuator and sensor latency, and new measurement methods are developed and existing methods adapted.
5G Cross-Border Operation for Connected and Automated Mobility: Challenges and Solutions
The challenges associated to a cross-border deployment of communication technologies are introduced through the analysis of three use cases: tele-operated driving, high-definition map generation and distribution for autonomous vehicles, and anticipated cooperative collision avoidance.
Adaptive Multi-View Live Video Streaming for Teledriving Using a Single Hardware Encoder
A novel concept that uses preprocessing filters to enable individual rate/quality adaptations in the superframe video and shows that the proposed approach produces bitrates for the individual video streams which are comparable to the bitrates achieved with separate encoders.
GStreamer RTSP Server
  • Accessed on: December 6, 2020. [Online]. Available:
  • 2020
Longtime Effects of Videoquality, Videocanvases and Displays on Situation Awareness during Teleoperation of Automated Vehicles*
A five-week long-time study measuring the impact of different displays, video-canvases and -streaming quality on situation awareness, workload and decision making shows a significant impact of video streaming quality on various factors of situation awareness.
TELECARLA: An Open Source Extension of the CARLA Simulator for Teleoperated Driving Research Using Off-the-Shelf Components
An open source framework for teleoperated driving research using low-cost off-the-shelf components and an extension of the open source simulator CARLA, which is responsible for rendering the driving environment and providing reproducible scenario evaluation is proposed.
VMAF: The Journey Continues
  • Accessed on: December 18, 2020. [Online]. Available:
  • 2020
gstreamer - open source multimedia framework
  • Accessed on: November 29, 2020. [Online]. Available:
  • 2020