The Impact of Virtual Reality and Viewpoints in Body Motion Based Drone Teleoperation

  title={The Impact of Virtual Reality and Viewpoints in Body Motion Based Drone Teleoperation},
  author={Matteo Macchini and Manana Lortkipanidze and Fabrizio Schiano and Dario Floreano},
  journal={2021 IEEE Virtual Reality and 3D User Interfaces (VR)},
The operation of telerobotic systems can be a challenging task, requiring intuitive and efficient interfaces to enable inexperienced users to attain a high level of proficiency. Body-Machine Interfaces (BoMI) represent a promising alternative to standard control devices, such as joysticks, because they leverage intuitive body motion and gestures. It has been shown that the use of Virtual Reality (VR) and first-person view perspectives can increase the user's sense of presence in avatars… 

Figures and Tables from this paper

Personalized Human-Swarm Interaction Through Hand Motion
A machine-learning algorithm is implemented to define a personalized BodyMachine Interface (BoMI) based only on a short calibration procedure, and leaves unprecedented freedom to the user to choose between position and velocity control only based on their body motion preferences.


Data-driven body–machine interface for the accurate control of drones
A systematic methodology to identify the spontaneous gesture-based interaction strategies of naive individuals with a distant device is presented, and to exploit this information to develop a data-driven body–machine interface (BoMI) to efficiently control this device.
Toward Enhanced Teleoperation Through Embodiment
All four premises of embodiment of the robotic system leads to optimal perceptual transparency and increases task performance are supported by direct or indirect evidence in the literature, suggesting that embodiment of a remote manipulator may improve dexterous performance in telerobotics.
The role of interaction in virtual embodiment: Effects of the virtual hand representation
Results show that the sense of agency is stronger for less realistic virtual hands which also provide less mismatch between the participant's actions and the animation of the virtual hand.
Exploring Perspective Dependency in a Shared Body with Virtual Supernumerary Robotic Arms
This research evaluated the embodiment, workload, and performance of the teleoperator through the "building task" with three different view dependency modes, and presented some early outcomes as trends that might give directions for the future investigations.
First Person Experience of Body Transfer in Virtual Reality
It is shown that a first person perspective of a life-sized virtual human female body that appears to substitute the male subjects' own bodies was sufficient to generate a body transfer illusion, supporting the notion that bottom-up perceptual mechanisms can temporarily override top down knowledge resulting in a radical illusion of transfer of body ownership.
Personalized Telerobotics by Fast Machine Learning of Body-Machine Interfaces
This work autonomously learns from the user their preferred strategy to control the robot, and provides a personalized body-machine mapping, and shows that the proposed method can significantly reduce the duration of the training phase in teleoperation, thus allowing faster skill acquisition.
Human Performance Issues and User Interface Design for Teleoperated Robots
A detailed examination of more than 150 papers covering human performance issues and suggested mitigation solutions is presented, summarizes the performance decrements caused by video images bandwidth, time lags, frame rates, lack of proprioception, frame of reference, two-dimensional views, attention switches, and motion effects.
FlyJacket: An Upper Body Soft Exoskeleton for Immersive Drone Control
A soft exoskeleton, so called FlyJacket, designed for naïve users that want to control a drone with upper body gestures in an intuitive manner, which includes a motion-tracking device to monitor body movements, an arm support system to prevent fatigue, and is coupled to goggles for first-person-view from the drone perspective.
A Kinect-based natural interface for quadrotor control
The proposed NUI is used to control the Ar.Drone quadrotor and shows the naturalness and variety of gestures, compared with traditional interaction paradigms, can offer unique opportunities also for new and attracting forms of human-machine interaction.
The Sense of Embodiment in Virtual Reality
A working definition of the Sense of Embodiment is provided which states that SoE consists of three subcomponents: the sense of self-location, thesense of agency, and the senseof body ownership.