Brain-Computer Interfaces, Virtual Reality, and Videogames

  title={Brain-Computer Interfaces, Virtual Reality, and Videogames},
  author={Anatole L{\'e}cuyer and Fabien Lotte and Richard B. Reilly and Robert Leeb and Michitaka Hirose and Mel Slater},
Major challenges must be tackled for brain-computer interfaces to mature into an established communications medium for VR applications, which will range from basic neuroscience studies to developing optimal peripherals and mental gamepads and more efficient brain-signal processing techniques. 

Figures from this paper

Intuitive Self-Paced Brain-Computer Interaction for Games
Research into Brain-Computer Interfaces for games in the shooter genre is presented and answers to the research questions about what is needed for more intuitive interaction for BCI systems are given.
BrainChat - A Collaborative Augmented Reality Brain Interface for Message Communication
  • Bojan Kerous, F. Liarokapis
  • Computer Science
    2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)
  • 2017
This paper presents BrainChat, an augmented reality based multiuser concept for brain-computer interfaces, which demonstrates two- person textual communication based on non-invasive brain computer interfaces.
BCIs and Video Games: State of the Art with the OpenViBE2 Project
This chapter describes the state of the art in the field of video games played "with the mind" and considers the results of the OpenViBE2 project : one of the most important research projects in this area.
This article presents a method of controlling video games using the EMOTIV EPOC + Neuro Headset as a controller.
Brain-Computer Interfaces and Augmented Reality: a State of the Art
This paper reviews the state of the art of using Brain-Computer Interfaces (BCIs) in combination with Augmented Reality (AR) and describes the various systems designed so far, categorized by their application field: medicine, robotics, home automation and brain activity visualization.
Neu: how brain activity can change an animated scene
In the last years the advances in animated cinema and videogames have suggested the possibility of creating virtual worlds with an high quality real-time rendering. Thus it is reasonable to think
Brain-computer interfaces for 3D games: hype or hope?
This paper elaborates on the suitability of BCI for 3D Video Games (VG), and discusses the limitations of current BCI technology, those being mainly related to usability and performances.
Actual and Imagined Movement in BCI Gaming
Research conducted to find out what the differences are between using actual and imagined movement as modalities in a BCI game shows that there are significant differences in user experience and that actual movement is a more robust way of communicating through aBCI.
Navigating in Virtual Reality using Thought: The Development and Assessment of a Motor Imagery based Brain-Computer Interface
A 3-class BCI with a rather elaborate EEG signal processing pipeline that heavily utilizes machine learning is created and it is shown that the proposed paradigm warrants further consideration as neurofeedback BCI training tool.
Using Brain-Computer Interface to control an avatar in a Virtual Reality Environment
The development of a tool that might be useful in rehabilitation, for subjects with disability, that suffer from some kind of limbs movement limitation is presented, which carries a 3D Virtual Reality Environment (VRE), which emulates the movement of a healthy person, using the immersion of the subject through an avatar.


Navigating Virtual Reality by Thought: What Is It Like?
A brain-computer interface is set up to be used as an input device to a highly immersive virtual reality CAVE-like system and the interrelations between BCI and presence are studied.
Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment
The performance of the BCI was found to be robust to distracting visual stimulation in the game and relatively consistent across six subjects, with 41 of 48 games successfully completed.
Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment
This work shows that ten naive subjects can be trained in a synchronous paradigm within three sessions to navigate freely through a virtual apartment, whereby at every junction the subjects could decide by their own, how they wanted to explore the virtual environment (VE).
Use of the evoked potential P3 component for control in a virtual apartment
  • J. Bayliss
  • Computer Science
    IEEE Transactions on Neural Systems and Rehabilitation Engineering
  • 2003
The results indicate that there are no significant differences in the P3 signal between subjects performing a task while immersed in VR versus subjects looking at a computer monitor, which indicates the robustness of the P2 signal over different environments.
Self-Paced Brain-Computer Interaction with Virtual Worlds: A Quantitative and Qualitative Study "Out of the Lab"
This paper describes the results of an evaluation of a self-paced BCI application conducted with 21 naive subjects. We studied both performances and preferences of subjects placed voluntarily in a
The Berlin Brain-Computer Interface (BBCI) – towards a new communication channel for online control in gaming applications
This contribution introduces the Berlin Brain–Computer Interface (BBCI) and presents setups where the user is provided with intuitive control strategies in plausible gaming applications that use biofeedback.
Open-ViBE: A Three Dimensional Platform for Real-Time Neuroscience
Open-ViBE is a general purpose platform for the development of three dimensional real-time virtual representations of brain physiological and anatomical data and is based on publicly available frameworks such as OpenMASK and OpenSG and is open source itself.
Learning to control brain rhythms: making a brain-computer interface possible
During a realistic, interactive, and motivationally engaging task, subjects learned to control levels of mu activity faster when it involves similar activity in both hemispheres, suggesting that while individual control of each hemisphere is possible, it requires more learning time.
Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic
The aim of the present study was to demonstrate for the first time that brain waves can be used by a tetraplegic to control movements of his wheelchair in virtual reality (VR) using a single bipolar EEG recording.