Collaborative brain-computer interfaces for the automatic classification of images

  title={Collaborative brain-computer interfaces for the automatic classification of images},
  author={Ana Matran-Fernandez and Riccardo Poli and Caterina Cinel},
  journal={2013 6th International IEEE/EMBS Conference on Neural Engineering (NER)},
In this paper, we propose a collaborative brain-computer interface for the automatic discrimination of images containing specific targets. When a user looks at a stream of images that are displayed using the rapid serial visual presentation protocol, images containing targets elicit a P300 event-related potential that can be detected. This allows the images to be automatically labelled as targets and non-targets. While this is relatively unreliable with single users, by combining the evidence… 

Figures from this paper

Collaborative brain-computer interfaces for target localisation in rapid serial visual presentation

A 2-user collaborative brain-computer interface is proposed that exploits the N2pc event-related potential for the automatic localisation of specific lateral targets in real aerial images displayed by means of the rapid serial visual presentation technique at speeds of 5-15 Hz.

CES-531: Collaborative Brain-Computer Interfaces for Target Detection and Localisation in Rapid Serial Visual Presentation

The rapid serial visual presentation protocol can be used to show images sequentially on the same spatial location at high presentation rates and it is found that this second system allows not just to say if a target is in on the left or the right of an image, but to also recover the target's approximate horizontal position.

A collaborative Brain-Computer Interface for improving group detection of visual targets in complex natural environments

A much harder target detection task where observers are presented with complex natural scenes where targets are very difficult to identify and physiological features representing eye movements and eye blinks of participants in the period preceding their decisions are complemented.

Towards the automated localisation of targets in rapid image-sifting by collaborative brain-computer interfaces

A single-trial target-localisation collaborative Brain-Computer Interface (cBCI) is proposed that exploits this ERP to automatically approximate the horizontal position of targets in aerial images and suggests that BCIs for automated triaging can be improved by integrating two classification systems: one devoted to target detection and another to detect the attentional shifts associated with lateral targets.

Brain–Computer Interfaces for Detection and Localization of Targets in Aerial Images

The N2pc is elicited during RSVP presentation of real complex images and contains analogue information that can be used to roughly infer the horizontal position of targets within an image and should be taken into account when creating collaborative brain–computer interfaces.

A collaborative Brain-Computer Interface to improve human performance in a visual search task

This paper uses a collaborative brain-computer interface to integrate the decision confidence of multiple non-communicating observers as a mechanism to improve group decisions and uses spatial CSP filters instead of the spatio-temporal PCA, resulting in a significant reduction in the number of features and free parameters used in the system.

Enhancement of Group Perception via a Collaborative Brain–Computer Interface

Results show that LTCCSP neural features, response times, and eye movement features significantly improve the accuracy of the cBCI over what the authors achieved with previous systems, paving the way to a variety of real-world applications of cBCIs where reducing decision errors is vital.

A Cross-Session Dataset for Collaborative Brain-Computer Interfaces Based on Rapid Serial Visual Presentation

Results in data evaluation indicate that adequate signal processing algorithms can greatly enhance the cross-session BCI performance in both individual and collaborative conditions and can be used for developing more efficient algorithms to enhance performance and practicality of a collaborative RSVP-based BCI system.

Anytime collaborative brain–computer interfaces for enhancing perceptual group decision-making

In the two test environments, groups assisted by collaborative Brain-Computer Interfaces make both more accurate and faster decisions than when individual decisions are integrated in more traditional manners.

Anytime Collaborative Brain-Computer Interfaces for Enhancing Group Decision-Making in Realistic Environments

Collaborative Brain-Computer Interfaces that can significantly increase both the speed and the accuracy of group decision-making in realistic situations are presented and tested.



Multi-brain fusion and applications to intelligence analysis

It is shown that the integration of information in EEGs collected from multiple operators results in performance improvements compared to the single-operator case.

Cortically coupled computer vision for rapid image search

The approach leverages the highly robust and invariant object recognition capabilities of the human visual system, using single-trial EEG analysis to efficiently detect neural signatures correlated with the recognition event.

Improving decision-making based on visual perception via a collaborative brain-computer interface

  • R. PoliC. CinelF. SepulvedaA. Stoica
  • Computer Science, Psychology
    2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA)
  • 2013
Results indicate that the integration of behavioural responses and neural features can significantly improve accuracy when compared with individual performance and within groups of each size, decision rules based on such features outperform the majority.

A two-stage model for multiple target detection in rapid serial visual presentation.

  • M. ChunM. Potter
  • Psychology
    Journal of experimental psychology. Human perception and performance
  • 1995
Results of Experiments 3-5 confirmed that AB is triggered by local interference from immediate posttarget stimulation and showed thatAB is modulated by the discriminability between the 1st target and the immediately following distractor.

A low-bandwidth graphical user interface for high-speed triage of potential items of interest in video imagery

A user interface for rapid human-in-the-loop analysis and detection of "threats" in high-bandwidth imagery and video from a list of “Items of Interest” (IOI), which includes objects, targets and events that the human is interested in detecting and identifying.

Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials.

The duration of the attentional blink in natural scenes depends on stimulus category

Study on an online collaborative BCI to accelerate response to visual targets

An online collaborative BCI is developed to accelerate human response to visual target stimuli by detecting multi-subjects' visual evoked potentials (VEPs) and achieving significantly enhanced accuracies at 120 ms after the target onset.

A Collaborative Brain-Computer Interface for Improving Human Performance

  • Yijun WangT. Jung
  • Computer Science
    PloS one
  • 2011
Results suggest that a collaborative BCI can effectively fuse brain activities of a group of people to improve the overall performance of natural human behavior.

Brain–computer interfaces for communication and control