Watching the watchers: bias and vulnerability in remote proctoring software

  title={Watching the watchers: bias and vulnerability in remote proctoring software},
  author={Ben Burgess and Avi Ginsberg and Edward W. Felten and Shaanan N. Cohney},
Educators are rapidly switching to remote proctoring and examination software for their testing needs, both due to the COVID-19 pandemic and the expanding virtualization of the education sector. State boards are increasingly utilizing these software for high stakes legal and medical licensing exams. Three key concerns arise with the use of these complex software: exam integrity, exam procedural fairness, and exam-taker security and privacy. We conduct the first technical analysis of each of… 

Figures and Tables from this paper



VGGFace2: A Dataset for Recognising Faces across Pose and Age

A new large-scale face dataset named VGGFace2 is introduced, which contains 3.31 million images of 9131 subjects, with an average of 362.6 images for each subject, and the automated and manual filtering stages to ensure a high accuracy for the images of each identity are described.

LightFace: A Hybrid Deep Face Recognition Framework

A review of face recognition has been done and the description of the developed lightweight hybrid high performance face recognition framework enables to switch face recognition models among state-of-the-art ones.

RetinaFace: Single-stage Dense Face Localisation in the Wild

A robust single-stage face detector, named RetinaFace, which performs pixel-wise face localisation on various scales of faces by taking advantages of joint extra-supervised and self-super supervised multi-task learning.

The Menpo Benchmark for Multi-pose 2D and 3D Facial Landmark Localisation and Tracking

An elaborate semi-automatic methodology is introduced for providing high-quality annotations for both the Menpo 2D and Menpo 3D benchmarks, two new datasets for multi-pose 2d and 3D facial landmark localisation and tracking.

Stacked Dense U-Nets with Dual Transformers for Robust Face Alignment

This work designs a novel scale aggregation network topology structure and a channel aggregation building block to improve the model's capacity without sacrificing the computational complexity and model size and shows that accurate 3D face alignment can assist pose-invariant face recognition where it achieves a new state-of-the-art accuracy on CFP-FP.

ArcFace: Additive Angular Margin Loss for Deep Face Recognition

This paper presents arguably the most extensive experimental evaluation against all recent state-of-the-art face recognition methods on ten face recognition benchmarks, and shows that ArcFace consistently outperforms the state of the art and can be easily implemented with negligible computational overhead.

OpenFace: A general-purpose face recognition library with mobile applications

It is shown that OpenFace provides near-human accuracy on the LFW benchmark and present a new classification benchmark for mobile scenarios, intended for non-experts interested in using OpenFace and provides a light introduction to the deep neural network techniques the authors use.

Deep Learning Face Attributes in the Wild

A novel deep learning framework for attribute prediction in the wild that cascades two CNNs, LNet and ANet, which are fine-tuned jointly with attribute tags, but pre-trained differently.

Face Recognition Vendor Test (FRVT)