Corpus ID: 235694283

Investigating the Reliability of Self-report Survey in the Wild: The Quest for Ground Truth

  title={Investigating the Reliability of Self-report Survey in the Wild: The Quest for Ground Truth},
  author={Nan Gao and Mohammad Saiedur Rahaman and Wei Shao and Flora D. Salim},
Inferring human mental state (e.g., emotion, depression, engagement) with sensing technology is one of the most valuable challenges in the affective computing area, which has a profound impact in all industries interacting with humans. The self-report survey is the most common way to quantify how people think, but prone to subjectivity and various responses bias. It is usually used as the ground truth for human mental state prediction. In recent years, many data-driven machine learning models… Expand

Figures from this paper


n-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild.
The n-Gage is presented, a student engagement sensing system using a combination of sensors from wearables and environments to automatically detect student in-class multidimensional learning engagement and can accurately predict multiddimensional student engagement in real-world scenarios. Expand
Unobtrusive Assessment of Students' Emotional Engagement during Lectures Using Electrodermal Activity Sensors
This paper shows that off-the-shelf wearable devices can be used to unobtrusively monitor the emotional engagement of students during lectures and proposes the use of several novel features to capture students' momentary engagement. Expand
Investigating self-reporting behavior in long-term studies
A six-week self-reporting study on smartphone usage was conducted in order to investigate the accuracy of self-reported information, and logged data was used as ground truth to compare the subjects' reports against. Expand
Prediction of Mood Instability with Passive Sensing
This study used passively sensed data from smartphones and wearables and machine learning techniques to predict mood instabilities, an important aspect of mental health, and explored the effectiveness of the proposed method on two large-scale datasets. Expand
Can People Self-Report Security Accurately?: Agreement Between Self-Report and Behavioral Measures
It is found that a relatively small number of behaviors -- mostly related to tasks that require users to take a specific, regular action -- have non-zero correlations and suggest that security research based on self-report is only reliable for certain behaviors. Expand
StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones
A Dartmouth term lifecycle is identified in the data that shows students start the term with high positive affect and conversation levels, low stress, and healthy sleep and daily activity patterns, while stress appreciably rises while positive affect, sleep, conversation and activity drops off. Expand
Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing
  • Rui Wang, Weichen Wang, +4 authors A. Campbell
  • Psychology, Computer Science
  • Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.
  • 2018
A new approach to predicting depression using passive sensing data from students' smartphones and wearables is proposed and it is shown that symptom features derived from phone and wearable sensors can predict whether or not a student is depressed on a week by week basis. Expand
Understanding occupants' behaviour, engagement, emotion, and comfort indoors with heterogeneous sensors and wearables
A field study at a K-12 private school in the suburbs of Melbourne, Australia, studying the daily behaviours and engagement of high school students using heterogeneous methods led to the creation of predictive models of occupants’ use of room air-conditioners in schools. Expand
Engagement in video and audio narratives: contrasting self-report and physiological measures
Although participants self-reported greater involvement for watching video relative to listening to auditory scenes, stronger physiological responses were recorded for auditory stories, suggesting that the stories were more cognitively and emotionally engaging at a physiological level when presented in an auditory format. Expand
The Measurement of Student Engagement: A Comparative Analysis of Various Methods and Student Self-report Instruments
One of the challenges with research on student engagement is the large variation in the measurement of this construct, which has made it challenging to compare findings across studies. This chapterExpand