ExtraSensory App: Data Collection In-the-Wild with Rich User Interface to Self-Report Behavior

@article{Vaizman2018ExtraSensoryAD,
  title={ExtraSensory App: Data Collection In-the-Wild with Rich User Interface to Self-Report Behavior},
  author={Yonatan Vaizman and Katherine Ellis and Gert R. G. Lanckriet and Nadir Weibel},
  journal={Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems},
  year={2018}
}
We introduce a mobile app for collecting in-the-wild data, including sensor measurements and self-reported labels describing people's behavioral context (e.g., driving, eating, in class, shower. [...] Key Method Our user interface combines past and near-future self-reporting of combinations of relevant context-labels. We deployed the app on the personal smartphones of 60 users and analyzed quantitative data collected in-the-wild and qualitative user-experience reports. The interface's flexibility was important…Expand
I Can't Be Myself
TLDR
It is argued that mounting the camera on different body locations with a different lens orientation, gives a device recording affordance that has the effect of reducing surveillance and social discomfort compared to ego-centric cameras. Expand
People Like Me
TLDR
This paper investigates how people reflect on three types of personal data when presented alongside a large set of aggregated data of multiple cohorts and discusses the implications for personal informatics systems that leverage the data of "people like me" to enable meaningful reflection. Expand
An empirical study on finding experience sampling parameters to explain sleep quality based on dimension reduction
TLDR
The number of items of self-reports is reduced in a manner of exploratory data analysis on this data and results indicate that a small number of Items which are shown to be important can be considered for consisting items ofSelf-reporting. Expand
INTOSIS: Interactive Observation of Smartphone Inferred Symptoms for In-The-Wild Data
TLDR
A visualization framework for the INTeractive Observation of Smartphone-Inferred Symptoms (INTOSIS), that supports contextualization of symptomatic days by presenting a holistic picture of complex smartphone data for analysts to find plausible explanations for the occurrence of certain symptoms. Expand
COMEX: Identifying Mislabeled Human Behavioral Context Data Using Visual Analytics
TLDR
COMEX, an interactive visual analytics tool that assists analysts in identifying instances of mislabeled context data to improve the quality of CA datasets is presented, which provides richer insights into the diverse characteristics of the target dataset. Expand
Visual Analytics of Smartphone-Sensed Human Behavior and Health
TLDR
It is postulate that interactive visual analytics (IVA) can assist data scientists during the development of such tools by facilitating the discovery and correction of wrong or missing user-provided ground-truth health annotations. Expand
Stress Annotations from Older Adults - Exploring the Foundations for Mobile ML-Based Health Assistance
TLDR
In this paper, insights into participants' stress annotation behavior are provided, a detailed analysis of the recorded data and the resulting implications regarding the annotation of stressful situations by older adults are reported on and how mobile annotation technology can benefit from the synergies with traditional methods are discussed. Expand
C2FHAR: Coarse-to-Fine Human Activity Recognition With Behavioral Context Modeling Using Smart Inertial Sensors
TLDR
This research work presents “C2FHAR”, a novel approach for coarse-to-fine human activity recognition in-the-wild, which explicitly models the user’s behavioral contexts with activities of daily living to learn and recognize the fine-grained human activities. Expand
PLEADES: Population Level Observation of Smartphone Sensed Symptoms for In-the-wild Data using Clustering
TLDR
The proposed Population Level Exploration and Analysis of smartphone DEtected Symptoms (PLEADES) is a framework to present smartphone sensed data in linked panes using intuitive data visualizations and allows analysts to contextualize the symptoms that manifest in smartphone sensor data. Expand
Using Machine Learning and Smartphone and Smartwatch Data to Detect Emotional States and Transitions: Exploratory Study
TLDR
Feature analyses show that spatiotemporal context, phone state, and motion-related information are the most informative factors for emotional state and transition detection and a strong association of daily context with emotional states and transitions is demonstrated. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 36 REFERENCES
Sensor-based observations of daily living for aging in place
TLDR
Observations of daily living about the everyday actions of individuals, if reviewed, can result in greater awareness, motivation for improving behaviors, and better-informed decision making about an individual’s health care, enabling individuals to maintain their functional abilities as they age. Expand
Recognizing Detailed Human Context in the Wild from Smartphones and Smartwatches
TLDR
The authors demonstrate how fusion of multimodal sensors is important for resolving situations that were harder to recognize and present a baseline system and encourage researchers to use their public dataset to compare methods and improve context recognition in the wild. Expand
Quantitative Study of Music Listening Behavior in a Smartphone Context
TLDR
A quantitative study of the personal, situational, and musical factors of musical preference in a smartphone context, using a new dataset comprising the listening records and self-report context annotation of 48 participants collected over 3wk via an Android app. Expand
Inferring Meal Eating Activities in Real World Settings from Ambient Sounds: A Feasibility Study
TLDR
This work describes results from a feasibility study conducted in the wild where eating activities were inferred from ambient sounds captured with a wrist-mounted device, leveraging off-the-shelf devices with audio sensing capabilities in contrast to systems for automated dietary assessment based on specialized sensors. Expand
Activity sensing in the wild: a field trial of ubifit garden
TLDR
This work has developed a system, UbiFit Garden, which uses on-body sensing and activity inference and a personal, mobile display to encourage physical activity to address the growing rate of sedentary lifestyles. Expand
Behavioral Context Recognition In the Wild
TLDR
This thesis promotes context recognition in-the-wild, capturing people's authentic behavior in their natural environments using natural, everyday devices and discusses the progress this work makes in the field of behavioral context recognition. Expand
Towards accurate non-intrusive recollection of stress levels using mobile sensing and contextual recall
TLDR
This paper proposes a contextual recall-based self- report method using mobile sensing technology that captures contextual cues including location, activity, and environmental acoustics to aid accurate recollection of stress levels and suggests that contextual recall outperforms recall- based self-report method. Expand
Harnessing Different Motivational Frames via Mobile Phones to Promote Daily Physical Activity and Reduce Sedentary Behavior in Aging Adults
TLDR
The results indicated that the three daily activity smartphone applications were sufficiently robust to significantly improve regular moderate-to-vigorous intensity physical activity and decrease leisure-time sitting during the 8-week behavioral adoption period. Expand
My Phone and Me: Understanding People's Receptivity to Mobile Notifications
TLDR
It is found that even a notification that contains important or useful content can cause disruption, and the substantial role of the psychological traits of the individuals on the response time and the disruption perceived from a notification is observed. Expand
Context Recognition In-the-Wild
TLDR
This work proposes using the multiple layer perceptron (MLP) as a multi-task model for context recognition, and evaluates context recognition on the previously published ExtraSensory Dataset, which was collected in thewild. Expand
...
1
2
3
4
...