How Well Do My Results Generalize? Comparing Security and Privacy Survey Results from MTurk, Web, and Telephone Samples
@article{Redmiles2019HowWD,
title={How Well Do My Results Generalize? Comparing Security and Privacy Survey Results from MTurk, Web, and Telephone Samples},
author={Elissa M. Redmiles and Sean Kross and Michelle L. Mazurek},
journal={2019 IEEE Symposium on Security and Privacy (SP)},
year={2019},
pages={1326-1343}
}Security and privacy researchers often rely on data collected from Amazon Mechanical Turk (MTurk) to evaluate security tools, to understand users' privacy preferences and to measure online behavior. Yet, little is known about how well Turkers' survey responses and performance on security- and privacy-related tasks generalizes to a broader population. This paper takes a first step toward understanding the generalizability of security and privacy user studies by comparing users' self-reports of… CONTINUE READING
Supplemental Presentations
Topics from this paper
29 Citations
A Typology of Perceived Triggers for End-User Security and Privacy Behaviors
- Computer Science
- SOUPS @ USENIX Security Symposium
- 2019
- 4
- PDF
How good is good enough for COVID19 apps? The influence of benefits, accuracy, and privacy on willingness to adopt
- Computer Science, Psychology
- ArXiv
- 2020
- 18
- PDF
Data Sharing in Mobile Apps — User Privacy Expectations in Europe
- Computer Science
- 2020 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW)
- 2020
- PDF
COVID-19 Contact Tracing and Privacy: Studying Opinion and Preferences
- Computer Science
- ArXiv
- 2020
- 18
- PDF
What Twitter Knows: Characterizing Ad Targeting Practices, User Perceptions, and Ad Explanations Through Users' Own Twitter Data
- Computer Science
- USENIX Security Symposium
- 2020
- PDF
Replication: No One Can Hack My Mind Revisiting a Study on Expert and Non-Expert Security Practices and Advice
- Computer Science
- SOUPS @ USENIX Security Symposium
- 2019
- 3
- PDF
Alexa, Who Am I Speaking To? Understanding Users' Ability to Identify Third-Party Apps on Amazon Alexa
- Computer Science
- ArXiv
- 2019
- 1
- PDF
References
SHOWING 1-10 OF 73 REFERENCES
Privacy Attitudes of Mechanical Turk Workers and the U.S. Public
- Computer Science
- SOUPS
- 2014
- 101
- Highly Influential
- PDF
How I Learned to be Secure: a Census-Representative Survey of Security Advice Sources and Behavior
- Computer Science
- CCS
- 2016
- 65
- PDF
Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples
- Psychology, Computer Science
- 2012
- 1,476
- PDF
Are privacy concerns a turn-off?: engagement and privacy in social networks
- Computer Science
- SOUPS
- 2012
- 71
- PDF
Separate but equal? A comparison of participants and data gathered via Amazon's MTurk, social media, and face-to-face behavioral testing
- Psychology, Computer Science
- Comput. Hum. Behav.
- 2013
- 1,059
Common (Mis)Beliefs about Memory: A Replication and Comparison of Telephone and Mechanical Turk Survey Methods
- Psychology, Medicine
- PloS one
- 2012
- 137
- Highly Influential
- PDF
Identifying patterns in informal sources of security information
- Political Science, Computer Science
- J. Cybersecur.
- 2015
- 42
- PDF
Too Much Knowledge? Security Beliefs and Protective Behaviors Among United States Internet Users
- Computer Science
- SOUPS
- 2015
- 63
- PDF