How Well Do My Results Generalize? Comparing Security and Privacy Survey Results from MTurk, Web, and Telephone Samples

  title={How Well Do My Results Generalize? Comparing Security and Privacy Survey Results from MTurk, Web, and Telephone Samples},
  author={Elissa M. Redmiles and Sean Kross and Michelle L. Mazurek},
  journal={2019 IEEE Symposium on Security and Privacy (SP)},
  • Elissa M. Redmiles, Sean Kross, Michelle L. Mazurek
  • Published 2019
  • Computer Science
  • 2019 IEEE Symposium on Security and Privacy (SP)
  • Security and privacy researchers often rely on data collected from Amazon Mechanical Turk (MTurk) to evaluate security tools, to understand users' privacy preferences and to measure online behavior. Yet, little is known about how well Turkers' survey responses and performance on security- and privacy-related tasks generalizes to a broader population. This paper takes a first step toward understanding the generalizability of security and privacy user studies by comparing users' self-reports of… CONTINUE READING
    29 Citations

    Topics from this paper

    A Typology of Perceived Triggers for End-User Security and Privacy Behaviors
    • 4
    • PDF
    Poli-see: An Interactive Tool for Visualizing Privacy Policies
    Data Sharing in Mobile Apps — User Privacy Expectations in Europe
    • PDF
    COVID-19 Contact Tracing and Privacy: Studying Opinion and Preferences
    • 18
    • PDF
    What Twitter Knows: Characterizing Ad Targeting Practices, User Perceptions, and Ad Explanations Through Users' Own Twitter Data
    • PDF
    Replication: No One Can Hack My Mind Revisiting a Study on Expert and Non-Expert Security Practices and Advice
    • 3
    • PDF
    Digital Words: Moving Forward with Measuring the Readability of Online Texts


    Privacy Attitudes of Mechanical Turk Workers and the U.S. Public
    • 101
    • Highly Influential
    • PDF
    Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples
    • 1,476
    • PDF
    Facebook privacy settings: Who cares?
    • 504
    Common (Mis)Beliefs about Memory: A Replication and Comparison of Telephone and Mechanical Turk Survey Methods
    • 137
    • Highly Influential
    • PDF
    Identifying patterns in informal sources of security information
    • 42
    • PDF