The MTurkification of Social and Personality Psychology

  title={The MTurkification of Social and Personality Psychology},
  author={C. Anderson and J. Allen and C. Plante and Adele Quigley-McBride and Alison Lovett and J. Rokkum},
  journal={Personality and Social Psychology Bulletin},
  pages={842 - 850}
The potential role of brief online studies in changing the types of research and theories likely to evolve is examined in the context of earlier changes in theory and methods in social and personality psychology, changes that favored low-difficulty, high-volume studies. An evolutionary metaphor suggests that the current publication environment of social and personality psychology is a highly competitive one, and that academic survival and reproduction processes (getting a job, tenure/promotion… Expand

Figures, Tables, and Topics from this paper

Unburdening the Shoulders of Giants: A Quest for Disconnected Academic Psychology
  • Dario Krpan
  • Medicine, Psychology
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2020
It is argued that combining the two streams of psychology would result in the most significant advancement of psychological knowledge, and it is proposed that, alongside the currently existing connected psychology, disconnected psychology should be established. Expand
Improving Research on the Psychology of Sustainable Consumption: Some Considerations from an Early Career Perspective
Psychological research on sustainable consumption is developing a rich and diverse corpus of knowledge and tools, involving a broad range of disciplines. This very growth and diversity, however,Expand
A Validity-Based Framework for Understanding Replication in Psychology
  • L. Fabrigar, D. Wegener, R. Petty
  • Medicine, Psychology
  • Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc
  • 2020
This article proposes that many aspects of this pattern of results can be understood within the classic framework of four proposed forms of validity: statistical conclusion validity, internal validity, construct validity, and external validity. Expand
Research in Social Psychology Changed Between 2011 and 2016: Larger Sample Sizes, More Self-Report Measures, and More Online Studies
The debate about false positives in psychological research has led to a demand for higher statistical power. To meet this demand, researchers need to collect data from larger samples—which isExpand
Humor styles and personality: A systematic review and meta-analysis on the relations between humor styles and the Big Five personality traits
Abstract Health-promoting and health-endangering humor styles as measured with the Humor Styles Questionnaire have been repeatedly associated with personality traits. Yet, a comprehensiveExpand
MTurk participants have substantially lower evaluative subjective well-being than other survey participants
A surprising finding was that MTurk participants' Ladder scores were substantial lower than the other two samples, and patterns of demographic-well-being associations were similar within the samples. Expand
Race-based biases in judgments of social pain
Abstract Six studies tested the hypothesis that evaluators judge Black people less sensitive to social pain than White people. Social pain was operationalized as the psychological distress caused byExpand
RUNNING HEAD: POSITIVE EMOTIONS AND THE TRANSITION TO PARENTHOOD New Parental Positivity: The Role of Positive Emotions in Promoting Relational Adjustment During the Transition to Parenthood
The transition to parenthood can be a challenging time for new parent couples, as a baby comes with changes and stress that can negatively influence new parents’ relational functioning in the form ofExpand
What Do Undergraduate Students Learn From Participating in Psychological Research?
Researchers often rely on undergraduate students to participate in psychological studies and so ethical guidelines state that there must be educational value to their participation. In previousExpand
Likert, slider, or text? reassurances about response format effects
Abstract Few experiments in the domain of addictive behaviors address how response format might impact self-reports of drug use, drug problems, or their correlates. In a preregistered study,Expand


Publication Trends in JPSP: A Three-Decade Review
To examine recent changes in research and publication practices, the authors systematically compared articles published in the Journal of Personality and Social Psychology during 1 968, 1978, andExpand
Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples
MTurk offers a highly valuable opportunity for data collection, and it is recommended that researchers using MTurk include screening questions that gauge attention and language comprehension, avoid questions with factual answers, and consider how individual differences in financial and social domains may influence results. Expand
Fifty Days an MTurk Worker: The Social and Motivational Context for Amazon Mechanical Turk Workers
  • G. B. Schmidt
  • Sociology
  • Industrial and Organizational Psychology
  • 2015
The focal article of Landers and Behrend (2015) persuasively argues that universally condemning potential convenience data sources outside of traditional industrial–organizational (I-O) samples suchExpand
A Convenient Solution: Using MTurk To Sample From Hard-To-Reach Populations
We agree with Landers and Behrend's (2015) proposition that Amazon's Mechanical Turk (MTurk) may provide great opportunities for organizational research samples. However, some groups areExpand
Caution! MTurk Workers Ahead—Fines Doubled
There is only scant evidence demonstrating that online sources can provide usable data for organizational research and that there is a need for further research evaluating the validity of these new sources of data. Expand
Amazon Mechanical Turk in Organizational Psychology: An Evaluation and Practical Recommendations
PurposeAmazon Mechanical Turk is an increasingly popular data source in the organizational psychology research community. This paper presents an evaluation of MTurk and provides a set of practicalExpand
Best research practices in psychology: Illustrating epistemological and pragmatic considerations with the case of relationship science.
This article contrasts the false-positives-reduction (FPR) approach with an alternative, the error balance (EB) approach, which argues that any serious consideration of optimal scientific practice must contend simultaneously with both false-positive and false-negative errors. Expand
On the scientific superiority of conceptual replications for scientific progress
Abstract There is considerable current debate about the need for replication in the science of social psychology. Most of the current discussion and approbation is centered on direct or exactExpand
Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants
In three online studies, participants from MTurk and collegiate populations participated in a task that included a measure of attentiveness to instructions (an instructional manipulation check: IMC), and MTurkers were more attentive to the instructions than were college students, even on novel IMCs. Expand
An Inconvenient Truth: Arbitrary Distinctions Between Organizational, Mechanical Turk, and Other Convenience Samples
Sampling strategy has critical implications for the validity of a researcher's conclusions. Despite this, sampling is frequently neglected in research methods textbooks, during the research designExpand