Gray (Literature) Matters: Evidence of Selective Hypothesis Reporting in Social Psychological Research

@article{Cairo2020GrayM,
  title={Gray (Literature) Matters: Evidence of Selective Hypothesis Reporting in Social Psychological Research},
  author={Athena H. Cairo and Jeffrey D. Green and Donelson R. Forsyth and Anne Behler and Tarah L Raldiris},
  journal={Personality and Social Psychology Bulletin},
  year={2020},
  volume={46},
  pages={1344 - 1362}
}
Selective reporting practices (SRPs)—adding, dropping, or altering study elements when preparing reports for publication—are thought to increase false positives in scientific research. Yet analyses of SRPs have been limited to self-reports or analyses of pre-registered and published studies. To assess SRPs in social psychological research more broadly, we compared doctoral dissertations defended between 1999 and 2017 with the publications based on those dissertations. Selective reporting… 

Figures and Tables from this paper

What’s in Your File Drawer? The Case of the Missing Null in Criminology and Criminal Justice

Analysis of scholarship in the physical, biological, and social sciences has discovered that peer-reviewed journals publish a much larger proportion of articles with statistically significant

Creative destruction in science

­Questionable Research Practices and Open Science in Quantitative Criminology

Objectives. Questionable research practices (QRPs) lead to incorrect research results and contribute to irreproducibility in science. Researchers and institutions have proposed open science practices

Make like a glass frog: In support of increased transparency in herpetology

Across many scientific disciplines, direct replication efforts and meta-analyses have fuelled concerns on the replicability of findings. Ecology and evolution are similarly affected. Investigations

DESTRUCTION THROUGH REPLICATION 1 Creative Destruction in Science

Drawing on the concept of a gale of creative destruction in a capitalistic economy, we argue that initiatives to assess the robustness of findings in the organizational literature should aim to

Learning to love the null.

  • C. Schuengel
  • Psychology
    Journal of child psychology and psychiatry, and allied disciplines
  • 2022
Children's behaviour and mental health has the power to surprise us, readers and authors of the Journal of Child Psychology and Psychiatry and laymen alike, if not for the endless variation among

1 AN EVENT-CODING ACCOUNT OF ATTITUDES

Attitudes (or opinions, preferences, biases, stereotypes) can be considered bindings of the perceptual features of the attitudes’ object to affective codes with positive or negative connotations,

An event-coding account of attitudes

This work tested the hypothesis that affective codes might “migrate” from one event file to another (i.e., effectively function as a component of one while actually being part of another), if the two files overlap in terms of other features.

THE IMPACT OF WORKPLACE DEMOCRACY ON THE PROACTIVE BEHAVIOUR OF EMPLOYEES

  • J. S. Ahmed
  • Business
    Advanced International Journal of Business, Entrepreneurship and SMEs
  • 2022
Proactive employee behaviour provides immense benefits to organisations at both macro and micro levels of analysis. Studies have suggested workplace democracy one of its significant antecedents.

Statement from the new Editor-in-Chief

The new Editor-in-Chief of the Asian Journal of Social Psychology will clarify the journal’s Aim and Scope, explain changes in the editorial policies, and introduce a couple of initiatives under planning.

References

SHOWING 1-10 OF 40 REFERENCES

Publication bias in psychological science: prevalence, methods for identifying and controlling, and implications for the use of meta-analyses.

Meta-analyses that included unpublished studies were more likely to show bias than those that did not, likely due to selection bias in unpublished literature searches, and sources of publication bias and implications for the use of meta-analysis are discussed.

The Chrysalis Effect

The issue of a published literature not representative of the population of research is most often discussed in terms of entire studies being suppressed. However, alternative sources of publication

Negative Results in European Psychology Journals

Psychologists have long speculated that the research literature is largely dominated by positive findings, but yet there is little data to justify these speculations. The present study investigates

Editors’ Introduction to the Special Section on Replicability in Psychological Science

  • H. PashlerE. Wagenmakers
  • Psychology
    Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
Although the very public problems experienced by psychology over this 2-year period are embarrassing to those of us working in the field, some have found comfort in the fact that, over the same period, similar concerns have been arising across the scientific landscape.

Consequences of Prejudice Against the Null Hypothesis

The consequences of prejudice against accepting the null hypothesis were examined through (a) a mathematical model intended to stimulate the research-publication process and (b) case studies of

Research Practices That Can Prevent an Inflation of False-Positive Rates

  • K. MurayamaR. PekrunK. Fiedler
  • Psychology
    Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc
  • 2014
It is argued that an inflation of false-positive rates would diminish, sometimes to a substantial degree, when researchers have explicit a priori theoretical hypotheses, include multiple replication studies in a single paper, and collect additional data based on observed results.

Making Research Evaluation More Transparent: Aligning Research Philosophy, Institutional Values, and Reporting

This work considers three actions that individuals and departments can take to facilitate change throughout psychological science: the development of individualized research-philosophy statements, the creation of an annotated curriculum vitae to improve the transparency of scholarly reporting, and the use of a formal evaluative system that explicitly captures behaviors that support reproducibility.

Improving the Dependability of Research in Personality and Social Psychology

  • D. FunderJ. Levine S. West
  • Psychology
    Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc
  • 2014
A brief statistical primer and recommendations for improving the dependability of research are offered and teaching and encouraging transparency of data reporting are recommended.

Estimating the reproducibility of psychological science

A large-scale assessment suggests that experimental reproducibility in psychology leaves a lot to be desired, and correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

Psychology's Renaissance

It is shown that the scientific practices of experimental psychologists have improved dramatically and is argued that meta‐analytical thinking increases the prevalence of false positives.