Recommendations for Increasing Replicability in Psychology †

@article{Asendorpf2013RecommendationsFI,
  title={Recommendations for Increasing Replicability in Psychology †},
  author={Jens B. Asendorpf and Mark T Conner and Filip De Fruyt and Jan De Houwer and Jaap J. A. Denissen and Klaus Fiedler and Susann Fiedler and David C. Funder and Reinhold Kliegl and Brian A. Nosek and Marco Perugini and Brent W. Roberts and Manfred J. Schmitt and Marcel A. G. Aken and Hannelore Weber and Jelte M. Wicherts},
  journal={European Journal of Personality},
  year={2013},
  volume={27},
  pages={108 - 119}
}
Replicability of findings is at the heart of any empirical science. The aim of this article is to move the current replicability debate in psychology towards concrete recommendations for improvement. We focus on research practices but also offer guidelines for reviewers, editors, journal management, teachers, granting institutions, and university promotion committees, highlighting some of the emerging and existing practical solutions that can facilitate implementation of these recommendations… 

Best-Practice Guidelines for Positive Psychological Intervention Research Design

Positive psychological interventions (PPIs) have been subjected to considerable criticism in recent years. Following similar movements across other domains of psychology, attempts to replicate

It’s Time to Broaden the Replicability Conversation: Thoughts for and From Clinical Psychological Science

Why clinical psychology and allied fields, such as counseling and school psychology, have not been central participants in the replicability conversation is examined and concerns and recommendations are reviewed that are less (or more) applicable to or appropriate for research in clinical Psychology and Allied fields.

Heterogeneity of research results: New perspectives on psychological science

Replicability of research findings is a key issue in psychology, and has been the subject of considerable discussion by researchers. Replication is crucial to scientific principles, and underpins the

A Concise Set of Core Recommendations to Improve the Dependability of Psychological Research

Numerous recommendations for improving the dependability of research findings in psychological science have emerged in recent years. Unfortunately, this glut of recommendations proves problematic for

Research and Educational Practice Improving the Dependability of Research in Personality and Social Psychology : Recommendations for

In this article, the Society for Personality and Social Psychology (SPSP) Task Force on Publication and Research Practices offers a brief statistical primer and recommendations for improving the

Improving the Dependability of Research in Personality and Social Psychology

  • D. FunderJ. Levine S. West
  • Psychology
    Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc
  • 2014
A brief statistical primer and recommendations for improving the dependability of research are offered and teaching and encouraging transparency of data reporting are recommended.

Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis

It is recommended that researchers adopt open science conventions of preregi‐stration and full disclosure and that replication efforts be based on multiple studies rather than on a single replication attempt.

Replication and Reproducibility in Cross-Cultural Psychology

Replication is the scientific gold standard that enables the confirmation of research findings. Concerns related to publication bias, flexibility in data analysis, and high-profile cases of academic

Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective

A robust dialogue about the (un)reliability of psychological science findings has emerged in recent years. In response, metascience researchers have developed innovative tools to increase rigor,

Recommendations for Replication Research in Special Education

Special education researchers conduct studies that can be considered replications. However, they do not often refer to them as replication studies. The purpose of this article is to consider the
...

References

SHOWING 1-10 OF 146 REFERENCES

Reporting and Interpreting Research in PSPB: Practices, Principles, and Pragmatics

Recommendations are developed that are hoped will enhance the reporting of quantitative research in social and personality psychology and emphasize ways to increase transparency in research reports.

Psychologists Are Open to Change, yet Wary of Rules

The proposal made by Simmons, Nelson & Simonsohn (2011) is a starting point for standards for data collection and reporting practices and it is found that psychologists are generally open to change.

The persistence of underpowered studies in psychological research: causes, consequences, and remedies.

Underpowered studies persist in the psychological literature and the effects on efforts to create a cumulative science are examined and the "curse of multiplicities" plays a central role.

Teaching Replication

  • Michael C. FrankR. Saxe
  • Psychology
    Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
It is argued that students in laboratory classes should replicate recent findings as part of their training in experimental methods, and it provides object lessons about the scientific process, the importance of reporting standards, and the value of openness.

Fearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research Practice

In this methodological commentary, we use Bem's (2011) recent article reporting experimental evidence for psi as a case study for discussing important deficiencies in modal research practice in

Replication in Prevention Science

It is argued that prevention science will be better positioned to help improve public health if more replications are conducted and state-of-the art techniques are used to summarize the body of evidence on the effects of the interventions.

Investigation and Its Discontents Some Constraints on Progress in Psychological Research

This article examines a number of prom- inent trends in the conduct of psychological research and considers how they may limit progress in our field. Failure to appreciate important differences in

An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

  • Brian A. NosekD. Lakens
  • Psychology
    Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors of reproducibility in psychological science.

Replications in Psychology Research

It was found that the majority of replications in psychology journals reported similar findings to their original studies (i.e., they were successful replications), however, replications were significantly less likely to be successful when there was no overlap in authorship between the original and replicating articles.

Rewarding Replications

  • S. KooleD. Lakens
  • Psychology
    Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
This article considers psychologists’ narrative approach to scientific publications as an underlying reason for this neglect and proposes an incentive structure for replications within psychology that can be developed in a relatively simple and cost-effective manner.
...