Forgetting What We Learned as Graduate Students: HARKing and Selective Outcome Reporting in I–O Journal Articles

  title={Forgetting What We Learned as Graduate Students: HARKing and Selective Outcome Reporting in I–O Journal Articles},
  author={Joseph J. Mazzola and Jacqueline K. Deuling},
  journal={Industrial and Organizational Psychology},
  pages={279 - 284}
With an overarching concern on how trustworthy and accurate the accumulated scientific knowledge is in industrial– organizational (I–O) psychology research, Kepes and McDaniel (2013) discuss how closely the publically or readily accessible research actually represents all completed research in I–O psychology. We share this concern and wanted to put this question to the test. Thus, in this commentary, we sought to test, through a pilot study, how much selective outcome reporting (i.e., dropping… 

When Does HARKing Hurt? Identifying When Different Types of Undisclosed Post Hoc Hypothesizing Harm Scientific Progress

Hypothesizing after the results are known, or HARKing, occurs when researchers check their research results and then add or remove hypotheses on the basis of those results without acknowledging this

Results-blind review: a masked crusader for science

ABSTRACT The organizational sciences are entering a confidence crisis where a growing number of scholars recognize our science is imperfect and our knowledge base is potentially flawed. One

On reproducibility and replicability: Arguing for open science practices and methodological improvements at the South African Journal of Industrial Psychology

Problematisation: In recent years, psychology has been going through a crisis of sorts. Research methods and practices have come under increased scrutiny, with many issues identified as negatively

Issues and Trends in Publishing Behavioral Science: A Quarrelsome Crew Struggling with a Disintegrating Boat on a Stormy Sea

Changes in societies and communication technologies are forcing universities and related post-secondary institutions to change quite significantly. Some of these institutions face threats to their

Editorial: Evidence on Questionable Research Practices: The Good, the Bad, and the Ugly

PurposeQuestionable research or reporting practices (QRPs) contribute to a growing concern regarding the credibility of research in the organizational sciences and related fields. Such practices

Honoring God through scientific research: Navigating the ethics of publishing with our students:

Scientists dedicate their careers to the quest of learning about the world through the collection and reporting of empirical data. Subsequently, practitioners apply this information in a variety of

Why and Where Do Academics Publish?

This essay describes some current and important issues that confront social and behavioral researchers and points out conflicts between doing what is methodologically correct and doing what readers expect.

Scientific Misconduct in Psychology: A Systematic Review of Prevalence Estimates and New Empirical Data

Spectacular cases of scientific misconduct have contributed to concerns about the validity of published results in psychology. In our systematic review, we identified 16 studies reporting prevalence

The Costs of HARKing

  • Mark Rubin
  • Psychology
    The British Journal for the Philosophy of Science
  • 2022
Kerr ([1998]) coined the term ‘HARKing’ to refer to the practice of ‘hypothesizing after the results are known’. This questionable research practice has received increased attention in recent years

Questionable research practices when using confirmatory factor analysis

Purpose The purpose of this paper is to describe common questionable research practices (QRPs) engaged in by management researchers who use confirmatory factor analysis (CFA) as part of their



The practitioner‐researcher divide in Industrial, Work and Organizational (IWO) psychology: Where are we now, and where do we go from here?

There is current concern that the researcher, or academic, and the practitioner wings of our discipline are moving further apart. This divergence is likely to result in irrelevant theory and in

How Trustworthy Is the Scientific Literature in Industrial and Organizational Psychology?

The trustworthiness of research findings has been questioned in many domains of science. This article calls for a review of the trustworthiness of the scientific literature in

Surveillance Is Not the Answer, and Replication Is Not a Test: Comment on Kepes and McDaniel, “How Trustworthy Is the Scientific Literature in I–O Psychology?”

Although we share Kepes and McDaniel’s (2013) concern about the state of affairs in I–O psychology, we think their emphasis on control and correction will, in the end, be counterproductive.

HARKing : Hypothesizing After the Results are Known

  • L.
  • Psychology
  • 2002
This article considers a practice in scientific communication termed HARKing (Hypothesizing After the Results are Known). HARKing is defined as presenting a post hoc hypothesis (i.e., one based on or

Organizational Theory Development: Displacement of Ends?

In this essay I argue that organization theory has witnessed a significant displacement of ends over the last 30 years. Whereas in the 1960s and 1970s the dominant goal of the discipline was

Learning the Craft of Organizational Research

This essay proposes that scholarly research is a craft and that significant research outcomes are associated with the mastery of craft elements in the research process. A tentative framework of the

Management Science on the Credibility Bubble: Cardinal Sins and Various Misdemeanors

This research-based essay presents survey results—collected from faculty in 104 PhD-granting management departments of AACSB-accredited business schools in the United States—regarding 11 different ...

A Cross-Cultural Comparison of Job Stressors and Reactions Among Employees Holding Comparable Jobs in Two Countries

The present study examined occupational stress in a cross-cultural context with a sample of female clerical employees from an Eastern and a Western culture, namely, India and the United States. An

Statistical Power Analysis for the Behavioral Sciences

  • Jacob Cohen
  • Mathematics
    The SAGE Encyclopedia of Research Design
  • 2022
Contents: Prefaces. The Concepts of Power Analysis. The t-Test for Means. The Significance of a Product Moment rs (subscript s). Differences Between Correlation Coefficients. The Test That a

Statistical Power Analysis for the Behavioral Sciences (2nd ed.)