The Chrysalis Effect

@article{OBoyle2017TheCE,
  title={The Chrysalis Effect},
  author={Ernest H. O’Boyle and George C. Banks and Erik Gonzalez‐Mul{\'e}},
  journal={Journal of Management},
  year={2017},
  volume={43},
  pages={376 - 399}
}
The issue of a published literature not representative of the population of research is most often discussed in terms of entire studies being suppressed. However, alternative sources of publication bias are questionable research practices (QRPs) that entail post hoc alterations of hypotheses to support data or post hoc alterations of data to support hypotheses. Using general strain theory as an explanatory framework, we outline the means, motives, and opportunities for researchers to better… 

FROM THE EDITORS ADVANTAGES OF STARTING WITH THEORY

  • Psychology
  • 2017
The field of management is in a period of critical self-reflection about several issues, including the prevalence andpotentially pernicious consequences of presenting results of post-result

The Harm Done to Reproducibility by the Culture of Null Hypothesis Significance Testing.

  • T. Lash
  • Biology
    American journal of epidemiology
  • 2017
Without discarding the culture of null hypothesis significance testing and implementing these alternative methods for statistical analysis and inference, all other strategies for improving reproducibility will yield marginal gains at best.

Is there a credibility crisis in strategic management research? Evidence on the reproducibility of study findings

Recent studies report an inability to replicate previously published research, leading some to suggest that scientific knowledge is facing a credibility crisis. In this essay, we provide evidence on

Commentary: Perverse Incentives or Rotten Apples?

  • L. Bouter
  • Education
    Accountability in research
  • 2015
This article is based on the inaugural lecture of my chair on Methodology and Integrity, which was presented at VU University Amsterdam on May 2, 2014, and is submitted for publication to the Dutch and Flemish journal for management in higher education Thema.

The Crisis of Confidence in Research Findings in Psychology: Is Lack of Replication the Real Problem? Or Is It Something Else?

There have been frequent expressions of concern over the supposed failure of researchers to conduct replication studies. But the large number of meta-analyses in our literatures shows that

What Crisis? Management Researchers’ Experiences with and Views of Scholarly Misconduct

It is found that misconduct (research that was either fabricated or falsified) is not encountered often by reviewers nor editors, and there is a strong prevalence of misrepresentations (method inadequacy, omission or withholding of contradictory results, dropping of unsupported hypotheses).

HARKing's Threat to Organizational Research: Evidence From Primary and Meta‐Analytic Sources

We assessed presumed consequences of hypothesizing after results are known (HARKing) by contrasting hypothesized versus nonhypothesized effect sizes among 10 common relations in organizational

HARKing: How Badly Can Cherry-Picking and Question Trolling Produce Bias in Published Results?

The practice of hypothesizing after results are known (HARKing) has been identified as a potential threat to the credibility of research results. We conducted simulations using input values based on

"Are you gonna publish that?" Peer-reviewed publication outcomes of doctoral dissertations in psychology

Results indicate that the large majority of Ph.D. dissertation research in psychology does not get disseminated into the peer-reviewed literature, and efforts to improve the quality and “publishability” of doctoral dissertation research could benefit psychological science on multiple fronts.
...

References

SHOWING 1-10 OF 114 REFERENCES

Publication Bias in Empirical Sociological Research

Despite great attention to the quality of research methods in individual studies, if publication decisions of journals are a function of the statistical significance of research findings, the

Statistical Power and the Testing of Null Hypotheses: A Review of Contemporary Management Research and Recommendations for Future Studies

The purpose of this study is to determine how well contemporary management re-search fares on the issue of statistical power with regard to studies specifically predicting null relationships between

Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data

The hypothesis that competitive academic environments increase not only scientists' productivity but also their bias is verified, which might be observed in other countries where academic competition and pressures to publish are high.

Negative results are disappearing from most disciplines and countries

The overall frequency of positive supports has grown by over 22% between 1990 and 2007, with significant differences between disciplines and countries, which support the hypotheses that research is becoming less pioneering and/or that the objectivity with which results are produced and published is decreasing.

How Can Significance Tests Be Deinstitutionalized?

The purpose of this article is to propose possible solutions to the methodological problem of null hypothesis significance testing (NHST), which is framed as deeply embedded in the institutional

Revisiting the file drawer problem in meta‐analysis: An assessment of published and nonpublished correlation matrices.

The file drawer problem rests on the assumption that statistically non-significant results are less likely to be published in primary-level studies and less likely to be included in meta-analytic

Why Most Published Research Findings Are False

Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true.

How Trustworthy Is the Scientific Literature in Industrial and Organizational Psychology?

The trustworthiness of research findings has been questioned in many domains of science. This article calls for a review of the trustworthiness of the scientific literature in

“Positive” Results Increase Down the Hierarchy of the Sciences

These results support the scientific status of the social sciences against claims that they are completely subjective, by showing that, when they adopt a scientific approach to discovery, they differ from the natural sciences only by a matter of degree.

Presenting Post Hoc Hypotheses as A Priori: Ethical and Theoretical Issues

  • K. Leung
  • Business, Psychology
    Management and Organization Review
  • 2011
Presenting post hoc hypotheses based on empirical findings as if they had been developed a priori seems common in management papers. The pure form of this practice is likely to breach research ethics
...