Questionable Research Practices Revisited

@article{Fiedler2016QuestionableRP,
  title={Questionable Research Practices Revisited},
  author={Klaus Fiedler and Norbert Schwarz},
  journal={Social Psychological and Personality Science},
  year={2016},
  volume={7},
  pages={45 - 52}
}
  • K. Fiedler, N. Schwarz
  • Published 1 January 2016
  • Psychology
  • Social Psychological and Personality Science
The current discussion of questionable research practices (QRPs) is meant to improve the quality of science. It is, however, important to conduct QRP studies with the same scrutiny as all research. We note problems with overestimates of QRP prevalence and the survey methods used in the frequently cited study by John, Loewenstein, and Prelec. In a survey of German psychologists, we decomposed QRP prevalence into its two multiplicative components, proportion of scientists who ever committed a… 

Figures and Tables from this paper

Editorial: Evidence on Questionable Research Practices: The Good, the Bad, and the Ugly
PurposeQuestionable research or reporting practices (QRPs) contribute to a growing concern regarding the credibility of research in the organizational sciences and related fields. Such practices
Questionable research practices among Brazilian psychological researchers: Results from a replication study and an international comparison.
TLDR
Brazilian researchers indicated a lower tendency to engage in two QRPs when compared to their Italian and North American counterparts, but indicated a higher tendency to engaging in two other QRPs.
Unfolding the Black Box of Questionable Research Practices: Where Is the Line Between Acceptable and Unacceptable Practices?
ABSTRACT Despite the extensive literature on what questionable research practices (QRPs) are and how to measure them, the normative underpinnings of such practices have remained less explored. QRPs
Ethical Shades of Gray: Questionable Research Practices in Health Professions Education
TLDR
Findings indicate that a substantial proportion of HPE researchers report a range of questionable research practices, and reforms are needed to improve the credibility and integrity of the HPE research enterprise.
Prevalence of Research Misconduct and Questionable Research Practices: A Systematic Review and Meta-Analysis.
TLDR
An updated meta-analysis that calculates the pooled estimates of research misconduct (RM) and questionable research practices (QRPs) and explores the factors associated with the prevalence of these issues, providing a better understanding of irresponsible research behaviors.
Research practices and statistical reporting quality in 250 economic psychology master's theses: a meta-research investigation
TLDR
This work investigated the statistical reporting quality and selected indicators of questionable research practices (QRPs) in psychology students' master's theses, along with statistical power, the consistency and completeness of reported results, and possible indications of p-hacking and further testing.
Questionable research practices among italian research psychologists
TLDR
The similarity of results obtained in the United States, this study, and a related study conducted in Germany suggest that adoption of these practices is an international phenomenon and is likely due to systemic features of the international research and publication processes.
Early-Career Researchers’ Perceptions of the Prevalence of Questionable Research Practices, Potential Causes, and Open Science
Young researchers of today will shape the field in the future. In light of current debates about social psychology’s research culture, this exploratory survey assessed early-career researchers’
Testing for Questionable Research Practices in a Meta-Analysis: An Example from Experimental Parapsychology
TLDR
This study demonstrates that quantitative simulations of QRPs can assess their impact, and concludes that the very significant probability cited by the Ganzfeld meta-analysis is likely inflated by QRPs, though results are still significant.
Crossing the Red Line? Empirical Evidence and Useful Recommendations on Questionable Research Practices among Business Scholars
Academic leaders in management from all over the world—including recent calls by the Academy of Management Shaw (Academy of Management Journal 60(3): 819–822, 2017)—have urged further research into
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 24 REFERENCES
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
TLDR
It is found that the percentage of respondents who have engaged in questionable practices was surprisingly high, which suggests that some questionable practices may constitute the prevailing research norm.
Ethical Norms and Moral Values Among Scientists : Applying Conceptions of Morality to Scientific Rules and Practices
The purpose of the present paper is to apply theoretical approaches to the social psychology of morality to the moral evaluation of scientists’ own behavior. It will be seen that the current
Research Practices That Can Prevent an Inflation of False-Positive Rates
  • K. Murayama, R. Pekrun, K. Fiedler
  • Psychology, Medicine
    Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc
  • 2014
TLDR
It is argued that an inflation of false-positive rates would diminish, sometimes to a substantial degree, when researchers have explicit a priori theoretical hypotheses, include multiple replication studies in a single paper, and collect additional data based on observed results.
The Long Way From α-Error Control to Validity Proper
TLDR
It is argued that, given the current state of affairs in behavioral science, false negatives often constitute a more serious problem and a scientific culture rewarding strong inference is more likely to see progress than a culture preoccupied with tightening its standards for the mere publication of original findings.
Judgment in a Social Context: Biases, Shortcomings, and the Logic of Conversation
Publisher Summary The chapter focuses on the contribution of conversational processes to the emergence of biases and shortcomings in human judgment, drawing on research in judgment and decision
Can psychology become a science
Abstract I am profoundly grateful to Tom Bouchard for helping me learn to think scientifically. Scientific thinking, which is characterized by a set of safeguards against confirmation bias, does not
A stochastic lie detector
TLDR
This work proposes an extension of Mangat’s (Journal of the Royal Statistical Society: Series B, 56, 93–95, 1994) variant of the RRT that allows for determining whether participants respond truthfully, and shows how to implement the method using both closed-form equations and easily accessible free software for multinomial processing tree models.
The Constructive, Destructive, and Reconstructive Power of Social Norms
TLDR
A field experiment in which normative messages were used to promote household energy conservation, offering an explanation for the mixed success of persuasive appeals based on social norms and suggesting how such appeals should be properly crafted.
Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research
Acknowledgements 1. Introduction Part One: Interactional Analysis 2. Using Behavioral Coding to Indentify Cognitive Problems with Survey Questions(Floyd Jackson Fowler Hr., and Charles F. Cannell) 3.
Descriptive Social Norms as Underappreciated Sources of Social Control
Böckenholt and van der Heijden’s results regarding compliance with insurance regulations—that the enforcement activities of a regulatory agency were relatively unpredictive of compliance—are
...
1
2
3
...