Needed: A Ban on the Significance Test

@article{Hunter1997NeededAB,
  title={Needed: A Ban on the Significance Test},
  author={John Edward Hunter},
  journal={Psychological Science},
  year={1997},
  volume={8},
  pages={3 - 7}
}
  • J. Hunter
  • Published 1997
  • Psychology
  • Psychological Science
The significance test as currently used is a disaster Whereas most researchers falsely believe that the significance test has an error rate of 5%, empirical studies show the average error rate across psychology is 60%–12 times higher than researchers think it to be The error rate for inference using the significance test is greater than the error rate using a coin toss to replace the empirical study The significance test has devastated the research review process Comprehensive reviews cite… Expand
Significance Tests Harm Progress in Forecasting
Based on a summary of prior literature, I conclude that tests of statistical significance harm scientific progress. Efforts to find exceptions to this conclusion have, to date, turned up none. EvenExpand
4-1-2007 Significance Tests Harm Progress in Forecasting
Based on a summary of prior literature, I conclude that tests of statistical significance harm scientific progress. Efforts to find exceptions to this conclusion have, to date, turned up none. EvenExpand
The Roles of Statistical Significance Testing In Research
The research methodology literature in recent years has included a full frontal assault on statistical significance testing. The purpose of this paper is to promote the position that, whileExpand
The Insignificance of Null Hypothesis Significance Testing
The current method of hypothesis testing in the social sciences is under intense criticism, yet most political scientists are unaware of the important issues being raised. Criticisms focus on theExpand
The Rise of Statistical Significance Testing in Public Administration Research and Why This Is a Mistake
ABSTRACT:The growth of statistical significance testing in articles published in the Public Administration Review for the period 1945 through 2008 is examined. Comparisons with sister journals, theExpand
Marketing Papers Wharton School April 2007 Significance Tests Harm Progress in Forecasting
Based on a summary of prior literature, I conclude that tests of statistical significance harm scientific progress. Efforts to find exceptions to this conclusion have, to date, turned up none. EvenExpand
A Quantitative Method for Substantive Robustness Assessment
Empirical political science is not simply about reporting evidence; it is also about coming to conclusions on the basis of that evidence and acting on those conclusions. But whether a result isExpand
2 Significance Tests Harm Progress in Forecasting
I summarize prior literature that concludes that tests of statistical significance harm scientific progress. Efforts to find exceptions to this conclusion have, to date, turned up none. Even whenExpand
Caveats for using statistical significance tests in research assessments
This article raises concerns about the advantages of using statistical significance tests in research assessments as has recently been suggested in the debate about proper normalization proceduresExpand
Null hypothesis significance testing. On the survival of a flawed method.
  • J. Krueger
  • Psychology, Medicine
  • The American psychologist
  • 2001
TLDR
The criticisms of NHST are reviewed and it is shown that the criticisms address the logical validity of inferences arising from NHST, whereas the defenses stress the pragmatic value of these inferences. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 10 REFERENCES
The earth is round (p < .05)
After 4 decades of severe criticism, the ritual of null hypothesis significance testing (mechanical dichotomous decisions around a sacred .05 criterion) still persists. This article reviews theExpand
Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of Researchers
Data analysis methods in psychology still emphasize statistical significance testing, despite numerous articles demonstrating its severe deficiencies. It is now possible to use meta-analysis to showExpand
Do studies of statistical power have an effect on the power of studies
The long-term impact of studies of statistical power is investigated using J. Cohen's (1962) pioneering work as an example. We argue that the impact is nil; the power of studies in the same journalExpand
THINGS I HAVE LEARNED (SO FAR)
This is an account of what I have learned (so far) about the application of statistics to psychology and the other sociobiomedical sciences. It includes the principles "less is more" (fewerExpand
The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis.
TLDR
Although meta-analysis has limitations, there are good reasons to believe that its results are more credible than those of conventional reviews and to conclude that well-developed psychological, educational, and behavioral treatment is generally efficacious. Expand
The statistical power of abnormal-social psychological research: a review.
  • J. Cohen
  • Psychology, Medicine
  • Journal of abnormal and social psychology
  • 1962
Thmgs I have levned
  • 1990
Thmgs I have levned (so fir) Ammcan PsydaOogist 45 1304-1312 rafor««nai(oricw«cliat Psydtok^iadMt^wis
  • 1990
DottoAetofttitabcilpowe tfae power of HuAes'' I'syeMogtcal mOetiH
  • 1989
Directional statistical decisions.
  • H. Kaiser
  • Psychology, Medicine
  • Psychological review
  • 1960