Statistical Methods in Psychology Journals: Guidelines and Explanations

@article{Wilkinson1999StatisticalMI,
  title={Statistical Methods in Psychology Journals: Guidelines and Explanations},
  author={Leland Wilkinson},
  journal={American Psychologist},
  year={1999},
  volume={54},
  pages={594-604}
}
In the light of continuing debate over the applications of significance testing in psychology journals and following the publication of Cohen's (1994) article, the Board of Scientific Affairs (BSA) of the American Psychological Association (APA) convened a committee called the Task Force on Statistical Inference (TFSI) whose charge was "to elucidate some of the controversial issues surrounding applications of statistics including significance testing and its alternatives; alternative underlying… 
Testing Statistical Significance Testing: Some Observations of an Agnostic
I read the article by Hubbard and Ryan (2000 [this issue]) with interest. The article adds one more criticism of statistical significance testing to a large body of literature with a long history. As
Colloquium on Effect Sizes: the Roles of Editors, Textbook Authors, and the Publication Manual
Reformers have long argued that misuse of Null Hypothesis Significance Testing (NHST) is widespread and damaging. The authors analyzed 150 articles from the Journal of Applied Psychology (JAP)
Estimation of the simple correlation coefficient
906 PS In order to reform statistical practices, Wilkinson and the American Psychological Association Task Force on Statistical Inference (1999), the Publication Manual of the American Psychological
Controversies Around the Role of Statistical Tests in Experimental Research
Despite widespread use of significance testing in empirical research, its interpretation and researchers' excessive confidence in its results have been criticized for years. In this article, the
Past and Future American Psychological Association Guidelines for Statistical Practice
We review the publication guidelines of the American Psychological Association (APA) since 1929 and document their advice for authors about statistical practice. Although the advice has been extended
Should Psychology Journals Adopt Specialized Statistical Review?
Readers of peer-reviewed research may assume that the reported statistical analyses supporting scientific claims have been closely scrutinized and surpass a high-quality threshold. However,
Effect Size Matters: Empirical Investigations to Help Researchers Make Informed Decisions on Commonly Used Statistical Techniques
Effect Size Matters: Empirical Investigations to Help Researchers Make Informed Decisions on Commonly Used Statistical Techniques. (December 2009) Susana Troncoso Skidmore, B.A., M.Ed., Texas A&M
Statistical Techniques Employed in AERJ and JCP Articles from 1988 to 1997: A Methodological Review
Abstract The authors of the present methodological review investigated the patterns of statistical usage and reporting practices in 756 articles published in the American Educational Research Journal
Reform of statistical inference in psychology: The case ofMemory & Cognition
  • S. Finch, G. Cumming, O. Goodman
  • Psychology
    Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc
  • 2004
TLDR
Analyzing 696 Memory & Cognition articles published before, during, and after the Loftus editorship confirmed that Loftus’s influence was most evident in the articles he accepted for publication, but was otherwise limited.
...
...

References

SHOWING 1-10 OF 81 REFERENCES
Beyond the Two Disciplines of Scientific Psychology.
The historic separation of experimental psychology from the study of individual differences impeded psychological research, So I argued when last I had occasion to address the APA audience (Cronbach,
Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of Researchers
Data analysis methods in psychology still emphasize statistical significance testing, despite numerous articles demonstrating its severe deficiencies. It is now possible to use meta-analysis to show
Teaching of Statistics
TLDR
There are many text-books on practical statistical methods, usually restricted to one particular field of application, such as economics, business statistics, psychology, or biology and medicine, in which the reader has to accept the statements without proof.
What if there were no significance tests
Contents: Preface. Part I: Overview. L.L. Harlow, Significance Testing Introduction and Overview. Part II: The Debate: Against and For Significance Testing. J.Cohen, The Earth Is Round. F.L. Schmidt,
Statistical Practices of Educational Researchers: An Analysis of their ANOVA, MANOVA, and ANCOVA Analyses
Articles published in several prominent educational journals were examined to investigate the use of data analysis tools by researchers in four research paradigms: between-subjects univariate
Formal modes of statistical inference for causal effects
The earth is round (p < .05)
After 4 decades of severe criticism, the ritual of null hypothesis significance testing (mechanical dichotomous decisions around a sacred .05 criterion) still persists. This article reviews the
The Design of Experiments
  • J. I
  • Economics
    Nature
  • 1936
AbstractREADERS of “Statistical Methods for Research Workers” will welcome Prof. Fisher's new book, which is partly devoted to a development of the logical ideas underlying the earlier volume and
On the Surprising Longevity of Flogged Horses: Why There Is a Case for the Significance Test
Criticisms of null-hypothesis significance tests (NHSTs) are reviewed Used as formal, two-valued decision procedures, they often generate misleading conclusions However, critics who argue that NHSTs
AERA Editorial Policies Regarding Statistical Significance Testing: Three Suggested Reforms.
TLDR
The logic of statistical significance testing is presented in an accessible manner; many people who use statistical tests might not place such a premium on the tests if these individuals understood what the tests really do, and what they do not do.
...
...