The Case Against Statistical Significance Testing

@article{Carver1978TheCA,
  title={The Case Against Statistical Significance Testing},
  author={Ronald P. Carver},
  journal={Harvard Educational Review},
  year={1978},
  volume={48},
  pages={378-399}
}
  • R. P. Carver
  • Published 1 September 1978
  • Education
  • Harvard Educational Review
In recent years the use of traditional statistical methods in educational research has increasingly come under attack. In this article, Ronald P. Carver exposes the fantasies often entertained by researchers about the meaning of statistical significance. The author recommends abandoning all statistical significance testing and suggests other ways of evaluating research results. Carver concludes that we should return to the scientific method of examining data and replicating results rather than… 

The Role of Statistical Significance Testing In Educational Research

The research methodology literature in recent years has included a full frontal assault on statistical significance testing.The purpose of this paper is to promote the position that, while

The Use of Statistical Significance Tests in Research: Bootstrap and Other Alternatives

AbstractThree of the various criticisms of conventional uses of statistical significance testing are elaborated. Three alternatives for augmenting statistical significance tests in interpreting

Statistical inference in educational research

TLDR
This article supports a proposal for the use of statistical tests in situations where the normal assumptions of random sampling or random assignment are not met, but offers an argument for these procedures in terms of testing an observed pattern of association or difference against a model of random distribution of characteristics.

The Roles of Statistical Significance Testing In Research

The research methodology literature in recent years has included a full frontal assault on statistical significance testing. The purpose of this paper is to promote the position that, while

The Case Against Statistical Significance Testing, Revisited

AbstractAt present, too many research results in education are blatantly described as significant, when they are in fact trivially small and unimportant. There are several things researchers can do

Lack of statistical significance

Criticism has been leveled against the use of statistical significance testing (SST) in many disciplines. However, the field of school psychology has been largely devoid of critiques of SST.

The Significance of Statistical Significance Tests in Marketing Research

Classical statistical significance testing is the primary method by which marketing researchers empirically test hypotheses and draw inferences about theories. The authors discuss the interpretation

The Rise of Statistical Significance Testing in Public Administration Research and Why This Is a Mistake

ABSTRACT:The growth of statistical significance testing in articles published in the Public Administration Review for the period 1945 through 2008 is examined. Comparisons with sister journals, the

The concept of statistical significance testing

Too few researchers understand what statistical significance testing does and doesn't do, and consequently their results are misinterpreted. Even more commonly, researchers understand elements of
...

References

SHOWING 1-10 OF 32 REFERENCES

The Place of Statistics in Psychology

MosT psychologists probably will agree that the emphasis on statistical methods in psychology is a healthy sign. Although we sometimes substitute statistical elegance for good ideas and overembellish

The test of significance in psychological research.

  • D. Bakan
  • Psychology
    Psychological bulletin
  • 1966
The test of significance does not provide the information concerning psychological phenomena characteristically attributed to it; and a great deal of mischief has been associated with its use. The

An Analysis of the Use of Statistical Testing in Communication Research

TLDR
A study to determine the adequacy of statistical testing in communication research discovered a large amount of inconsistency in the reporting of statistical findings; a condition which hampers any clear understanding of what the researcher did and what he found.

Chapter I: Hypothesis Testing in Relation to Statistical Methodology

THE SHORTCOMINGS in the methodology of statistical hypothesis testing used in educational and psychological research have been emphasized repeatedly in recent behavioral science and statistical

The Difference between Statistical Hypotheses and Scientific Hypotheses

When a professional stacistician runs a statistical test he is usually concerned only with the mathematical properties of certain sets of numbers, but when a scientist runs a stztistical test he is

Statistical Power: Derivation, Development, and Data-Analytic Implications

In 1933, Neyman and Pearson introduced the interrelated concepts of statistical power and Type II error in response to a fundamental asymmetry in the hypothesis testing process. With few exceptions,

Tactics of scientific research : evaluating experimental data in psychology

Louis pasteur is a huge quantity available but generally. In terms of natural philosophy al, raqqah in the most successful. See appeal to the operational definition of our gaze but least. Later if

Statistical significance in psychological research.

  • D. Lykken
  • Psychology
    Psychological bulletin
  • 1968
TLDR
Sapolsky (1964) developed the following substantive theory: Some psychiatric patients entertain an unconscious belief in the "cloacal theory of birth" which involves the notions of oral impregnation and anal parturition, which led Sapolsky to predict that Rorschach frog responders show.

The fallacy of the null-hypothesis significance test.

TLDR
To the experimental scientist, statistical inference is a research instrument, a processing device by which unwieldy masses of raw data may be refined into a product more suitable for assimilation into the corpus of science, and in this lies both strength and weakness.

Reconstruction of Educational Research

If there are some subjects on which the results obtained have finally received the unanimous assent of all who have attended to the proof, and others which .. .have never succeeded in establishing