Corpus ID: 16472277

Misinterpretations of significance: A problem students share with their teachers?

  title={Misinterpretations of significance: A problem students share with their teachers?},
  author={H. Haller and S. Krauss},
The use of significance tests in science has been debated from the invention of these tests until the present time. Apart from theoretical critiques on their appropriateness for evaluating scientific hypotheses, significance tests also receive criticism for inviting misinterpretations. We presented six common misinterpretations to psychologists who work in German universities and found out that they are still surprisingly widespread - even among instructors who teach statistics to psychology… Expand

Figures and Tables from this paper

The use of significance tests in science has been debated from the invention of these tests until the present time. Apart from theoretical critiques on their appropriateness for evaluating scientificExpand
How Confident are Students in their Misconceptions about Hypothesis Tests?
Both researchers and teachers of statistics have made considerable efforts during the last decades to re-conceptualize statistics courses in accordance with the general reform movement in mathematicsExpand
Designing an Assessment to Measure Students' Inferential Reasoning in Statistics: The First Study, Development of a Test Blueprint
Accompanied with ongoing calls for reform in statistics curriculum, mathematics and statistics teachers purposefully have been reconsidering the curriculum and the content taught in statisticsExpand
Teaching hypothesis testing: a necessary challenge.
The last decades a debate has been going on about the use of hypothesis testing. This has led some teachers to think that confidence intervals and effect sizes need to be taught instead of formalExpand
Perspectives on significance testing
Null hypothesis significance testing is the staple of psychological research. It is a technique so ingrained in the teaching of psychological research methods that we rarely have cause to questionExpand
Students' Misconceptions About Hypothesis Test
Students’ misconceptions about hypothesis test have been discussed for decades by many researchers in the developed countries. However, documented studies in the non-developed countries are lacking.Expand
Failing Grade: 89% of Introduction-to-Psychology Textbooks That Define or Explain Statistical Significance Do So Incorrectly
Null-hypothesis significance testing (NHST) is commonly used in psychology; however, it is widely acknowledged that NHST is not well understood by either psychology professors or psychology students.Expand
Interpretation of the p value: A national survey study in academic psychologists from Spain.
It is suggested that many academic psychologists do not know how to correctly interpret p values, and the importance of the statistical re-education of professors is highlighted. Expand
Students’ misconceptions of statistical inference: A review of the empirical evidence from research on statistics education
Abstract A solid understanding of inferential statistics is of major importance for designing and interpreting empirical results in any scientific discipline. However, students are prone to manyExpand
Investigating Statistics Teachers' Knowledge of Probability in the Context of Hypothesis Testing.
In the last three decades, there has been a significant growth in the number of undergraduate students taking introductory statistics. As a result, there is a need by universities and communityExpand


About some misconceptions and the discontent with statistical tests in psychology 1
The function and potential importance of statistical tests in examining and evaluating substantive and psychological hypotheses is discussed. Psychological hypotheses are sharply distinguished fromExpand
Significance Tests Die Hard
We present a critique showing the flawed logical structure of statistical significance tests. We then attempt to analyze why, in spite of this faulty reasoning, the use of significance testsExpand
The test of significance in psychological research.
  • D. Bakan
  • Psychology, Medicine
  • Psychological bulletin
  • 1966
The test of significance does not provide the information concerning psychological phenomena characteristically attributed to it; and a great deal of mischief has been associated with its use. TheExpand
Null hypothesis significance testing: a review of an old and continuing controversy.
The concluding opinion is that NHST is easily misunderstood and misused but that when applied with good judgment it can be an effective aid to the interpretation of experimental data. Expand
The Case Against Statistical Significance Testing, Revisited
AbstractAt present, too many research results in education are blatantly described as significant, when they are in fact trivially small and unimportant. There are several things researchers can doExpand
Statistical Procedures and the Justification of Knowledge in Psychological Science
Justification, in the vernacular language of philosophy of science, refers to the evaluation, defense, and confirmation of claims of truth. In this article, we examine some aspects of the rhetoric ofExpand
The Design of Experiments
AbstractREADERS of “Statistical Methods for Research Workers” will welcome Prof. Fisher's new book, which is partly devoted to a development of the logical ideas underlying the earlier volume andExpand
If you are reading this Editorial, it is likely because you are contemplating diving into the set of articles that comprise this Neuropsychologia Special Issue. The decision-making that is part andExpand
The earth is round (p < .05)
After 4 decades of severe criticism, the ritual of null hypothesis significance testing (mechanical dichotomous decisions around a sacred .05 criterion) still persists. This article reviews theExpand
A picture is worth a thousandp values: On the irrelevance of hypothesis testing in the microcomputer age
Hypothesis testing, while by far the most common statistical technique for generating conclusions from data, is nonetheless not very informative. It emphasizes a banal and confusing question (“Is itExpand