Do studies of statistical power have an effect on the power of studies

@article{Sedlmeier1989DoSO,
  title={Do studies of statistical power have an effect on the power of studies},
  author={Peter Sedlmeier and Gerd Gigerenzer},
  journal={Psychological Bulletin},
  year={1989},
  volume={105},
  pages={309-316}
}
The long-term impact of studies of statistical power is investigated using J. Cohen's (1962) pioneering work as an example. We argue that the impact is nil; the power of studies in the same journal that Cohen reviewed (now the Journal of Abnormal Psychology) has not increased over the past 24 years. In 1960 the median power (i.e., the probability that a significant result will be obtained if there is a true effect) was .46 for a medium size effect, whereas in 1984 it was only .37. The decline… 
Statistical power of psychological research: what have we gained in 20 years?
  • J. Rossi
  • Psychology
    Journal of consulting and clinical psychology
  • 1990
TLDR
The implications of these results concerning the proliferation of Type I errors in the published literature, the failure of replication studies, and the interpretation of null (negative) results are emphasized.
Article Commentary: On the Persistence of Low Power in Psychological Science
TLDR
Surveyed studies published recently in a high-ranking psychology journal and contacted authors to establish the rationale used for deciding sample size, finding that approximately one third held beliefs that would serve, on average, to reduce statistical power.
Statistical power of articles published in three health psychology-related journals.
  • J. Maddock, J. Rossi
  • Psychology, Medicine
    Health psychology : official journal of the Division of Health Psychology, American Psychological Association
  • 2001
TLDR
Power was calculated for 8,266 statistical tests in 187 journal articles published in the 1997 volumes of Health Psychology, Addictive Behaviors, and the Journal of Studies on Alcohol, giving a good estimation for the field of health psychology.
The Power of Replicated Measures to Increase Statistical Power
When running statistical tests, researchers can commit a Type II error, that is, fail to reject the null hypothesis when it is false. To diminish the probability of committing a Type II error (β),
The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases
TLDR
Certain biases have caused a dramatic inflation in published effects, making it difficult to compare an actual effect with the real population effects (as these are unknown), and there were very large differences in the mean effects between psychological sub-disciplines and between different study designs,Making it impossible to apply any global benchmarks.
Average Power: A Cautionary Note
Replication is an important contemporary issue in psychological research, and there is great interest in ways of assessing replicability, in particular, retrospectively via prior studies. The average
Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature
TLDR
In light of the findings, the recently reported low replication success in psychology is realistic, and worse performance may be expected for cognitive neuroscience, and false report probability is likely to exceed 50% for the whole literature.
Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature
TLDR
The recently reported low replication success in psychology is realistic and worse performance may be expected for cognitive neuroscience, and false report probability is likely to exceed 50% for the whole literature.
The case against retrospective statistical power analyses with an introduction to power analysis
Statistical power analysis is an important tool for planning an experiment because this type of analysis allows researchers to identify an appropriate sample size for a particular experimental
...
...

References

SHOWING 1-10 OF 54 REFERENCES
Statistical Power: Derivation, Development, and Data-Analytic Implications
In 1933, Neyman and Pearson introduced the interrelated concepts of statistical power and Type II error in response to a fundamental asymmetry in the hypothesis testing process. With few exceptions,
On the Power of Statistical Tests in the American Educational Research Journal 1
It is almost universally accepted by educational researchers that the power (probability of rejecting Ho when Ho is false, that is, 1-0-) of a statistical test is important and should be substantial.
Statistical Power and Research in Occupational Therapy
TLDR
A post hoc power analysis of 205 statistical tests from 22 articles reporting occupational therapy research revealed that studies reporting small and medium effect sizes were associated with low power and were subject to a high probability of Type II experimental error.
A power‐analytic examination of contemporary communication research
While Type I error has enjoyed widespread attention in communication research, the interrelated concepts of statistical power and Type II error have been generally neglected. In order to assess the
Approximate Power and Sample Size Determination for Common one-Sample and two-Sample Hypothesis Tests
IN the course of preparing a handbook for power analysis (Cohen, 1969), it became apparent that at the cost of (a) working with approximate rather than &dquo;exact&dquo; solutions, and (b) doing a
An Analysis of the Use of Statistical Testing in Communication Research
TLDR
A study to determine the adequacy of statistical testing in communication research discovered a large amount of inconsistency in the reporting of statistical findings; a condition which hampers any clear understanding of what the researcher did and what he found.
BELIEF IN THE LAW OF SMALL NUMBERS
“Suppose you have run an experiment on 20 subjects, and have obtained a significant result which confirms your theory ( z = 2.23, p If you feel that the probability is somewhere around .85, you may
Consequences of Prejudice Against the Null Hypothesis
The consequences of prejudice against accepting the null hypothesis were examined through (a) a mathematical model intended to stimulate the research-publication process and (b) case studies of
Tables and Procedures for the Determination of Power and Sample Sizes in Univariate and Multivariate Analyses of Variance and Regression
The available power tables for use in experimental design only serve for limited practical purposes, since they are restricted to very few levels of significance such as .01, .05, and .10. With these
The test of significance in psychological research.
  • D. Bakan
  • Psychology
    Psychological bulletin
  • 1966
The test of significance does not provide the information concerning psychological phenomena characteristically attributed to it; and a great deal of mischief has been associated with its use. The
...
...