Overcoming feelings of powerlessness in "aging" researchers: a primer on statistical power in analysis of variance designs.

  title={Overcoming feelings of powerlessness in "aging" researchers: a primer on statistical power in analysis of variance designs.},
  author={Joel R. Levin},
  journal={Psychology and aging},
  volume={12 1},
  • J. Levin
  • Published 1997
  • Medicine
  • Psychology and aging
A general rationale and specific procedures for examining the statistical power characteristics of psychology-of-aging empirical studies are provided. First, 4 basic ingredients of statistical hypothesis testing are reviewed. Then, 2 measures of effect size are introduced (standardized mean differences and the proportion of variation accounted for by the effect of interest), and methods are given for estimating these measures from already-completed studies. Power and sample size formulas… Expand
Statistical Practices of Educational Researchers: An Analysis of their ANOVA, MANOVA, and ANCOVA Analyses
Articles published in several prominent educational journals were examined to investigate the use of data analysis tools by researchers in four research paradigms: between-subjects univariateExpand
Appraising Minimum Effect of Standardized Contrasts in ANCOVA Designs: Statistical Power, Sample Size, and Covariate Imbalance Considerations
  • G. Shieh
  • Mathematics
  • Statistics in Biopharmaceutical Research
  • 2020
Abstract The concepts and implementation of standardized mean differences and minimum effect tests have been emphasized in ANOVA. The corresponding processes and implications are, however, not yetExpand
Power Analysis and Sample Size Planning in ANCOVA Designs
  • G. Shieh
  • Medicine, Computer Science
  • Psychometrika
  • 2019
An exact approach is proposed for power and sample size calculations in ANCOVA with random assignment and multinormal covariates and the improved solution is illustrated with an example regarding the comparative effectiveness of interventions. Expand
Power Analysis Software for Educational Researchers
Given the importance of statistical power analysis in quantitative research and the repeated emphasis on it by American Educational Research Association/American Psychological Association journals,Expand
The welchADF Package for Robust Hypothesis Testing in Unbalanced Multivariate Mixed Models with Heteroscedastic and Non-normal Data
A new R package is presented for dealing with non-normality and variance heterogeneity of sample data when conducting hypothesis tests of main effects and interactions in mixed models. The proposalExpand
Approximate Sample Size Formulas for Testing Group Mean Differences When Variances Are Unequal in One-Way ANOVA
This study proposes an approach for determining appropriate sample size for Welch's F test when unequal variances are expected. Given a certain maximum deviation in population means and using theExpand
Developing the Noncentrality Parameter for Calculating Group Sample Sizes in Heterogeneous Analysis of Variance
Sample size determination is an important issue in planning research. In the context of one-way fixed-effect analysis of variance, the conventional sample size formula cannot be applied for theExpand
Rejoinder: Editorial Policies Regarding Statistical Significance Tests: Further Comments
In this response to Robinson and Levin’s comments on Thompson (1996), it is argued that describing results as “significant” rather than “statistically significant” is confusing to those persons mostExpand
Research news and Comment: Reflections on Statistical and Substantive Significance, With a Slice of Replication
In this comment, we propose some modifications to Thompson’s (1996) recent suggestions for AERA editorial policy on statistical significance testing. First, we discuss the potential problems, bothExpand
Princesses are bigger than elephants: Effect size as a category error in evidence-based education
  • A. Simpson
  • Psychology
  • British Educational Research Journal
  • 2018
Much of the evidential basis for recent policy decisions is grounded in effect size: the standardised mean difference in outcome scores between a study's intervention and comparison groups. This isExpand


Statistical Power Analysis for the Behavioral Sciences
Contents: Prefaces. The Concepts of Power Analysis. The t-Test for Means. The Significance of a Product Moment rs (subscript s). Differences Between Correlation Coefficients. The Test That aExpand
The purpose of this paper is to present some new procedures for estimating the appropriate (or at least, the approximate) number of subjects to include in educational experiments designed to detectExpand
GPOWER: A general power analysis program
GPOWER performs high-precision statistical power analyses for the most common statistical tests in behavioral research, that is,t tests,F tests, andχ2 tests. Expand
Multiple correlation: exact power and sample size calculations.
The mathematical framework applicable when a multivariate normal distribution can be assumed is reviewed, a method for calculating exact power and sample sizes using a series expansion for the distribution of the multiple correlation coefficient is described and Cohen's approximations are described. Expand
Designing Experiments and Analyzing Data: A Model Comparison Perspective
This book discusses conceptual Bases of Experimental Design and Analysis, model Comparisons for Between-Subjects Designs, and an Introduction to Multilevel Hierarchical Mixed Models: Nested Designs. Expand
Experimental Design: Procedures for the Behavioral Sciences
Chapter 1. Research Strategies and the Control of Nuisance Variables Chapter 2. Experimental Designs: an Overview Chapter 3. Fundamental Assumptions in Analysis of Variance Chapter 4. CompletelyExpand
Effect sizes and p values: what should be reported and what should be replicated?
The most-criticized flaws of NHT can be avoided when the importance of a hypothesis is used to determine that a finding is worthy of report, and when p approximately equal to .05 is treated as insufficient basis for confidence in the replicability of an isolated non-null finding. Expand
Aging and memory for frequency of occurrence of novel, visual stimuli: direct and indirect measures.
  • C. Wiggs
  • Psychology, Medicine
  • Psychology and aging
  • 1993
Elderly and young subjects did not differ when shown words, but elderly were impaired compared with young subjects when ideograms were presented, and both groups were sensitive to the frequency of occurrence of ideograms. Expand
Consequences of Prejudice Against the Null Hypothesis
The consequences of prejudice against accepting the null hypothesis were examined through (a) a mathematical model intended to stimulate the research-publication process and (b) case studies ofExpand
Resource-reduction interpretations of cognitive aging☆
Abstract It is reliably found in samples of adults of varying ages that increased age is associated with poorer performance on many cognitive tasks involving reasoning, memory, and spatial abilities.Expand