Varying coefficient meta-analytic methods for alpha reliability.

  title={Varying coefficient meta-analytic methods for alpha reliability.},
  author={Douglas G. Bonett},
  journal={Psychological methods},
  volume={15 4},
  • D. Bonett
  • Published 1 December 2010
  • Engineering
  • Psychological methods
The conventional fixed-effects (FE) and random-effects (RE) confidence intervals that are used to assess the average alpha reliability across multiple studies have serious limitations. The FE method, which is based on a constant coefficient model, assumes equal reliability coefficients across studies and breaks down under minor violations of this assumption. The RE method, which is based on a random coefficient model, assumes that the selected studies are a random sample from a normally… 

Tables from this paper

Some recommended statistical analytic practices when reliability generalization studies are conducted.

This work compares thirteen different statistical models for averaging reliability coefficients and searching for moderator variables that differ in terms of whether to transform or not the coefficients alpha, and the statistical model assumed, distinguishing between ordinary least squares methods.

Alternatives for Mixed-Effects Meta-Regression Models in the Reliability Generalization Approach

Since heterogeneity between reliability coefficients is usually found in reliability generalization studies, moderator analyses constitute a crucial step for that meta-analytic approach. In this

Synthesizer 1.0: A varying-coefficient meta-analytic tool

A free statistical software tool that employs a varying-coefficient model recently proposed by Bonett (2008, 2009) that may be used to meta-analyze correlations, alpha reliabilities, and standardized mean differences.

Meta-analysis methods for risk differences.

  • D. BonettR. Price
  • Business
    The British journal of mathematical and statistical psychology
  • 2014
Confidence interval methods based on a varying coefficient model are proposed for combining and comparing risk differences from multi-study between- subjects or within-subjects designs and are shown to have excellent finite-sample performance characteristics under realistic conditions.

Meta-analysis Methods for 2 2 Contingency Tables

Methods for combining 2 2 contingency tables from multiple studies are reviewed and new methods are proposed. Methods for combining 2 2 contingency tables from multiple studies are presented in the

Bayesian meta‐analysis of coefficient alpha

A Bayesian approach to the meta-analysis of coefficient alpha is described and illustrated by the analysis of studies of the reliability of the General Ethnicity Questionnaire - Abridged, a measure of identification with the culture of one's heritage and the culture in one's host country.

A tutorial on the meta-analytic structural equation modeling of reliability coefficients.

The primary objective of this article is to present the potential MASEM has for the meta-analysis of reliability coefficients, and discuss and illustrate two MASEM approaches (i.e., correlation-based and parameter-based MASEM), and propose some practical guidelines.

A Distribution Free Interval Estimate for Coefficient Alpha

Scales are important tools for obtaining quantitative measures of theoretical constructs. Once a set of measures to be used in a scale is selected, reliability is commonly examined in order to assess

Confidence intervals for population reliability coefficients: Evaluation of methods, recommendations, and software for composite measures.

These confidence interval methods for 4 reliability coefficients under a variety of conditions with 3 large-scale Monte Carlo simulation studies are evaluated and lead to generally recommend bootstrap confidence intervals for hierarchical omega for continuous items and categorical omega for categorical items.

Varying coefficient meta-analysis methods for odds ratios and risk ratios.

The results of extensive simulation studies suggest that the proposed varying coefficient methods have excellent performance characteristics under realistic conditions and should provide useful alternatives to the currently used meta-analysis methods.



Meta-analytic interval estimation for standardized and unstandardized mean differences.

New FE meta-analytic confidence intervals are proposed that are easy to compute and perform properly under effect-size heterogeneity and nonrandomly selected studies and may be used to combine unstandardized or standardized mean differences from studies having either independent samples or dependent samples.

Fixed- and random-effects models in meta-analysis.

There are 2 families of statistical procedures in meta-analysis: fixed- and randomeffects procedures. They were developed for somewhat different inference goals: making inferences about the effect

Meta-analytic interval estimation for bivariate correlations.

A new fixed-effects meta-analytic confidence interval for bivariate correlations is proposed that is easy to compute and performs well under correlation heterogeneity and nonrandomly selected studies.

Confidence intervals for the amount of heterogeneity in meta‐analysis

A novel method for constructing confidence intervals for the amount of heterogeneity in the effect sizes is proposed that guarantees nominal coverage probabilities even in small samples when model assumptions are satisfied and yields the most accurate coverage probabilities under conditions more analogous to practice.

Fixed- versus random-effects models in meta-analysis: model properties and an empirical comparison of differences in results.

Findings suggest that the precision of meta-analysis findings in the literature has often been substantially overstated, with important consequences for research and practice.

Empirical vs natural weighting in random effects meta‐analysis

It is recommended that empirically based weighted random effects meta-analysis not be used in the future, unless strong cautions about the assumptions underlying these analyses are stated, and at a minimum, some form of secondary analysis based on the principles set forth in this article be provided to supplement the primary analysis.

Toward using confidence intervals to compare correlations.

  • G. Zou
  • Mathematics
    Psychological methods
  • 2007
The distinctive feature of this approach is its acknowledgment of the asymmetry of sampling distributions for single correlations, which requires only the availability of confidence limits for the separate correlations and a method for taking into account the dependency between correlations.

Statistical Inference for Coefficient Alpha

Rigorous comparison of the reliability coefficients of several tests or measurement procedures requires a sampling theory for the coefficients. This paper sum marizes the important aspects of the

A Study Of The Distribution Of Sample Coefficient Alpha With The Hopkins Symptom Checklist: Bootstrap Versus Asymptotics

Sample coefficient alpha is commonly reported for psychological measurement scales. However, how to characterize the distribution of sample coefficient alpha with the Likert-type scales typically

A basis for analyzing test-retest reliability

Lower bounds to the reliability coefficient that can be computed from but asingle trial are developed, to avoid the experimental difficulties of making two independent trials.