# Varying coefficient meta-analytic methods for alpha reliability.

@article{Bonett2010VaryingCM, title={Varying coefficient meta-analytic methods for alpha reliability.}, author={D. Bonett}, journal={Psychological methods}, year={2010}, volume={15 4}, pages={ 368-85 } }

The conventional fixed-effects (FE) and random-effects (RE) confidence intervals that are used to assess the average alpha reliability across multiple studies have serious limitations. The FE method, which is based on a constant coefficient model, assumes equal reliability coefficients across studies and breaks down under minor violations of this assumption. The RE method, which is based on a random coefficient model, assumes that the selected studies are a random sample from a normally… Expand

#### 66 Citations

Some recommended statistical analytic practices when reliability generalization studies are conducted.

- Mathematics, Medicine
- The British journal of mathematical and statistical psychology
- 2013

This work compares thirteen different statistical models for averaging reliability coefficients and searching for moderator variables that differ in terms of whether to transform or not the coefficients alpha, and the statistical model assumed, distinguishing between ordinary least squares methods. Expand

Alternatives for Mixed-Effects Meta-Regression Models in the Reliability Generalization Approach

- Mathematics
- 2013

Since heterogeneity between reliability coefficients is usually found in reliability generalization studies, moderator analyses constitute a crucial step for that meta-analytic approach. In this… Expand

Synthesizer 1.0: A varying-coefficient meta-analytic tool

- Computer Science, Medicine
- Behavior research methods
- 2010

A free statistical software tool that employs a varying-coefficient model recently proposed by Bonett (2008, 2009) that may be used to meta-analyze correlations, alpha reliabilities, and standardized mean differences. Expand

Bayesian meta-analysis of coefficient alpha.

- Computer Science, Medicine
- Research synthesis methods
- 2013

A Bayesian approach to the meta-analysis of coefficient alpha is described and illustrated by the analysis of studies of the reliability of the General Ethnicity Questionnaire - Abridged, a measure of identification with the culture of one's heritage and the culture in one's host country. Expand

Meta-analysis methods for risk differences.

- Mathematics, Medicine
- The British journal of mathematical and statistical psychology
- 2014

Confidence interval methods based on a varying coefficient model are proposed for combining and comparing risk differences from multi-study between- subjects or within-subjects designs and are shown to have excellent finite-sample performance characteristics under realistic conditions. Expand

Meta-analysis Methods for 2 2 Contingency Tables

- 2012

Methods for combining 2 2 contingency tables from multiple studies are reviewed and new methods are proposed. Methods for combining 2 2 contingency tables from multiple studies are presented in the… Expand

A tutorial on the meta-analytic structural equation modeling of reliability coefficients.

- Medicine
- Psychological methods
- 2020

The primary objective of this article is to present the potential MASEM has for the meta-analysis of reliability coefficients, and discuss and illustrate two MASEM approaches (i.e., correlation-based and parameter-based MASEM), and propose some practical guidelines. Expand

A Distribution Free Interval Estimate for Coefficient Alpha

- Mathematics
- 2018

Scales are important tools for obtaining quantitative measures of theoretical constructs. Once a set of measures to be used in a scale is selected, reliability is commonly examined in order to assess… Expand

Confidence intervals for population reliability coefficients: Evaluation of methods, recommendations, and software for composite measures.

- Mathematics, Medicine
- Psychological methods
- 2016

These confidence interval methods for 4 reliability coefficients under a variety of conditions with 3 large-scale Monte Carlo simulation studies are evaluated and lead to generally recommend bootstrap confidence intervals for hierarchical omega for continuous items and categorical omega for categorical items. Expand

Varying coefficient meta-analysis methods for odds ratios and risk ratios.

- Mathematics, Medicine
- Psychological methods
- 2015

The results of extensive simulation studies suggest that the proposed varying coefficient methods have excellent performance characteristics under realistic conditions and should provide useful alternatives to the currently used meta-analysis methods. Expand

#### References

SHOWING 1-10 OF 62 REFERENCES

Meta-analytic interval estimation for standardized and unstandardized mean differences.

- Mathematics, Medicine
- Psychological methods
- 2009

New FE meta-analytic confidence intervals are proposed that are easy to compute and perform properly under effect-size heterogeneity and nonrandomly selected studies and may be used to combine unstandardized or standardized mean differences from studies having either independent samples or dependent samples. Expand

Fixed- and random-effects models in meta-analysis.

- Mathematics
- 1998

There are 2 families of statistical procedures in meta-analysis: fixed- and randomeffects procedures. They were developed for somewhat different inference goals: making inferences about the effect… Expand

Meta-analytic interval estimation for bivariate correlations.

- Mathematics, Medicine
- Psychological methods
- 2008

A new fixed-effects meta-analytic confidence interval for bivariate correlations is proposed that is easy to compute and performs well under correlation heterogeneity and nonrandomly selected studies. Expand

Confidence intervals for the amount of heterogeneity in meta-analysis.

- Computer Science, Medicine
- Statistics in medicine
- 2007

A novel method for constructing confidence intervals for the amount of heterogeneity in the effect sizes is proposed that guarantees nominal coverage probabilities even in small samples when model assumptions are satisfied and yields the most accurate coverage probabilities under conditions more analogous to practice. Expand

Fixed- versus random-effects models in meta-analysis: model properties and an empirical comparison of differences in results.

- Mathematics, Medicine
- The British journal of mathematical and statistical psychology
- 2009

Findings suggest that the precision of meta-analysis findings in the literature has often been substantially overstated, with important consequences for research and practice. Expand

Empirical vs natural weighting in random effects meta-analysis.

- Mathematics, Medicine
- Statistics in medicine
- 2010

It is recommended that empirically based weighted random effects meta-analysis not be used in the future, unless strong cautions about the assumptions underlying these analyses are stated, and at a minimum, some form of secondary analysis based on the principles set forth in this article be provided to supplement the primary analysis. Expand

Toward using confidence intervals to compare correlations.

- Mathematics, Medicine
- Psychological methods
- 2007

The distinctive feature of this approach is its acknowledgment of the asymmetry of sampling distributions for single correlations, which requires only the availability of confidence limits for the separate correlations and a method for taking into account the dependency between correlations. Expand

Statistical Inference for Coefficient Alpha

- Mathematics
- 1987

Rigorous comparison of the reliability coefficients of several tests or measurement procedures requires a sampling theory for the coefficients. This paper sum marizes the important aspects of the… Expand

A Study Of The Distribution Of Sample Coefficient Alpha With The Hopkins Symptom Checklist: Bootstrap Versus Asymptotics

- Psychology
- 2003

Sample coefficient alpha is commonly reported for psychological measurement scales. However, how to characterize the distribution of sample coefficient alpha with the Likert-type scales typically… Expand

A basis for analyzing test-retest reliability

- Mathematics, Medicine
- Psychometrika
- 1945

Lower bounds to the reliability coefficient that can be computed from but asingle trial are developed, to avoid the experimental difficulties of making two independent trials. Expand