# Small sample inference for fixed effects from restricted maximum likelihood.

@article{Kenward1997SmallSI, title={Small sample inference for fixed effects from restricted maximum likelihood.}, author={Michael G. Kenward and James H. Roger}, journal={Biometrics}, year={1997}, volume={53 3}, pages={ 983-97 } }

Restricted maximum likelihood (REML) is now well established as a method for estimating the parameters of the general Gaussian linear model with a structured covariance matrix, in particular for mixed linear models. Conventionally, estimates of precision and inference for fixed effects are based on their asymptotic distribution, which is known to be inadequate for some small-sample problems. In this paper, we present a scaled Wald statistic, together with an F approximation to its sampling…

## 3,528 Citations

Robust Small-Sample Inference for Fixed Effects in General Gaussian Linear Models

- Mathematics, MedicineJournal of biopharmaceutical statistics
- 2012

Simulation studies show that the proposed small sample correction for the empirical covariance estimator in general Gaussian linear models generally performs better than other bias-correction methods, including Mancl and DeRouen (2001), Kauermann and Carroll (2001, and Fay and Graubard ( 2001), in the investigated balanced designs.

An improved approximation to the precision of fixed effects from restricted maximum likelihood

- Mathematics, Computer ScienceComput. Stat. Data Anal.
- 2009

An approximate small sample variance estimator for fixed effects from the multivariate normal linear model, together with appropriate inference tools based on a scaled F pivot, is now well…

Small sample inference for the fixed effects in the mixed linear model

- Mathematics, Computer ScienceComput. Stat. Data Anal.
- 2004

Results show that Type I error rates for the Wald-type test with chi-square approximation are substantially inflated, though less so with REML estimates than with ML estimates.

Estimation Methods for Mixed Logistic Models with Few Clusters

- Mathematics, MedicineMultivariate behavioral research
- 2016

ABSTRACT For mixed models generally, it is well known that modeling data with few clusters will result in biased estimates, particularly of the variance components and fixed effect standard errors.…

Bayesian methods for the analysis of small sample multilevel data with a complex variance structure.

- Mathematics, MedicinePsychological methods
- 2013

The authors report a Monte Carlo study that compares the performance of an adjusted restricted maximum likelihood (REML) analysis to a Bayesian analysis, and suggests that for fixed effects, the models perform equally well with respect to bias, efficiency, and coverage of interval estimates.

Improved small sample inference in the mixed linear model: Bartlett correction and adjusted likelihood

- Mathematics
- 2000

The mixed linear model is a popular method for analysing unbalanced repeated measurement data. The classical statistical tests for parameters in this model are based on asymptotic theory that is…

The analysis of very small samples of repeated measurements I: an adjusted sandwich estimator.

- Mathematics, MedicineStatistics in medicine
- 2010

A generalization of an approach to Wald tests using a bias-adjusted empirical sandwich estimator for the covariance matrix of the fixed effects parameters from generalized estimating equations is developed for Gaussian repeated measurements.

Simultaneous inference for multiple marginal generalized estimating equation models

- Medicine, Computer ScienceStatistical methods in medical research
- 2019

The proposed framework in which a generalized estimating equation model is fit for each endpoint marginally, taking into account dependencies within the same subject, is suitable to efficiently use the information from repeated observations of multiple endpoints in small-sample studies.

Avoiding bias in mixed model inference for fixed effects.

- Mathematics, MedicineStatistics in medicine
- 2011

It is proved that the underspecification creates bias in both small and large samples, indicating that recruiting more participants will not alleviate inflation of the Type I error rate associated with fixed effect inference.

Approximate Small-Sample Tests of Fixed Effects in Nonlinear Mixed Models

- Mathematics, Computer ScienceCommun. Stat. Simul. Comput.
- 2014

Investigating the performance of commonly applied tests of linear hypotheses about the fixed effect parameters under different approximations to the likelihood function and to the estimated covariance matrix of the estimators indicates that FOCE and AGQ estimation methods outperform FIRO.

## References

SHOWING 1-10 OF 29 REFERENCES

Likelihood Ratio Tests for Fixed Model Terms using Residual Maximum Likelihood

- Mathematics
- 1997

Likelihood ratio tests for fixed model terms are proposed for the analysis of linear mixed models when using residual maximum likelihood estimation. Bartlett‐type adjustments, using an approximate…

Two-stage analysis based on a mixed model: large-sample asymptotic theory and small-sample simulation results

- Computer Science
- 1985

SUMMARY A two-stage analysis for the mixed model in which variance components due to the random effects are estimated and used to compute generalized least squares estimates of fixed effects is…

Prediction-interval procedures and (fixed-effects) confidence-interval procedures for mixed linear models

- Mathematics
- 1988

A general approach is presented for devising an approximate 100(1-α)% prediction interval for an unobservable random variable w based on the value of an observable random vector y. It is assumed…

Random-effects models for longitudinal data.

- Mathematics, MedicineBiometrics
- 1982

A unified approach to fitting these models, based on a combination of empirical Bayes and maximum likelihood estimation of model parameters and using the EM algorithm, is discussed.

Classical and Bayesian prediction as applied to an unbalanced mixed linear model

- Mathematics
- 1992

Unbalanced mixed linear models that contain a single set of random effects are frequently employed in animal breeding applications, in small-area estimation, and in the analysis of comparative…

Approximations for Standard Errors of Estimators of Fixed and Random Effects in Mixed Linear Models

- Mathematics
- 1984

Abstract Best linear unbiased estimators of the fixed and random effects of mixed linear models are available when the true values of the variance ratios are known. If the true values are replaced by…

Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems

- Mathematics
- 1977

Abstract Recent developments promise to increase greatly the popularity of maximum likelihood (ml) as a technique for estimating variance components. Patterson and Thompson (1971) proposed a…

That BLUP is a Good Thing: The Estimation of Random Effects

- Mathematics
- 1991

In animal breeding, Best Linear Unbiased Prediction, or BLUP, is a technique for estimating genetic merits. In general, it is a method of estimating random effects. It can be used to derive the…

The application of REML in clinical trials.

- Mathematics, MedicineStatistics in medicine
- 1994

The REML technique is described and its application to three common types of clinical trial: crossover, repeated measures and multicentre is discussed.

Average information REML: An efficient algorithm for variance parameter estimation in linear mixed models

- Mathematics
- 1995

A strategy of using an average information matrix is shown to be computationally convenient and efficient for estimating variance components by restricted maximum likelihood (REML) in the mixed…