• Corpus ID: 248069535

Uniformly Valid Inference Based on the Lasso in Linear Mixed Models

  title={Uniformly Valid Inference Based on the Lasso in Linear Mixed Models},
  author={Peter Kramlinger and Ulrike Schneider and Tatyana Krivobokova},
Linear mixed models (LMMs) are suitable for clustered data and are common in e.g. biometrics, medicine, or small area estimation. It is of interest to obtain valid inference after selecting a subset of available variables. We construct confidence sets for the fixed effects in Gaussian LMMs that are estimated via a Lasso-type penalization which allows quantifying the joint uncertainty of both variable selection and estimation. To this end, we exploit the properties of restricted maximum likelihood… 

Figures from this paper



Uniformly valid confidence sets based on the Lasso

In a linear regression model of fixed dimension, in finite samples with Gaussian errors and asymptotically in the case where the Lasso estimator is tuned to perform conservative model selection, exact formulas are derived for computing the minimal coverage probability over the entire parameter space for a large class of shapes for the confidence sets, thus enabling the construction of valid confidence regions based on the Lello estimator in these settings.

Model Selection in Linear Mixed Models

A large body of literature on linear mixed model selection methods based on four major approaches is reviewed, including information criteria such as AIC or BIC, shrinkage methodsbased on penalized loss functions such as LASSO, the Fence procedure and Bayesian techniques.

Regression Shrinkage and Selection via the Lasso

A new method for estimation in linear models called the lasso, which minimizes the residual sum of squares subject to the sum of the absolute value of the coefficients being less than a constant, is proposed.

Wald consistency and the method of sieves in REML estimation

We prove that for all unconfounded balanced mixed models of the analysis of variance, estimates of variance components parameters that maximize the (restricted) Gaussian likelihood are consistent and

Fixed and Random Effects Selection in Mixed Effects Models

Summary We consider selecting both fixed and random effects in a general class of mixed effects models using maximum penalized likelihood (MPL) estimation along with the smoothly clipped absolute

Valid post-selection inference

It is common practice in statistical data analysis to perform data-driven variable selection and derive statistical inference from the resulting model. Such inference enjoys none of the guarantees

On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding

REML estimation: asymptotic behavior and related topics

The restricted maximum likelihood (REML) estimates of dispersion parameters (variance components) in a general (non-normal) mixed model are defined as solutions of the REML equations. In this paper,

Marginal and Conditional Multiple Inference in Linear Mixed Models

This work introduces a general framework for multiple inference in linear mixed models for the latter, and shows that consistent simultaneous confidence sets for cluster specific parameters are constructed and are shown to be asymptotically valid for conditional inference.

A simultaneous variable selection methodology for linear mixed models

ABSTRACT Selecting an appropriate structure for a linear mixed model serves as an appealing problem in a number of applications such as in the modelling of longitudinal or clustered data. In this