A Lasso for Hierarchical Interactions.

  title={A Lasso for Hierarchical Interactions.},
  author={Jacob Bien and Jonathan Taylor and Robert Tibshirani},
  journal={Annals of statistics},
  volume={41 3},
We add a set of convex constraints to the lasso to produce sparse interaction models that honor the hierarchy restriction that an interaction only be included in a model if one or both variables are marginally important. We give a precise characterization of the effect of this hierarchy constraint, prove that hierarchy holds with probability one and derive an unbiased estimate for the degrees of freedom of our estimator. A bound on this estimate reveals the amount of fitting "saved" by the… CONTINUE READING
Highly Influential
This paper has highly influenced 22 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS

From This Paper

Figures, tables, and topics from this paper.


Publications citing this paper.
Showing 1-10 of 97 extracted citations

Convex Modeling of Interactions with Strong Heredity.

Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America • 2016
View 12 Excerpts
Highly Influenced

Multiclass Svm with Hierarchical Interaction: Application to Face Classification

2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP) • 2018
View 5 Excerpts
Highly Influenced

Sparse and Smooth Prior for Bayesian Linear Regression with Application to ETEX Data

Lukáš Ulrych, Václav Šḿıdl
View 4 Excerpts
Highly Influenced


Publications referenced by this paper.
Showing 1-10 of 44 references

Distributed optimization and statistical learning via the alternating direction method of multipliers

S. Boyd, N. Parikh, E. Chu, B. Peleato, J. Eckstein
Foundations and Trends in Machine Learning • 2011
View 4 Excerpts
Highly Influenced

Categorical Data Analysis Second Edition

View 4 Excerpts
Highly Influenced

Best subset regression using the nonnegative garrote

L. Breiman
Technometrics • 1995
View 4 Excerpts
Highly Influenced

‘ Hierarchical variable selection in polynomial regression models

J. Peixoto
View 5 Excerpts
Highly Influenced

‘ A reformulation of linear models

J. A. Nelder
Journal of the Royal Statistical Society • 1977
View 4 Excerpts
Highly Influenced

Similar Papers

Loading similar papers…