Fast Best Subset Selection: Coordinate Descent and Local Combinatorial Optimization Algorithms
@article{Hazimeh2020FastBS, title={Fast Best Subset Selection: Coordinate Descent and Local Combinatorial Optimization Algorithms}, author={Hussein Hazimeh and R. Mazumder}, journal={Oper. Res.}, year={2020}, volume={68}, pages={1517-1537} }
The $L_0$-regularized least squares problem (a.k.a. best subsets) is central to sparse statistical learning and has attracted significant attention across the wider statistics, machine learning, and optimization communities. Recent work has shown that modern mixed integer optimization (MIO) solvers can be used to address small to moderate instances of this problem. In spite of the usefulness of $L_0$-based estimators and generic MIO solvers, there is a steep computational price to pay when… Expand
Supplemental Code
Figures, Tables, and Topics from this paper
Paper Mentions
Blog Post
55 Citations
Probabilistic Best Subset Selection by Gradient-Based Optimization
- Computer Science, Mathematics
- 2020
- 4
- Highly Influenced
- PDF
Learning Sparse Classifiers: Continuous and Mixed Integer Optimization Perspectives
- Computer Science, Mathematics
- ArXiv
- 2020
- 6
- PDF
Grouped Variable Selection with Discrete Optimization: Computational and Statistical Perspectives
- Mathematics, Computer Science
- 2021
- PDF
A polynomial algorithm for best-subset selection problem
- Computer Science, Medicine
- Proceedings of the National Academy of Sciences
- 2020
- 1
Sparse Regression at Scale: Branch-and-Bound rooted in First-Order Optimization
- Mathematics, Computer Science
- ArXiv
- 2020
- 12
- Highly Influenced
- PDF
Learning Hierarchical Interactions at Scale: A Convex Optimization Approach
- Computer Science, Mathematics
- AISTATS
- 2020
- 10
- PDF
Sparse and Smooth Signal Estimation: Convexification of L0 Formulations
- Mathematics, Computer Science
- ArXiv
- 2018
- 15
- PDF
References
SHOWING 1-10 OF 43 REFERENCES
Random Coordinate Descent Methods for $\ell_{0}$ Regularized Convex Optimization
- Mathematics, Computer Science
- IEEE Transactions on Automatic Control
- 2015
- 23
- Highly Influential
Iterative hard thresholding methods for $$l_0$$l0 regularized convex cone programming
- Mathematics, Computer Science
- Math. Program.
- 2014
- 68
- PDF
The Discrete Dantzig Selector: Estimating Sparse Linear Models via Mixed Integer Linear Optimization
- Mathematics, Computer Science
- IEEE Transactions on Information Theory
- 2017
- 27
- PDF
Efficiency of Coordinate Descent Methods on Huge-Scale Optimization Problems
- Mathematics, Computer Science
- SIAM J. Optim.
- 2012
- 1,069
- Highly Influential
- PDF
COORDINATE DESCENT ALGORITHMS FOR NONCONVEX PENALIZED REGRESSION, WITH APPLICATIONS TO BIOLOGICAL FEATURE SELECTION.
- Computer Science, Mathematics
- The annals of applied statistics
- 2011
- 504
- Highly Influential
- PDF
Sparsity Constrained Nonlinear Optimization: Optimality Conditions and Algorithms
- Computer Science, Mathematics
- SIAM J. Optim.
- 2013
- 223
- Highly Influential
- PDF
Subset Selection with Shrinkage: Sparse Linear Modeling when the SNR is low
- Mathematics
- 2017
- 38
- Highly Influential
- PDF
A General Theory of Concave Regularization for High-Dimensional Sparse Estimation Problems
- Computer Science, Mathematics
- 2011
- 239
- PDF