• Corpus ID: 224804092

Localizing Changes in High-Dimensional Regression Models

@inproceedings{Rinaldo2021LocalizingCI,
  title={Localizing Changes in High-Dimensional Regression Models},
  author={Alessandro Rinaldo and Daren Wang and Qin Wen and Rebecca M. Willett and Yi Yu},
  booktitle={AISTATS},
  year={2021}
}
This paper addresses the problem of localizing change points in high-dimensional linear regression models with piecewise constant regression coefficients. We develop a dynamic programming approach to estimate the locations of the change points whose performance improves upon the current state-of-the-art, even as the dimensionality, the sparsity of the regression coefficients, the temporal spacing between two consecutive change points, and the magnitude of the difference of two consecutive… 

Figures and Tables from this paper

Denoising and change point localisation in piecewise-constant high-dimensional regression coefficients
We study the theoretical properties of the fused lasso procedure originally proposed by Tibshirani et al. (2005) in the context of a linear regression model in which the regression coefficient are
Localising change points in piecewise polynomials of general degrees
  • Yi Yu
  • Computer Science, Mathematics
  • 2022
TLDR
This paper proposes a two-step estimation procedure based on the (cid:2) 0 -penalisation and provides upper bounds on the localisation error and deriving global information-theoretic lower bounds, which show that the two- step estimators are nearly minimax rate-optimal.
Change Point Detection for High-dimensional Linear Models: A General Tail-adaptive Approach
TLDR
A novel tail- Adaptive approach for simultaneous change point testing and estimation and combined with the wild binary segmentation technique, a new algorithm is proposed to detect multiple change points in a tail-adaptive manner.
Localising change points in piecewise polynomials of general degrees
TLDR
A two-step estimation procedure based on the $\ell_0$-penalisation and upper bounds on the localisation error are provided and it is shown that the estimator enjoys near optimally adaptive performance by attaining individual localisation errors depending on the level of smoothness at individual change points of the underlying signal.
Fast and Scalable Algorithm for Detection of Structural Breaks in Big VAR Models
TLDR
A novel procedure is proposed which leverages a block segmentation scheme (BSS) that reduces the number of model parameters to be estimated through a regularized least-square criterion and leads to significant computational gains without compromising on the statistical accuracy in identifying the number and location of the structural breaks.
Inference in high-dimensional online changepoint detection
TLDR
An online algorithm is proposed that produces an interval with guaranteed nominal coverage, and whose length is, with high probability, of the same order as the average detection delay, up to a logarithmic factor.
A review on minimax rates in change point detection and localisation.
  • Yi Yu
  • Computer Science
  • 2020
TLDR
This paper starts with the univariate mean change point analysis problem and review the state-of-the-art results in the literature, then moves on to more complex data types and investigates general principles behind the optimal procedures that lead to minimax rate-optimal results.
A Contrastive Approach to Online Change Point Detection
We suggest a novel procedure for online change point detection. Our approach expands an idea of maximizing a discrepancy measure between points from pre-change and post-change distributions. This
Inference for Change Points in High Dimensional Mean Shift Models
We consider the problem of constructing confidence intervals for the locations of change points in a high-dimensional mean shift model. To that end, we develop a locally refitted least squares
Inference on the Change Point in High Dimensional Dynamic Graphical Models
TLDR
It is shown that the proposed estimator retains sufficient adaptivity against plugin estimates of the edge structure of the underlying graphical models, in order to yield an O(\psi^{-2}) rate of convergence of the change point estimator in the integer scale.

References

SHOWING 1-10 OF 33 REFERENCES
Parameter estimation for high dimensional change point regression models without grid search
TLDR
An L1 regularized estimator is proposed for the parameters of a high dimensional change point regression model and the corresponding rates of convergence for the regression as well change point estimates are provided.
Computationally efficient change point detection for high-dimensional regression
TLDR
This work proposes a joint estimator of the number and the locations of the change points and of the parameters in the corresponding segments of the data-generating process and establishes oracle inequalities for the estimator as well as for its binary search approximation.
Oracle Estimation of a Change Point in High-Dimensional Quantile Regression
ABSTRACT In this article, we consider a high-dimensional quantile regression model where the sparsity structure may differ between two sub-populations. We develop ℓ1-penalized estimators of both
High dimensional change point estimation via sparse projection
TLDR
A two‐stage procedure called inspect is proposed for estimation of the change points, arguing that a good projection direction can be obtained as the leading left singular vector of the matrix that solves a convex optimization problem derived from the cumulative sum transformation of the time series.
Multiscale change point inference
TLDR
A new estimator, the simultaneous multiscale change point estimator SMUCE, is introduced, which achieves the optimal detection rate of vanishing signals as n→∞, even for an unbounded number of change points.
Narrowest Significance Pursuit: inference for multiple change-points in linear models
TLDR
The Narrowest Significance Pursuit enables the opposite viewpoint and paves the way for the concept of "post-inference selection", and its key computational component uses simple linear programming.
The lasso for high dimensional regression with a possible change point
  • S. Lee, M. Seo, Youngki Shin
  • Mathematics, Computer Science
    Journal of the Royal Statistical Society. Series B, Statistical methodology
  • 2016
TLDR
It is established conditions under which the estimation error of the unknown threshold parameter can be bounded by a factor that is nearly n−1 even when the number of regressors can be much larger than the sample size n.
Optimal covariance change point localization in high dimensions
TLDR
The first algorithm, called Wild Binary Segmentation through Independent Projection (WBSIP), is shown to be optimal in the sense of allowing for the minimax scaling in all the relevant parameters, and a phase transition effect based on the problem of change point localization is revealed.
Optimal Covariance Change Point Detection in High Dimension
TLDR
The first algorithm, called Wild Binary Segmentation through Independent Projection (WBSIP) is shown to be minimax optimal in the in terms of all the relevant parameters, and the minimax analysis reveals a phase transition effect based on the generic model setting.
Optimal change point detection and localization in sparse dynamic networks
TLDR
This work proposes a computationally simple novel algorithm for network change point localization, called Network Binary Segmentation, which relies on weighted averages of the adjacency matrices, and devise a more sophisticated algorithm based on singular value thresholding, called Local Refinement, that delivers more accurate estimates of the change point locations.
...
...