Finite-sample Analysis of M-estimators using Self-concordance

@article{Ostrovskii2018FinitesampleAO,
  title={Finite-sample Analysis of M-estimators using Self-concordance},
  author={Dmitrii Ostrovskii and F. Bach},
  journal={arXiv: Statistics Theory},
  year={2018}
}
  • Dmitrii Ostrovskii, F. Bach
  • Published 2018
  • Mathematics
  • arXiv: Statistics Theory
  • We demonstrate how self-concordance of the loss can be exploited to obtain asymptotically optimal rates for M-estimators in finite-sample regimes. We consider two classes of losses: (i) canonically self-concordant losses in the sense of Nesterov and Nemirovski (1994), i.e., with the third derivative bounded with the $3/2$ power of the second; (ii) pseudo self-concordant losses, for which the power is removed, as introduced by Bach (2010). These classes contain some losses arising in generalized… CONTINUE READING
    13 Citations

    Figures from this paper

    Beyond Least-Squares: Fast Rates for Regularized Empirical Risk Minimization through Self-Concordance
    • 15
    • PDF
    An improper estimator with optimal excess risk in misspecified density estimation and logistic regression
    • 3
    • Highly Influenced
    • PDF
    Non-asymptotic Optimal Prediction Error for RKHS-based Partially Functional Linear Models
    • 1
    • PDF
    Generalized Self-Concordant Analysis of Frank-Wolfe algorithms
    • 2
    • PDF
    Self-concordant analysis of Frank-Wolfe algorithms
    • 4
    • PDF
    Near-Optimal Model Discrimination with Non-Disclosure.
    • PDF
    Composite convex optimization with global and local inexact oracles
    • 1
    • PDF

    References

    SHOWING 1-10 OF 49 REFERENCES
    Parametric estimation. Finite sample theory
    • 80
    • PDF
    Statistical consistency and asymptotic normality for high-dimensional robust M-estimators
    • 102
    • PDF
    Fast rates with high probability in exp-concave statistical learning
    • 24
    • PDF
    Self-concordant analysis for logistic regression
    • 146
    • PDF