Aggregation of Affine Estimators
- Dong Dai, P. Rigollet, Lucy Xia, Tong Zhang
- MathematicsArXiv
- 12 November 2013
It is shown that the proposed estimator leads simultaneously to all the best known bounds for aggregation, including $\ell_q$-aggregation, $q \in (0,1)$, with high probability.
QUADRO: A SUPERVISED DIMENSION REDUCTION METHOD VIA RAYLEIGH QUOTIENT OPTIMIZATION.
- Jianqing Fan, Z. Ke, Han Liu, Lucy Xia
- Computer ScienceAnnals of Statistics
- 21 November 2013
This paper proposes a novel Rayleigh quotient based sparse quadratic dimension reduction method-named QUADRO (Quadratic Dimension Reduction via Rayleigh Optimization)-for analyzing high-dimensional data and proposes an efficient linearized augmented Lagrangian method to solve the constrained optimization problem.
Unifying approach to selective inference with applications to cross-validation
- J. Marković, Lucy Xia, Jonathan E. Taylor
- Computer Science, Mathematics
- 20 March 2017
We develop tools to do valid post-selective inference for a family of model selection procedures, including choosing a model via cross-validated Lasso. The tools apply universally when the following…
A Projection-based Conditional Dependence Measure with Applications to High-dimensional Undirected Graphical Models.
- Jianqing Fan, Yang Feng, Lucy Xia
- Computer ScienceJournal of Econometrics
- 7 January 2015
A Conditional Dependence Measure with Applications to Undirected Graphical Models
- Jianqing Fan, Yang Feng, Lucy Xia
- Mathematics
- 7 January 2015
Measuring conditional dependence is an important topic in statistics with broad applications including graphical models. Under a factor model setting, a new conditional dependence measure is…
Neyman-Pearson classification: parametrics and sample size requirement
- Xin Tong, Lucy Xia, Jiacheng Wang, Yang Feng
- Computer ScienceJournal of machine learning research
- 7 February 2018
A new parametric thresholding algorithm is proposed, which does not need the minimum sample size requirements on class $0$ observations and thus is suitable for small sample applications such as rare disease diagnosis and proves NP oracle inequalities for one proposed classifier.
Inferactive data analysis
- Nan Bi, J. Marković, Lucy Xia, Jonathan E. Taylor
- Computer ScienceScandinavian Journal of Statistics
- 20 July 2017
The approach is a compromise between Tukey's exploratory and confirmatory data analysis allowing also for Bayesian data analysis, and the basis of inference is (a conditional approach to) selective inference, in particular its randomized form.
Intentional Control of Type I Error Over Unconscious Data Distortion: A Neyman–Pearson Approach to Text Classification
- Lucy Xia, Richard Zhao, Yanhui Wu, Xin Tong
- Computer Science
- 7 February 2018
This article addresses the challenges in classifying textual data obtained from open online platforms, which are vulnerable to distortion and proposes the use of the Neyman–Pearson (NP) classification paradigm, which minimizes Type II error under a user-specified Type I error constraint.
Comparison of prediction errors: Adaptive p-values after cross-validation
- J. Marković, Lucy Xia, Jonathan E. Taylor
- Computer Science, Mathematics
- 20 March 2017
A novel variation to these model selection procedures by adding Gaussian randomizations to either one of the two vectors, illustrating the method through adding randomization and applying the technical tools to four important procedures for which no valid selective inference has yet developed.
Intentional control of type I error over unconscious data distortion: a Neyman-Pearson classification approach
- Lucy Xia, Richard Zhao, Yanhui Wu, Xin Tong
- Computer Science
- 7 February 2018
This work proposes a new distortion-invariant statistical approach to parse data, based on the Neyman-Pearson (NP) classification paradigm, and illustrates the working of this new method by combining the recently developed NP umbrella algorithm with topic modeling to automatically detect posts that are related to strikes and corruption in samples of randomly selected posts extracted from Sina Weibo.
...
...