Superconsistency of Tests in High Dimensions
@inproceedings{Kock2021SuperconsistencyOT, title={Superconsistency of Tests in High Dimensions}, author={Anders Kock and David Preinerstorfer}, year={2021} }
To assess whether there is some signal in a big database, aggregate tests for the global null hypothesis of no effect are routinely applied in practice before more specialized analysis is carried out. Although a plethora of aggregate tests is available, each test has its strengths but also its blind spots. In a Gaussian sequence model, we study whether it is possible to obtain a test with substantially better consistency properties than the likelihood ratio (i.e., Euclidean norm based) test. We…
References
SHOWING 1-10 OF 76 REFERENCES
Higher criticism for detecting sparse heterogeneous mixtures
- Mathematics
- 2004
Higher criticism, or second-level significance testing, is a multiplecomparisons concept mentioned in passing by Tukey. It concerns a situation where there are many independent tests of significance…
Power in High‐Dimensional Testing Problems
- MathematicsEconometrica
- 2019
Fan, Liao, and Yao (2015) recently introduced a remarkable method for increasing the asymptotic power of tests in high‐dimensional testing problems. If applicable to a given test, their
power…
Beyond HC: More sensitive tests for rare/weak alternatives
- Mathematics
- 2020
Higher criticism (HC) is a popular method for large-scale inference problems based on identifying unusually high proportions of small pvalues. It has been shown to enjoy a lower-order optimality…
Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
- Mathematics
- 2011
Testing for the significance of a subset of regression coefficients in a linear model, a staple of statistical analysis, goes back at least to the work of Fisher who introduced the analysis of…
Weighted Statistic in Detecting Faint and Sparse Alternatives for High-Dimensional Covariance Matrices
- Mathematics
- 2017
ABSTRACT This article considers testing equality of two population covariance matrices when the data dimension p diverges with the sample size n (p/n → c > 0). We propose a weighted test statistic…
Innovated Higher Criticism for Detecting Sparse Signals in Correlated Noise
- Computer Science
- 2010
It turns out that the case of independent noise is the most difficult of all, from a statistical viewpoint, and that more accurate signal detection can be obtained when correlation is present, by exploiting the nature of correlation.
Combining P-Values Via Averaging
- Mathematics
- 2012
This paper proposes general methods for the problem of multiple testing of a single hypothesis, with a standard goal of combining a number of p-values without making any assumptions about their…
Detection of sparse mixtures: higher criticism and scan statistic
- Computer ScienceElectronic Journal of Statistics
- 2019
Perhaps surprisingly, it is found that in the context of such a power-law distribution, the higher criticism does not achieve the detection boundary, however, the scan statistic does.
Power Enhancement in High Dimensional Cross-Sectional Tests.
- Computer ScienceEconometrica : journal of the Econometric Society
- 2015
A novel technique to boost the power of testing a high-dimensional vector H : θ = 0 against sparse alternatives where the null hypothesis is violated only by a couple of components and the null distribution does not require stringent regularity conditions, and is completely determined by that of the pivotal statistic.
Adaptive hypothesis testing using wavelets
- Mathematics
- 1996
Let a function f be observed with a noise. We wish to test the null hypothesis that the function is identically zero, against a composite nonparametric alternative: functions from the alternative set…