# 'Too Many, Too Improbable' test statistics: A general method for testing joint hypotheses and controlling the k-FWER

@inproceedings{Mogensen2021TooMT, title={'Too Many, Too Improbable' test statistics: A general method for testing joint hypotheses and controlling the k-FWER}, author={P. B. Mogensen and Bo Markussen}, year={2021} }

Hypothesis testing is a key part of empirical science and multiple testing as well as the combination of evidence from several tests are continued areas of research. In this article we consider the problem of combining the results of multiple hypothesis tests to i) test global hypotheses and ii) make marginal inference while controlling the k-FWER. We propose a new family of combination tests for joint hypotheses, which we show through simulation to have higher power than other combination…

## Figures and Tables from this paper

## References

SHOWING 1-10 OF 20 REFERENCES

Controlling the false discovery rate: a practical and powerful approach to multiple testing

- Business
- 1995

SUMMARY The common approach to the multiplicity problem calls for controlling the familywise error rate (FWER). This approach, though, has faults, and we point out a few. A different approach to…

Rank truncated product of P‐values, with application to genomewide association scans

- Mathematics, BiologyGenetic epidemiology
- 2003

It is shown that, under realistic scenarios, forming the product of the K most significant P‐values provides increased power to detect genomewide association, while identifying a candidate set of good quality and fixed size for follow‐up studies.

Cauchy Combination Test: A Powerful Test With Analytic p-Value Calculation Under Arbitrary Dependency Structures

- Computer ScienceJournal of the American Statistical Association
- 2020

It is proved a nonasymptotic result that the tail of the null distribution of the proposed test statistic can be well approximated by a Cauchy distribution under arbitrary dependency structures, making the p-value calculation of this proposed test well suited for analyzing massive data.

The harmonic mean p-value for combining dependent tests

- Computer ScienceProceedings of the National Academy of Sciences
- 2019

The harmonic mean p-value (HMP) is introduced, a simple to use and widely applicable alternative to Bonferroni correction motivated by Bayesian model averaging that greatly improves statistical power while maintaining control of the gold standard false positive rate.

Truncated product method for combining P‐values

- MathematicsGenetic epidemiology
- 2002

A new procedure to take the product of only those P‐values less than some specified cut‐off value and to evaluate the probability of such a product, or a smaller value, under the overall hypothesis that all L hypotheses are true is presented.

On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics

- Mathematics
- 2000

A new approach to problems of multiple significance testing was presented in Benjamini and Hochberg (1995), which calls for controlling the expected ratio of the number of erroneous rejections to the…

Controlling Error in Multiple Comparisons, with Examples from State-to-State Differences in Educational Achievement

- Education
- 1999

Three alternative procedures to adjust significance levels for multiplicity are the traditional Bonferroni technique, a sequential Bonferroni technique developed by Hochberg (1988), and a sequential…

400: A Method for Combining Non-Independent, One-Sided Tests of Significance

- Mathematics
- 1975

Littell and Folks [.1971, 1973] show that Fisher's method of combining independenlt tests of significance is asymptotically optimal among essentially all methods of combining independent tests. By…