Median of the p Value Under the Alternative Hypothesis

  title={Median of the p Value Under the Alternative Hypothesis},
  author={Bhaskar Bhattacharya and Desale Habtzghi},
  journal={The American Statistician},
  pages={202 - 206}
Due to absence of an universally acceptable magnitude of the Type I error in various fields, p values are used as a well-recognized tool in decision making in all areas of statistical practice. The distribution of p values under the null hypothesis is uniform. However, under the alternative hypothesis the distribution of the p values is skewed. The expected p value (EPV) has been proposed by authors to be used as a measure of the performance of the test. This article proposes the median of the… 

The p value line: a way to choose the tuning constant in tests based on the Huber M -estimator

In this paper, we propose a method to choose a test result from several competing ones. The choice is based on the p value under the alternative, i.e., the probability of obtaining an extreme or a

P Values are not Error Probabilities

Confusion surrounding the reporting and interpretation of results of classical statistical tests is widespread among applied researchers. The confusion stems from the fact that most of these

Change Detection Based on the Distribution of p-Values

A new method based on the information about the distribution of p-values is presented and discussed in this article as well as classical methods such as Bonferroni correction and the Bonferronsi-Holm method which account for the multiple testing issue and consequently improve reliability of change detection.

The p value line: a way to choose the tuning constant in tests based on the Huber $${\varvec{M}}$$M-estimator

In this paper, we propose a method to choose a test result from several competing ones. The choice is based on the p value under the alternative, i.e., the probability of obtaining an extreme or a

A Reckless Guide to P-values : Local Evidence, Global Errors.

  • M. Lew
  • Economics
    Handbook of experimental pharmacology
  • 2020
This chapter demystifies P-values, hypothesis tests and significance tests and introduces the concepts of local evidence and global error rates, which are useful indices of evidence and deserve their place in the statistical toolbox of basic pharmacologists.

Nonparametric Power-Law Surrogates

Power-law distributions are essential in computational and statistical investigations of extreme events and complex systems. The usual technique to generate power-law distributed data is to first

Reproducibility of statistical test results based on p-value

  • T. Yanagawa
  • Mathematics
    Japanese Journal of Biometrics
  • 2020
Reproducibility is the essence of a scientific research. Focusing on two-sample problems we discuss in this paper the reproducibility of statistical test results based on p-values. First,

To P or not to P: on the evidential nature of P-values and their place in scientific inference

It is shown that P-values quantify experimental evidence not by their numerical value, but through the likelihood functions that they index.

Using pValue to Measure Significance Level of Continuous Data

In this paper, we provide a practical method on how to calculate pValue for continuous data. In later paper, we will cover pValue for discrete data. For continuous distribution in part 1, we defined


Using exact, analytic results for the average power of the Benjamini-Hochberg (1995) procedure, we provide example power analyses useful for scientists planning studies involving multiple



P Values as Random Variables—Expected P Values

Abstract p values are extensively reported in practical hypothesis testing situations. Although carefully studied by Dempster and Schatzoff, the stochastic aspect of p values is often neglected. In

Sensitivity Comparisons among Tests of the General Linear Hypothesis

Abstract The expected significance level (ESL) of a test, proposed by Dempster and Schatzoff (4) as a criterion for comparing sensitivities of competing test statistics, is defined as the expected

P Values: What They are and What They are Not

Abstract P values (or significance probabilities) have been used in place of hypothesis tests as a means of giving more information about the relationship between the data and the hypothesis than

When is a p-Value a Good Measure of Evidence?

Blyth and Staudte (1993, 1995a) introduced the notion of a level-α weight of evidence for an alternative to a hypothesis; it is an estimator of the ideal power function which gives for each

Hypothesis Estimates and Acceptability Profiles for 2 × 2 Contingency Tables

Abstract By estimating, rather than testing, hypotheses regarding the degree of dependence between the factors in 2 × 2 tables, the technical difficulties associated with small sample sizes are

Expected Significance Level as a Sensitivity Index for Test Statistics

Abstract After a brief motivating discussion, of approaches to significance tests in Section 1, the concept of expected significance level (esl) is defined and its basic properties are presented in

Order restricted statistical inference

Isotonic Regression. Tests of Ordered Hypotheses: The Normal Means Case. Tests of Ordered Hypotheses: Generalizations of the Likelihood Ratio Tests and Other Procedures. Inferences about a Set of

P-values: Interpretation and Methodology

The behavior of the P-value when the alternative hypothesis is true.

Potential applications of the P-value distribution under the alternative hypothesis to the design, analysis, and interpretation of results of clinical trials are considered.

Testing Statistical Hypotheses, (2nd edition)

  • 1986