Corpus ID: 88512633

Is the p-value a good measure of evidence? An asymptotic consistency criterion

@article{Grendr2011IsTP,
  title={Is the p-value a good measure of evidence? An asymptotic consistency criterion},
  author={Mari{\'a}n Grend{\'a}r},
  journal={arXiv: Statistics Theory},
  year={2011}
}
  • M. Grendár
  • Published 21 November 2011
  • Mathematics
  • arXiv: Statistics Theory
What are the criteria that a measure of statistical evidence should satisfy? It is argued that a measure of evidence should be consistent. Consistency is an asymptotic criterion: the probability that if a measure of evidence in data strongly testifies against a hypothesis H, then H is indeed not true, should go to one, as more and more data appear. The p-value is not consistent, while the ratio of likelihoods is. 
A classical measure of evidence for general null hypotheses
TLDR
This paper proposes an objective measure of evidence for very general null hypotheses that satisfies logical requirements and concludes that it can be used to establish objective states of belief on the subsets of Θ . Expand

References

SHOWING 1-10 OF 24 REFERENCES
The Strength of Statistical Evidence for Composite Hypotheses with an Application to Multiple Comparisons
The strength of the statistical evidence in a sample of data that favors one composite hypothesis over another may be quantified by the likelihood ratio using the parameter value consistent with eachExpand
Bayes Factors: What They are and What They are Not
Abstract Bayes factors have been offered by Bayesians as alternatives to P values (or significance probabilities) for testing hypotheses and for quantifying the degree to which observed data supportExpand
Calibration of ρ Values for Testing Precise Null Hypotheses
P values are the most commonly used tool to measure evidence against a hypothesis or hypothesized model. Unfortunately, they are often incorrectly viewed as an error probability for rejection of theExpand
On the Probability of Observing Misleading Statistical Evidence
Abstract The law of likelihood explains how to interpret statistical data as evidence. Specifically, it gives to the discipline of statistics a precise and objective measure of the strength ofExpand
P Values: What They are and What They are Not
Abstract P values (or significance probabilities) have been used in place of hypothesis tests as a means of giving more information about the relationship between the data and the hypothesis thanExpand
On defining P-values
The Fisherian prescription of reporting P-values as a summary of a result, as compared to the Neyman-Pearson system of acceptance or rejection of a null hypothesis, is more common in applied science.Expand
A Law of Likelihood for Composite Hypotheses
The law of likelihood underlies a general framework, known as the likelihood paradigm, for representing and interpreting statistical evidence. As stated, the law applies only to simple hypotheses,Expand
Statistical Evidence: A Likelihood Paradigm
The First Principle Introduction The Law of Likelihood Three Questions Towards Verification Relativity of Evidence Strength of Evidence Counterexamples Testing Simple Hypotheses Composite HypothesesExpand
Relationships Among Sample Size, Model Selection and Likelihood Regions, and Scientifically Important Differences
, in multidimensional models, simultaneous confidence or credibility regions for continuous parameters hold the overall frequentist long run or Bayesian posterior probability constant at some levelExpand
Logic of Statistical Inference
TLDR
This chapter discusses the long run frequencies, statistical tests, and theories of testing that led to Bayes' theory, as well as the subjective theory. Expand
...
1
2
3
...