# A Statistical Inference Course Based on p-Values

@article{Martin2016ASI, title={A Statistical Inference Course Based on p-Values}, author={Ryan Martin}, journal={The American Statistician}, year={2016}, volume={71}, pages={128 - 136} }

ABSTRACT Introductory statistical inference texts and courses treat the point estimation, hypothesis testing, and interval estimation problems separately, with primary emphasis on large-sample approximations. Here, I present an alternative approach to teaching this course, built around p-values, emphasizing provably valid inference for all sample sizes. Details about computation and marginalization are also provided, with several illustrative examples, along with a course outline. Supplementary…

## 15 Citations

Generalized inferential models for meta-analyses based on few studies.

- Mathematics
- 2019

A new approach, based on the generalized inferential model framework, whose success lays in marginalizing out the between-study variance, so that an accurate estimate is not essential, and which outperforms existing methods across a wide range of scenarios.

Prior-Free Probabilistic Inference for Econometricians

- EconomicsRobustness in Econometrics
- 2017

This paper is intended to inform econometricians that an alternative inferential model (IM) approach exists that can achieve probabilistic inference without a prior and while enjoying certain calibration properties essential for reproducibility, etc.

Interval estimation, point estimation, and null hypothesis significance testing calibrated by an estimated posterior probability of the null hypothesis

- Psychology
- 2021

Much of the blame for failed attempts to replicate reports of scientific findings has been placed on ubiquitous and persistent misinterpretations of the p value. An increasingly popular solution is...

False confidence, non-additive beliefs, and valid statistical inference

- PhilosophyInt. J. Approx. Reason.
- 2019

An imprecise-probabilistic characterization of frequentist statistical inference

- Mathematics
- 2021

Between the two dominant schools of thought in statistics, namely, Bayesian and classical/frequentist, a main difference is that the former is grounded in the mathematically rigorous theory of…

General and feasible tests with multiply-imputed datasets

- Computer ScienceThe Annals of Statistics
- 2022

A general MI procedure is proposed, called stacked multiple imputation (SMI), for performing Wald’s tests, likelihood ratio tests and Rao's score tests by a unified algorithm that requires neither EOMI nor an infinite number of imputations.

Response to the comment Confidence in confidence distributions!

- MathematicsProceedings of the Royal Society A
- 2021

Thanks to Drs Céline Cunen, Nils Lid Hjort and Tore Schweder for their interest in our recent contribution [1] concerning the probability dilution phenomenon in satellite conjunction analysis and,…

A mathematical characterization of confidence as valid belief

- Philosophy
- 2017

Confidence is a fundamental concept in statistics, but there is a tendency to misinterpret it as probability. In this paper, I argue that an intuitively and mathematically more appropriate…

Correcting for attenuation due to measurement error

- Geology
- 2019

I present a frequentist method for quantifying uncertainty when correcting correlations for attenuation due to measurement error. The method is conservative but has far better coverage properties…

Valid Model-Free Prediction of Future Insurance Claims

- EconomicsNorth American Actuarial Journal
- 2020

Bias resulting from model misspecification is a concern when predicting insurance claims. Indeed, this bias puts the insurer at risk of making invalid or unreliable predictions. A method that could…

## References

SHOWING 1-10 OF 35 REFERENCES

Statistical Inference: Likelihood to Significance

- Mathematics
- 1991

Abstract The concepts of likelihood and significance were defined and initially developed by R. A. Fisher, but followed almost separate and distinct routes. We suggest that a central function of…

P Values: What They are and What They are Not

- Mathematics
- 1996

Abstract P values (or significance probabilities) have been used in place of hypothesis tests as a means of giving more information about the relationship between the data and the hypothesis than…

Confidence Curves: An Omnibus Technique for Estimation and Testing Statistical Hypotheses

- Mathematics
- 1961

Abstract A standard practice of physical scientists is to report estimates (“measurements”) accompanied by their standard errors (or alternatively “average errors” or “probable errors”). Such reports…

Confidence, Likelihood, Probability: Statistical Inference with Confidence Distributions

- Mathematics
- 2016

This lively book lays out a methodology of confidence distributions and puts them through their paces. Among other merits, they lead to optimal combinations of confidence from different sources of…

Plausibility Functions and Exact Frequentist Inference

- Mathematics
- 2015

In the frequentist program, inferential methods with exact control on error rates are a primary focus. The standard approach, however, is to rely on asymptotic approximations, which may not be…

Applied Asymptotics: Case Studies in Small-Sample Statistics

- Mathematics, Computer Science
- 2007

Uncertainty and approximation, regression with continuous responses, and likelihood approximations - some numerical techniques:.

Estimation in Parallel Randomized Experiments

- Mathematics
- 1981

Many studies comparing new treatments to standard treatments consist of parallel randomized experiments. In the example considered here, randomized experiments were conducted in eight schools to…

Paradoxes and Improvements in Interval Estimation

- Mathematics, Business
- 2000

Abstract Cases where confidence sets are empty or include every possible parameter value are an embarrassment to standard theory and difficult to explain to students. To alleviate this problem, and…

Confidence and Likelihood *

- Mathematics
- 2001

Confidence intervals for a single parameter are spanned by quantiles of a confidence distribution, and one‐sided p‐values are cumulative confidences. Confidence distributions are thus a unifying…

Inferential Models: Reasoning with Uncertainty

- Computer Science
- 2015

Preliminaries Introduction Assumed background Scientific inference: An overview Prediction and inference Outline of the book Prior-Free Probabilistic Inference, and some further technical details.