How Large Are Your G-Values? Try Gosset’s Guinnessometrics When a Little “p” Is Not Enough

@article{Ziliak2019HowLA,
  title={How Large Are Your G-Values? Try Gosset’s Guinnessometrics When a Little “p” Is Not Enough},
  author={Stephen T. Ziliak},
  journal={The American Statistician},
  year={2019},
  volume={73},
  pages={281 - 290}
}
  • S. Ziliak
  • Published 20 March 2019
  • Education
  • The American Statistician
Abstract A crisis of validity has emerged from three related crises of science, that is, the crises of statistical significance and complete randomization, of replication, and of reproducibility. Guinnessometrics takes commonplace assumptions and methods of statistical science and stands them on their head, from little p-values to unstructured Big Data. Guinnessometrics focuses instead on the substantive significance which emerges from a small series of independent and economical yet balanced… 

Comparative Probability Metrics: Using Posterior Probabilities to Account for Practical Equivalence in A/B tests

ABSTRACT Recently, online-controlled experiments (i.e., A/B tests) have become an extremely valuable tool used by internet and technology companies for purposes of advertising, product development,

Moving to a World Beyond “p < 0.05”

Some of you exploring this special issue of The American Statistician might be wondering if it’s a scolding from pedantic statisticians lecturing you about what not to do with p-values, without

bayes4psy—An Open Source R Package for Bayesian Statistics in Psychology

The bayes4psy package is to bridge the gap and offer a collection of models and methods to be used for analysing data that arises from psychological experiments and as a teaching tool for Bayesian statistics in psychology.

bayes4psy -- an Open Source R Package for Bayesian Statistics in Psychology

The bayes4psy package is to bridge the gap and offer a collection of models and methods to be used for analysing data that arises from psychological experiments and as a teaching tool for Bayesian statistics in psychology.

WHEN AND WHERE P-VALUE IS REQUIRED: MISNOMERS IN CLINICALAND STATISTICAL SIGNIFICANCE

The interpretation of the p-value has been an arena for discussion making it difficult for many researchers, so the usage of the confidence intervals around the sample statistics and effect size should be given more importance than relying solely upon the statistical significance.

Quantifying microbial control of soil organic matter dynamics at macrosystem scales

Soil organic matter (SOM) stocks, decomposition and persistence are largely the product of controls that act locally. Yet the controls are shaped and interact at multiple spatiotemporal scales, from

Computational Intelligence From Autonomous System to Super-Smart Society and Beyond

  • R. Fiorini
  • Engineering
    Int. J. Softw. Sci. Comput. Intell.
  • 2020
Main implications of current autonomous system through the symbiotics autonomous system (SAS) and the symbiotic system science (SSS) towards the incoming super-smart society are discussed.

References

SHOWING 1-10 OF 56 REFERENCES

Signifying nothing: reply to Hoover and Siegler

After William Gosset (1876–1937), the ‘Student’ of Student's t, the best statisticians have distinguished economic (or agronomic or psychological or medical) significance from merely statistical

Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations

Misinterpretation and abuse of statistical tests, confidence intervals, and statistical power have been decried for decades, yet remain rampant. A key problem is that there are no interpretations of

The ASA Statement on p-Values: Context, Process, and Purpose

Cobb’s concern was a long-worrisome circularity in the sociology of science based on the use of bright lines such as p< 0.05: “We teach it because it’s what we do; we do it because it’s what we

ASA Statement on Statistical Significance and p-Values

145707973/the-problem-with-p-values-how-signi!cant-are-they-really. html. [129] Siegfried, T. (2010), “Odds Are, It’s Wrong: Science Fails to Face the Shortcomings of Statistics,” Science News, 177,

Thinking, Fast and Slow

Daniel Kahneman, recipient of the Nobel Prize in Economic Sciences for his seminal work in psychology challenging the rational model of judgment and decision making, is one of the world's most

Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don't know P

  • M. Lew
  • Psychology
    British journal of pharmacology
  • 2012
This paper explains the distinction between Fisher's P‐values, which are local indices of evidence against the null hypothesis in the results of a particular experiment, and Neyman–Pearson α levels,Which are global rates of false positive errors from unrelated experiments taken as an aggregate.

A comment on replication, p-values and evidence.

It is shown that if the observed difference is the true one, the probability of repeating a statistically significant result, the 'replication probability', is substantially lower than expected.

Revised standards for statistical evidence

  • V. Johnson
  • Computer Science
    Proceedings of the National Academy of Sciences
  • 2013
Modifications of common standards of evidence are proposed to reduce the rate of nonreproducibility of scientific research by a factor of 5 or greater and to correct the problem of unjustifiably high levels of significance.

Balanced versus Randomized Field Experiments in Economics: Why W. S. Gosset aka "Student" Matters

Over the past decade randomized field experiments have gained prominence in the toolkit of empirical economics and policy making. In an article titled "Field Experiments in Economics: The Past, the
...