How Large Are Your G-Values? Try Gosset’s Guinnessometrics When a Little “p” Is Not Enough

@article{Ziliak2019HowLA,
  title={How Large Are Your G-Values? Try Gosset’s Guinnessometrics When a Little “p” Is Not Enough},
  author={S. Ziliak},
  journal={The American Statistician},
  year={2019},
  volume={73},
  pages={281 - 290}
}
  • S. Ziliak
  • Published 2019
  • Psychology
  • The American Statistician
Abstract A crisis of validity has emerged from three related crises of science, that is, the crises of statistical significance and complete randomization, of replication, and of reproducibility. Guinnessometrics takes commonplace assumptions and methods of statistical science and stands them on their head, from little p-values to unstructured Big Data. Guinnessometrics focuses instead on the substantive significance which emerges from a small series of independent and economical yet balanced… Expand
11 Citations
Moving to a World Beyond “p < 0.05”
Some of you exploring this special issue of The American Statistician might be wondering if it’s a scolding from pedantic statisticians lecturing you about what not to do with p-values, withoutExpand
bayes4psy—An Open Source R Package for Bayesian Statistics in Psychology
TLDR
The bayes4psy package is to bridge the gap and offer a collection of models and methods to be used for analysing data that arises from psychological experiments and as a teaching tool for Bayesian statistics in psychology. Expand
bayes4psy -- an Open Source R Package for Bayesian Statistics in Psychology
TLDR
The bayes4psy package is to bridge the gap and offer a collection of models and methods to be used for analysing data that arises from psychological experiments and as a teaching tool for Bayesian statistics in psychology. Expand
WHEN AND WHERE P-VALUE IS REQUIRED: MISNOMERS IN CLINICALAND STATISTICAL SIGNIFICANCE
The interpretation of the p-value has been an arena for discussion making it difficult for many researchers. The p-value was introduced in 1900 by Pearson. Though, it is very difficult to commentExpand
New paradigms for considering statistical significance: A way forward for health services research journals, their authors, and their readership.
  • James B. Schreiber
  • Medicine, Sociology
  • Research in social & administrative pharmacy : RSAP
  • 2019
This commentary discusses the new American Statistical Association forty-three article issue in The American Statistician. I cover some history of p-values, misunderstandings, along with NHST and theExpand
Scientific value of econometric tourism demand studies
The objective of this paper was to evaluate the scientific value of econometric tourism demand studies. Based on a questionnaire answered by ourselves we analyzed articles published in Annals ofExpand
Computational Intelligence From Autonomous System to Super-Smart Society and Beyond
  • R. Fiorini
  • Computer Science
  • Int. J. Softw. Sci. Comput. Intell.
  • 2020
In this article the author discusses main implications of current autonomous system (AS) through the symbiotic autonomous system (SAS) and the symbiotic system science (SSS) towards the incomingExpand
Pyrogenic organic matter effects on soil bacterial community composition
Abstract Pyrogenic organic matter (PyOM) is produced by the incomplete combustion of organic matter, and can represent a large portion of total soil organic carbon in both fire-affected systems andExpand
Quantifying microbial control of soil organic matter dynamics at macrosystem scales
Soil organic matter (SOM) stocks, decomposition and persistence are largely the product of controls that act locally. Yet the controls are shaped and interact at multiple spatiotemporal scales, fromExpand
...
1
2
...

References

SHOWING 1-10 OF 65 REFERENCES
The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives
"Statistical significance," a technique that dominates medicine, economics, psychology, and many other scientific fields, has been a huge mistake. The outcome is a case study in bad science - how itExpand
Signifying nothing: reply to Hoover and Siegler
After William Gosset (1876–1937), the ‘Student’ of Student's t, the best statisticians have distinguished economic (or agronomic or psychological or medical) significance from merely statisticalExpand
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Misinterpretation and abuse of statistical tests, confidence intervals, and statistical power have been decried for decades, yet remain rampant. A key problem is that there are no interpretations ofExpand
The ASA Statement on p-Values: Context, Process, and Purpose
Cobb’s concern was a long-worrisome circularity in the sociology of science based on the use of bright lines such as p< 0.05: “We teach it because it’s what we do; we do it because it’s what weExpand
The Illusion of Predictability: How Regression Statistics Mislead Experts
TLDR
The implications of the study suggest the need to reconsider the way in which empirical results are presented, and the possible provision of easy-to-use simulation tools that would enable readers of empirical papers to make accurate inferences. Expand
ASA Statement on Statistical Significance and p-Values
145707973/the-problem-with-p-values-how-signi!cant-are-they-really. html. [129] Siegfried, T. (2010), “Odds Are, It’s Wrong: Science Fails to Face the Shortcomings of Statistics,” Science News, 177,Expand
Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don't know P
  • M. Lew
  • Psychology, Medicine
  • British journal of pharmacology
  • 2012
TLDR
This paper explains the distinction between Fisher's P‐values, which are local indices of evidence against the null hypothesis in the results of a particular experiment, and Neyman–Pearson α levels,Which are global rates of false positive errors from unrelated experiments taken as an aggregate. Expand
A comment on replication, p-values and evidence.
  • S. Goodman
  • Mathematics, Medicine
  • Statistics in medicine
  • 1992
TLDR
It is shown that if the observed difference is the true one, the probability of repeating a statistically significant result, the 'replication probability', is substantially lower than expected. Expand
Revised standards for statistical evidence
  • V. Johnson
  • Medicine, Mathematics
  • Proceedings of the National Academy of Sciences
  • 2013
TLDR
Modifications of common standards of evidence are proposed to reduce the rate of nonreproducibility of scientific research by a factor of 5 or greater and to correct the problem of unjustifiably high levels of significance. Expand
Balanced versus Randomized Field Experiments in Economics: Why W. S. Gosset aka "Student" Matters
Over the past decade randomized field experiments have gained prominence in the toolkit of empirical economics and policy making. In an article titled "Field Experiments in Economics: The Past, theExpand
...
1
2
3
4
5
...