Bayesian alternatives for common null-hypothesis significance tests in psychiatry: a non-technical guide using JASP

@article{Quintana2018BayesianAF,
  title={Bayesian alternatives for common null-hypothesis significance tests in psychiatry: a non-technical guide using JASP},
  author={Daniel S. Quintana and Donald R. Williams},
  journal={BMC Psychiatry},
  year={2018},
  volume={18}
}
BackgroundDespite its popularity as an inferential framework, classical null hypothesis significance testing (NHST) has several restrictions. Bayesian analysis can be used to complement NHST, however, this approach has been underutilized largely due to a dearth of accessible software options. JASP is a recently developed open-source statistical package that facilitates both Bayesian and NHST analysis using a graphical interface. This article provides an applied introduction to Bayesian… 
View on Springer
bmcpsychiatry.biomedcentral.com
197 Citations
Highly Influential Citations
23
Background Citations
42
Methods Citations
45
Results Citations
7

197 Citations

Citation Type

Citation Type

An Introduction to Calculating Bayes Factors in JASP for Speech, Language, and Hearing Research.
TLDR
This article provides an introduction to BFs through JASP, a free, open-source, graphics-based statistics package that allows researchers to easily conduct both NHST and Bayesian analyses in a clear and reproducible manner.
A Bayesian Analysis of Evidence in Support of the Null Hypothesis in Gerontological Psychology (or Lack Thereof).
  • C. Brydges, A. Bielak
  • Psychology
    The journals of gerontology. Series B, Psychological sciences and social sciences
  • 2019
TLDR
Bayesian analyses are rarely used in gerontological research, and a large proportion of null findings were deemed inconclusive when reanalyzed with BFs, a statistical technique that can distinguish between conclusive and inconclusive non-significant results.
Complementing the P-value from null-hypothesis significance testing with a Bayes factor from null-hypothesis Bayesian testing.
TLDR
NHBT offers statistical and practical advantages that complement NHST and is recommended to recommend that researchers complement the P-value from NHST with a Bayes factor from NHBT in their research analysis.
Applied Bayesian Approaches for Research in Motor Neuron Disease
TLDR
It is shown that Bayesian statistics is a viable addition of a scientist's statistical toolset, which can help to interpret data.
A Bayesian analysis of non-significant rehabilitation findings: evaluating the evidence in favour of truly absent treatment effects.
Bayesian and frequentist testing for differences between two groups with parametric and nonparametric two‐sample tests
  • Riko Kelter
  • Mathematics
    WIREs Computational Statistics
  • 2020
Testing for differences between two groups is one of the scenarios most often faced by scientists across all domains and is particularly important in the medical sciences and psychology. The…
Testing of hypothesis using the bayes factor
TLDR
The paper tries to establish the Bayes Factor as another practical tool for testing of hypotheses as well as providing a brief overview of theBayes Factor.
An Analysis of Nonsignificant Results in Audiology Using Bayes Factors.
TLDR
Bayes factors (BFs) are underutilized in audiology research, and a large proportion of null findings were deemed inconclusive when re-analyzed with BFs.
Bayesian meta-analysis of fMRI image data
TLDR
Bayesian meta-analysis provides neuroscientists with an alternativeMeta-analysis method for fMRI studies given the improved overlap with the NeuroSynth result and the practical and epistemological value of Bayes Factors that can directly test the presence of an effect.
Towards better hypothesis tests in oxytocin research: Evaluating the validity of auxiliary assumptions
  • D. Quintana
  • Psychology, Biology
    Psychoneuroendocrinology
  • 2022
...
...

References

SHOWING 1-10 OF 49 REFERENCES
Bayesian inference for psychology. Part II: Example applications with JASP
TLDR
This part of this series introduces JASP (http://www.jasp-stats.org), an open-source, cross-platform, user-friendly graphical software package that allows users to carry out Bayesian hypothesis tests for standard statistical problems.
Bayes factor approaches for testing interval null hypotheses.
TLDR
This article develops several Bayes factor 1-sample tests for the assessment of approximate equality and ordinal constraints, which are alternatives to previously developed Bayes factors, which do not allow for interval null hypotheses.
Default “Gunel and Dickey” Bayes factors for contingency tables
TLDR
This work outlines an alternative, Bayes factor method to quantify the evidence for and against the hypothesis of independence in R×C contingency tables, and describes different sampling models for contingency tables.
Harold Jeffreys’s default Bayes factor hypothesis tests: Explanation, extension, and application in psychology
Bayesian t tests for accepting and rejecting the null hypothesis
TLDR
To facilitate use of the Bayes factor, an easy-to-use, Web-based program is provided that performs the necessary calculations and has better properties than other methods of inference that have been advocated in the psychological literature.
Statistical Evidence in Experimental Psychology
TLDR
The authors provide a practical comparison of p values, effect sizes, and default Bayes factors as measures of statistical evidence, using 855 recently published t tests in psychology and conclude that the Bayesian approach is comparatively prudent, preventing researchers from overestimating the evidence in favor of an effect.
Informed Bayesian t-Tests
TLDR
A flexible t-prior for standardized effect size is proposed that allows computation of the Bayes factor by evaluating a single numerical integral and two measures for informed prior distributions that quantify the departure from the objective Bayes factors desiderata of predictive matching and information consistency are proposed.
Null hypothesis significance testing: a review of an old and continuing controversy.
TLDR
The concluding opinion is that NHST is easily misunderstood and misused but that when applied with good judgment it can be an effective aid to the interpretation of experimental data.
Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications
TLDR
Ten prominent advantages of the Bayesian approach are outlined, and several objections to Bayesian hypothesis testing are countered.
Using Bayes to get the most out of non-significant results
TLDR
It is argued Bayes factors allow theory to be linked to data in a way that overcomes the weaknesses of the other approaches, and provides a coherent approach to determining whether non-significant results support a null hypothesis over a theory, or whether the data are just insensitive.
...
...