Can Visualization Alleviate Dichotomous Thinking? Effects of Visual Representations on the Cliff Effect

@article{Helske2021CanVA,
  title={Can Visualization Alleviate Dichotomous Thinking? Effects of Visual Representations on the Cliff Effect},
  author={Jouni Helske and Satu Helske and Matthew D. Cooper and Anders Ynnerman and Lonni Besançon},
  journal={IEEE Transactions on Visualization and Computer Graphics},
  year={2021},
  volume={27},
  pages={3397-3409}
}
Common reporting styles for statistical results in scientific articles, such as <inline-formula><tex-math notation="LaTeX">$p$</tex-math><alternatives><mml:math><mml:mi>p</mml:mi></mml:math><inline-graphic xlink:href="helske-ieq1-3073466.gif"/></alternatives></inline-formula>-values and confidence intervals (CI), have been reported to be prone to dichotomous interpretations, especially with respect to the null hypothesis significance testing framework. For example when the <inline-formula><tex… 

Figures and Tables from this paper

Doing Better Data Visualization

Methods in data visualization have rapidly advanced over the past decade. Although social scientists regularly need to visualize the results of their analyses, they receive little training in how to

Sources of information waste in neuroimaging: mishandling structures, thinking dichotomously, and over-reducing data

TLDR
This work examines three sources of substantial information loss and proposes a Bayesian multilevel modeling framework that closely characterizes the data hierarchies across spatial units and experimental trials to improve inference efficiency, predictive accuracy, and generalizability in neuroimaging.

Dichotomous thinking and informational waste in neuroimaging

TLDR
To improve inference efficiency, predictive accuracy, and generalizability, a Bayesian multilevel modeling framework is proposed and four actionable suggestions to alleviate information waste and to improve reproducibility are made.

Publishing Visualization Studies as Registered Reports: Expected Benefits and Researchers’ Attitudes

TLDR
A brief introduction to Registered Reports and their expected benefits for visualization research is offered and a survey of the visualization community on their attitudes towards Registered Reports is reported.

Building a Thinking Visualization System Based on AI Multiple Intelligence Theory in the 5G Era

  • Xinyan Zhang
  • Computer Science
    2022 International Conference on Artificial Intelligence in Everything (AIE)
  • 2022
The advent of the Internet information age has had a significant impact on people’s lifestyles. The combination of 5G mobile network and artificial intelligence is eye-catching in current and future

Hybrid Touch/Tangible Spatial Selection in Augmented Reality

TLDR
This paper theorize, discuss, and study different available mappings for manual spatial selections using a tangible tablet within an AR‐HMD space, and then study the use of this tablet within a 3D AR environment, compared to its use with a 2D external screen.

Transparent Practices for Quantitative Empirical Research

Transparent research practices enable the research design, materials, analytic methods, and data to be thoroughly evaluated and potentially reproduced. The HCI community has recognized research

GAN’SDA Wrap: Geographic And Network Structured DAta on surfaces that Wrap around

There are many methods for projecting spherical maps onto the plane. Interactive versions of these projections allow the user to centre the region of interest. However, the effects of such

References

SHOWING 1-10 OF 80 REFERENCES

DICHOTOMOUS THINKING: A PROBLEM BEYOND NHST

The cliff effect—a sudden drop of confidence that a real effect exists just above p=0.05—captures the way many researchers and students interpret p-values. It is consistent with dichotomous

Even statisticians are not immune to misinterpretations of Null Hypothesis Significance Tests

We investigated the way experienced users interpret Null Hypothesis Significance Testing (NHST) outcomes. An empirical study was designed to compare the reactions of two populations of NHST users,

Interpretation of significance levels by psychological researchers: The .05 cliff effect may be overstated

TLDR
Investigation of individual curves reveals that the attitude of researchers towardp values is far from being as homogeneous as might be expected, and most psychological researchers in this study rated graduated confidence judgments, as either exponential or linear.

A Cross-Sectional Analysis of Students’ Intuitions When Interpreting CIs

TLDR
Observed changes in students’ intuitions following this teaching program suggest that a brief intervention using cat’s eyes can reduce CI misconceptions and increase accurate CI intuitions.

Researchers misunderstand confidence intervals and standard error bars.

TLDR
Results suggest that many leading researchers have severe misconceptions about how error bars relate to statistical significance, do not adequately distinguish CIs and SE bars, and do not appreciate the importance of whether the 2 means are independent or come from a repeated measures design.

Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error

TLDR
It is confirmed that the encoding of mean and error significantly changes how viewers make decisions about uncertain data, and the use of gradient plots and violin plots are suggested as better alternatives for inferential tasks than bar charts with error bars.

Threats of a replication crisis in empirical computer science

TLDR
Research replication only works if there is confidence built into the results, and the results should be confidence-based.

ColorBrewer

  • 2021

The New Statistics: Why and How

We need to make substantial changes to how we conduct research. First, in response to heightened concern that our published research literature is incomplete and untrustworthy, we need new
...