Can Visualization Alleviate Dichotomous Thinking? Effects of Visual Representations on the Cliff Effect

  title={Can Visualization Alleviate Dichotomous Thinking? Effects of Visual Representations on the Cliff Effect},
  author={Jouni Helske and Satu Helske and Matthew D. Cooper and Anders Ynnerman and Lonni Besançon},
  journal={IEEE Transactions on Visualization and Computer Graphics},
Common reporting styles for statistical results in scientific articles, such as <inline-formula><tex-math notation="LaTeX">$p$</tex-math><alternatives><mml:math><mml:mi>p</mml:mi></mml:math><inline-graphic xlink:href="helske-ieq1-3073466.gif"/></alternatives></inline-formula>-values and confidence intervals (CI), have been reported to be prone to dichotomous interpretations, especially with respect to the null hypothesis significance testing framework. For example when the <inline-formula><tex… 

Figures and Tables from this paper

Doing Better Data Visualization

Methods in data visualization have rapidly advanced over the past decade. Although social scientists regularly need to visualize the results of their analyses, they receive little training in how to

Sources of information waste in neuroimaging: mishandling structures, thinking dichotomously, and over-reducing data

This work examines three sources of substantial information loss and proposes a Bayesian multilevel modeling framework that closely characterizes the data hierarchies across spatial units and experimental trials to improve inference efficiency, predictive accuracy, and generalizability in neuroimaging.

Dichotomous thinking and informational waste in neuroimaging

To improve inference efficiency, predictive accuracy, and generalizability, a Bayesian multilevel modeling framework is proposed and four actionable suggestions to alleviate information waste and to improve reproducibility are made.

Publishing Visualization Studies as Registered Reports: Expected Benefits and Researchers’ Attitudes

A brief introduction to Registered Reports and their expected benefits for visualization research is offered and a survey of the visualization community on their attitudes towards Registered Reports is reported.

Building a Thinking Visualization System Based on AI Multiple Intelligence Theory in the 5G Era

  • Xinyan Zhang
  • Computer Science
    2022 International Conference on Artificial Intelligence in Everything (AIE)
  • 2022
This paper studies the design concept of using AI multiple intelligence theory to build a visualization system in the 5G era and guides the construction of visual thinking design theory.

Hybrid Touch/Tangible Spatial Selection in Augmented Reality

This paper theorize, discuss, and study different available mappings for manual spatial selections using a tangible tablet within an AR‐HMD space, and then study the use of this tablet within a 3D AR environment, compared to its use with a 2D external screen.

Transparent Practices for Quantitative Empirical Research

Transparent research practices enable the research design, materials, analytic methods, and data to be thoroughly evaluated and potentially reproduced. The HCI community has recognized research

GAN’SDA Wrap: Geographic And Network Structured DAta on surfaces that Wrap around

There are many methods for projecting spherical maps onto the plane. Interactive versions of these projections allow the user to centre the region of interest. However, the effects of such

Point specification in collaborative visualization for 3D scalar fields using augmented reality

Three distinct techniques to specify 3D positions for collaborative augmented reality (AR) visualization are compared and it is suggested that all the three techniques provide good mutual understanding and co-presence among collaborators.




The cliff effect—a sudden drop of confidence that a real effect exists just above p=0.05—captures the way many researchers and students interpret p-values. It is consistent with dichotomous

Even statisticians are not immune to misinterpretations of Null Hypothesis Significance Tests

We investigated the way experienced users interpret Null Hypothesis Significance Testing (NHST) outcomes. An empirical study was designed to compare the reactions of two populations of NHST users,

Interpretation of significance levels by psychological researchers: The .05 cliff effect may be overstated

Investigation of individual curves reveals that the attitude of researchers towardp values is far from being as homogeneous as might be expected, and most psychological researchers in this study rated graduated confidence judgments, as either exponential or linear.

A Cross-Sectional Analysis of Students’ Intuitions When Interpreting CIs

Observed changes in students’ intuitions following this teaching program suggest that a brief intervention using cat’s eyes can reduce CI misconceptions and increase accurate CI intuitions.

Researchers misunderstand confidence intervals and standard error bars.

Results suggest that many leading researchers have severe misconceptions about how error bars relate to statistical significance, do not adequately distinguish CIs and SE bars, and do not appreciate the importance of whether the 2 means are independent or come from a repeated measures design.

Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error

It is confirmed that the encoding of mean and error significantly changes how viewers make decisions about uncertain data, and the use of gradient plots and violin plots are suggested as better alternatives for inferential tasks than bar charts with error bars.

Threats of a replication crisis in empirical computer science

Research replication only works if there is confidence built into the results, and the results should be confidence-based.


  • 2021

The New Statistics: Why and How

We need to make substantial changes to how we conduct research. First, in response to heightened concern that our published research literature is incomplete and untrustworthy, we need new