Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making

@article{Fernandes2018UncertaintyDU,
  title={Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making},
  author={Michael Fernandes and Logan A. Walls and Sean A. Munson and Jessica R. Hullman and Matthew Kay},
  journal={Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems},
  year={2018}
}
Everyday predictive systems typically present point predictions, making it hard for people to account for uncertainty when making decisions. [...] Key Result We discuss implications for real time transit predictions and possible generalization to other domains.Expand

Figures and Topics from this paper

Hypothetical Outcome Plots Help Untrained Observers Judge Trends in Ambiguous Data
TLDR
This work identifies and motivate an appropriate task to investigate realistic judgments of uncertainty in the public domain through a qualitative analysis of uncertainty visualizations in the news, and contributes two crowdsourced experiments comparing the effectiveness of HOPs, error bars, and line ensembles for supporting perceptual decision-making from visualized uncertainty. Expand
Visual Reasoning Strategies and Satisficing: How Uncertainty Visualization Design Impacts Effect Size Judgments and Decisions
TLDR
Findings from a mixed design experiment on Mechanical Turk are presented, finding that adding means to uncertainty visualizations has small biasing effects on both magnitude estimation and decision-making, consistent with discounting uncertainty. Expand
How Visualizing Inferential Uncertainty Can Mislead Readers About Treatment Effects in Scientific Results
TLDR
It is found that axis rescaling reduces error, but not as well as prediction intervals or animated hypothetical outcome plots (HOPs), and that depicting inferential uncertainty causes participants to underestimate variability in individual outcomes. Expand
Let's Gamble: Uncovering the Impact of Visualization on Risk Perception and Decision-Making
TLDR
A large-scale gambling game that immersed participants in an environment where their actions impacted their bonuses showed that icon arrays tended to elicit economically sound behavior and a ranking to improve visualization selection was provided. Expand
Uncertain About Uncertainty: How Qualitative Expressions of Forecaster Confidence Impact Decision-Making With Uncertainty Visualizations
TLDR
This work focuses on one type of distinction between direct quantitative uncertainty and indirect qualitative uncertainty, and recommends that forecasters present qualitative expressions of model confidence whenever possible alongside quantified uncertainty. Expand
Visualization Equilibrium
TLDR
The effects of visualization anticipation is characterized, referring to changes to behavior when an agent goes from alone having access to a visualization to knowing that others also have access to the visualization to guide their decisions, and the implications of visualization equilibria and visualization anticipation are reflected on. Expand
Communicating Uncertainty and Risk in Air Quality Maps
TLDR
In a user study, it is found that including uncertainty in air quality maps has a significant effect on how much users would choose to reduce their physical activity, and that people make more cautious decisions when using uncertainty-aware maps. Expand
In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation
TLDR
A taxonomy for characterizing decisions made in designing an evaluation of an uncertainty visualization is presented and a concrete set of recommendations for evaluators designed to reduce the mismatch between the conceptualization of uncertainty in visualization versus other fields is concluded. Expand
When Does Uncertainty Matter?: Understanding the Impact of Predictive Uncertainty in ML Assisted Decision Making
TLDR
This work carries out user studies to systematically assess how people respond to different types of predictive uncertainty i.e., posterior predictive distributions with different shapes and variances, in the context of ML assisted decision making, and demonstrates that uncertainty is an effective tool for persuading humans to agree with model predictions. Expand
Visualizing Uncertainty in Probabilistic Graphs with Network Hypothetical Outcome Plots (NetHOPs)
TLDR
The results of a study in which 51 network experts used Network Hypothetical Outcome Plots to complete a set of common visual analysis tasks and reported how they perceived network structures and properties subject to uncertainty are described, suggesting NetHOPs can be a reasonable approach for enabling network analysts to reason about multiple properties under uncertainty. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 47 REFERENCES
When (ish) is My Bus?: User-centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems
TLDR
A novel discrete representation of continuous outcomes designed for small screens, quantile dotplots is proposed that reduces the variance of probabilistic estimates by ~1.15 times compared to density plots and facilitates more confident estimation by end-users in the context of realtime transit prediction scenarios. Expand
The Advantages of Predictive Interval Forecasts for Non‐Expert Users and the Impact of Visualizations
Summary Three experiments demonstrated advantages over conventional deterministic forecasts for participants making temperature estimates and precautionary decisions with predictive intervalExpand
Uncertainty Forecasts Improve Decision Making Among Nonexperts
The objective of this research was to evaluate the impact of weather uncertainty information on decision making in naturalistic settings. Traditional research often reveals deficits in human decisionExpand
Investigating Representation Alternatives for Communicating Uncertainty to Non-experts
TLDR
Twelve representations that provide different levels of uncertainty information are selected and compared in an online survey and a turn-based online game to show that a function graph of a probability distribution function is the best way to communicate uncertain information. Expand
Uncertainty forecasts improve weather-related decisions and attenuate the effects of forecast error.
TLDR
Testing the relative benefits of several forecast formats suggested that uncertainty information improved decision quality overall and increased trust in the forecast, and combining decision advice with uncertainty estimates resulted in the best performance overall. Expand
Decisions With Uncertainty: The Glass Half Full
Each of us makes important decisions involving uncertainty in domains in which we are not experts, such as retirement planning, medical treatment, and precautions against severe weather. Often,Expand
A Laboratory Study of the Benefits of Including Uncertainty Information in Weather Forecasts
TLDR
Using laboratory-based methods developed by experimental economists to study individual choice it is found that nonspecialists are able to make better decisions that increase their expected reward while reducing their exposure to risk, when provided with information about the day-to-day uncertainty associated with temperature forecasts. Expand
Strike probability judgments and protective action recommendations in a dynamic hurricane tracking task
This experiment assessed the strike probability (ps) judgments and protective action recommendations (PARs) of students playing the roles of county emergency managers during four different hurricaneExpand
Guidelines for the Display of Attribute Certainty
This research investigates how the inclusion of attribute certainty in map displays influences GIS modeling and spatial decision support. The goal is to establish empirical evidence documentingExpand
Communicating forecast uncertainty: public perception of weather forecast uncertainty
TLDR
Users had well-formed uncertainty expectations suggesting that they are prepared to understand explicit uncertainty forecasts for a wide range of parameters, and explicit uncertainty estimates may be necessary to overcome some of the anticipated forecast biases that may be affecting the usefulness of existing weather forecasts. Expand
...
1
2
3
4
5
...