Automating Visualization Quality Assessment: a Case Study in Higher Education

@article{Holliman2021AutomatingVQ,
  title={Automating Visualization Quality Assessment: a Case Study in Higher Education},
  author={Nicolas S. Holliman},
  journal={ArXiv},
  year={2021},
  volume={abs/2106.00077}
}
We present a case study in the use of machine+human mixed intelligence for visualization quality assessment, applying automated visualization quality metrics to support the human assessment of data visualizations produced as coursework by students taking higher education courses. A set of image informatics algorithms including edge congestion, visual saliency and colour analysis generate machine analysis of student visualizations. The insight from the image informatics outputs has proved… Expand

References

SHOWING 1-10 OF 29 REFERENCES
How to evaluate data visualizations across different levels of understanding
TLDR
This work diagnoses levels of understanding of visualized data by adapting Bloom’s taxonomy, a common framework from the education literature, and presents three case studies showing that this framework expands on existing methods to comprehensively measure how a visualization design facilitates a viewer's understanding ofVisualizations. Expand
The challenge of information visualization evaluation
TLDR
As the field of information visualization matures, the tools and ideas described in research publications are reaching users but evaluation approaches need to take into account the long exploratory nature of users tasks, the value of potential discoveries or the benefits of overall awareness. Expand
Toward measuring visualization insight
  • C. North
  • Computer Science, Medicine
  • IEEE Computer Graphics and Applications
  • 2006
TLDR
The capability of the controlled experiment method to measure insight is examined, to determine to what degree visualizations achieve this purpose. Expand
Quality Metrics for Information Visualization
TLDR
This survey attempts to report, categorize and unify the diverse understandings and aims to establish a common vocabulary that will enable a wide audience to understand their differences and subtleties. Expand
An approach to the perceptual optimization of complex visualizations
  • D. House, A. Bair, C. Ware
  • Computer Science, Medicine
  • IEEE Transactions on Visualization and Computer Graphics
  • 2006
This paper proposes a new experimental framework within which evidence regarding the perceptual characteristics of a visualization method can be collected, and describes how this evidence can beExpand
Data Visualization in Society
TLDR
This chapter uses examples of historical data visualizations in order to examine what ways of knowing they privilege and how they shape the ideas of what is possible. Expand
Evaluating Information Visualizations
TLDR
The purpose of this chapter is to increase awareness of empirical research in general, of its relationship to information visualization in particular, and to emphasize its importance to encourage thoughtful application of a greater variety of evaluative research methodologies in information visualization. Expand
The Role of Automation in Undergraduate Computer Science Education
TLDR
It is found that carefully designed and managed automation can improve student performance while realizing a significant savings of scarce teaching resources. Expand
Quantification of interface visual complexity
TLDR
This paper studies automatic metrics of GUI qualities that take screenshots of GUI as input and can thus be applied to any type of GUI, and proposes six associated automatic metrics that could enable designers to iterate their designs more quickly. Expand
Aalto Interface Metrics (AIM): A Service and Codebase for Computational GUI Evaluation
Aalto Interface Metrics (AIM) pools several empirically validated models and metrics of user perception and attention into an easy-to-use online service for the evaluation of graphical user interfaceExpand
...
1
2
3
...