Automating Visualization Quality Assessment: a Case Study in Higher Education

  title={Automating Visualization Quality Assessment: a Case Study in Higher Education},
  author={Nicolas S. Holliman},
We present a case study in the use of machine+human mixed intelligence for visualization quality assessment, applying automated visualization quality metrics to support the human assessment of data visualizations produced as coursework by students taking higher education courses. A set of image informatics algorithms including edge congestion, visual saliency and colour analysis generate machine analysis of student visualizations. The insight from the image informatics outputs has proved… 



How to evaluate data visualizations across different levels of understanding

This work diagnoses levels of understanding of visualized data by adapting Bloom’s taxonomy, a common framework from the education literature, and presents three case studies showing that this framework expands on existing methods to comprehensively measure how a visualization design facilitates a viewer's understanding ofVisualizations.

Data Visualization in Society

This chapter uses examples of historical data visualizations in order to examine what ways of knowing they privilege and how they shape the ideas of what is possible.

The challenge of information visualization evaluation

As the field of information visualization matures, the tools and ideas described in research publications are reaching users but evaluation approaches need to take into account the long exploratory nature of users tasks, the value of potential discoveries or the benefits of overall awareness.

Toward measuring visualization insight

  • C. North
  • Art
    IEEE Computer Graphics and Applications
  • 2006
The capability of the controlled experiment method to measure insight is examined, to determine to what degree visualizations achieve this purpose.

Quality Metrics for Information Visualization

This survey attempts to report, categorize and unify the diverse understandings and aims to establish a common vocabulary that will enable a wide audience to understand their differences and subtleties.

An approach to the perceptual optimization of complex visualizations

This paper proposes a new experimental framework within which evidence regarding the perceptual characteristics of a visualization method can be collected, and describes how this evidence can be

Evaluating Information Visualizations

The purpose of this chapter is to increase awareness of empirical research in general, of its relationship to information visualization in particular, and to emphasize its importance to encourage thoughtful application of a greater variety of evaluative research methodologies in information visualization.

The Role of Automation in Undergraduate Computer Science Education

It is found that carefully designed and managed automation can improve student performance while realizing a significant savings of scarce teaching resources.

Quantification of interface visual complexity

This paper studies automatic metrics of GUI qualities that take screenshots of GUI as input and can thus be applied to any type of GUI, and proposes six associated automatic metrics that could enable designers to iterate their designs more quickly.

Aalto Interface Metrics (AIM): A Service and Codebase for Computational GUI Evaluation

Aalto Interface Metrics (AIM) pools several empirically validated models and metrics of user perception and attention into an easy-to-use online service for the evaluation of graphical user interface