The state of the art in automating usability evaluation of user interfaces

@article{Ivory2001TheSO,
  title={The state of the art in automating usability evaluation of user interfaces},
  author={Melody Y. Ivory and Marti A. Hearst},
  journal={ACM Comput. Surv.},
  year={2001},
  volume={33},
  pages={470-516}
}
Usability evaluation is an increasingly important part of the user interface design process. However, usability evaluation can be expensive in terms of time and human resources, and automation is therefore a promising way to augment existing approaches. This article presents an extensive survey of usability evaluation methods, organized according to a new taxonomy that emphasizes the role of automation. The survey analyzes existing techniques, identifies which aspects of usability evaluation… Expand
Automation in model-based usability evaluation of adaptive user interfaces by simulating user interaction
TLDR
An integrated approach that provides automation in model-based usability evaluation based on already existing development models of adaptive UIs based on required information for describing the UI surface information and the interaction capabilities of the UI. Expand
Model-Based Evaluation of Adaptive User Interfaces
TLDR
By combining a user model with user interface models from a model-based development framework, providing different adaptation alternatives, interaction can be simulated and evaluated accordingly, and the complexity and costs for applying an automated usability evaluation can be reduced significantly. Expand
User-Interface Usability Evaluation
Nowadays, computers and internet are playing the major role in the development of business and different aspects of human lives; hence, the quality of user-computer interface became an importantExpand
Interaction Walkthrough : A usability evaluation method for critical systems
Usability evaluation methods are a battery of techniques for assessing the usability of interactive systems or of proposed interactive systems. This paper describes an additional evaluation method,Expand
Incorporating Usability Evaluation in Software Development Environments
  • S. Humayoun
  • Computer Science
  • KI - Künstliche Intelligenz
  • 2012
TLDR
This work proposes a way to define and automate user and usability evaluation from within the integrated development environment (IDE) and provides a framework for conducting evaluation experiments using TaMoGolog-based formal task models. Expand
User-Centered Design and Evaluation - The Big Picture
This paper provides a high-level overview of the field of usability evaluation as context for a panel "Systematization, Modeling and Quantitative Evaluation of Human Interface" in which severalExpand
Model-Based Usability Evaluation - Evaluation of Tool Support
TLDR
This paper introduces and evaluates two tools, AWUSA and ReModEl, which use task modeling for remote usability evaluation and describes the tasks composed of subtasks and temporal relationships between them. Expand
A Methodology and Framework to Simplify Usability Analysis of Mobile Applications
TLDR
A methodology and framework to aid developers in preparing the mobile system for usability analysis and the processing of the collected usability data by automating some of the tasks involved in the process is proposed. Expand
Automating the evaluation of usability remotely for web applications via a model-based approach
TLDR
The use of task models to define how the user should interact with a given system is explored and results performed to assess the usability of a website shows the potency of the system to discover usability setbacks that can be addressed to improve the user experience. Expand
Empirical validation of an automatic usability evaluation method
TLDR
This work empirically validate a usability evaluation method conceived to assess consistency aspects of a GUI with no need to analyze the back-end, and shows that the proposed methodology can indeed be a useful complement to standard techniques of usability evaluation. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 198 REFERENCES
Automatic Support for Usability Evaluation
TLDR
A method to evaluate user interfaces using task models and logs generated from a user test of an application is proposed and can be incorporated into an automatic tool which gives the designer information useful to evaluate and improve the user interface. Expand
Evaluation Techniques: Exploring the Intersection of HCI and Software Engineering
  • J. Coutaz
  • Computer Science
  • ICSE Workshop on SE-HCI
  • 1994
TLDR
It is shown that each usability technique has a natural anchor point within the software development process, however, in practice such techniques are not exploited by the software community. Expand
User interface evaluation in the real world: a comparison of four techniques
TLDR
A user interface for a software product was evaluated prior to its release by four groups, each applying a different technique: heuristic evaluation, software guidelines, cognitive walkthroughs, and usability testing. Expand
Comparing Performance and Usability Evaluation : New Methods for Automated Usability Assessment
To gain insight about new methods for automated usability assessment, we systematically compare methods for usability evaluation to those of performance evaluation. We find that the major challengesExpand
How to measure and to quantify usability of user interfaces
TLDR
First, a concept to describe user-interfaces on a granularity level, that is detailed enough to preserve important interface characteristics, and is general enough to cover most of known interface types is developed. Expand
Model-aided Remote Usability Evaluation
TLDR
The method is tool-supported and it is able to analyse the logs of user actions performed during work sessions by using information contained in powerful task models able to describe concurrent and interactive activities. Expand
Knowledge-based evaluation as design support for graphical user interfaces
TLDR
A knowledge-based tool is presented, containing design knowledge drawn from general guideline documents and toolkit-specific style guides, capable of evaluating a user interface design produced in a UIMS, showing that part of what the designers consider relevant design knowledge is related to the user's tasks and thus cannot be applied to the static design representation of the UIMs. Expand
Usability engineering
  • J. Nielsen
  • Computer Science
  • The Computer Science and Engineering Handbook
  • 1997
TLDR
This guide to the methods of usability engineering provides cost-effective methods that will help developers improve their user interfaces immediately and shows you how to avoid the four most frequently listed reasons for delay in software projects. Expand
A framework for human factors evaluation
TLDR
Support for evaluation in the form of a framework for describing and guiding the general activity is considered, following a definition of evaluation, and a framework is proposed that attempts to clarify what can be done towards which goals and how it can bedone. Expand
QUIP: Quantitative User Interface Profiling
TLDR
A usability evaluation system that provides automatic, quantitative analysis of usage trace data that aggregates usage traces into a usage profile in which disparities between user and designer conceptual models are exposed graphically. Expand
...
1
2
3
4
5
...