Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems

  title={Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems},
  author={Terence S. Andre},
  journal={Human Factors: The Journal of Human Factors and Ergonomics Society},
  pages={455 - 482}
  • T. Andre
  • Published 1 September 2003
  • Computer Science
  • Human Factors: The Journal of Human Factors and Ergonomics Society
Despite the increased focus on usability and on the processes and methods used to increase usability, a substantial amount of software is unusable and poorly designed. Much of this is attributable to the lack of cost-effective usability evaluation tools that provide an interaction-based framework for identifying problems. We developed the user action framework and a corresponding evaluation tool, the usability problem inspector (UPI), to help organize usability concepts and issues into a… 

Validating the User -Centered Hybrid Assessment Tool (User-CHAT): A comparative usability evaluation

The results demonstrated that the User-CHAT attained higher effectiveness scores than the heuristic evaluation and cognitive walkthrough, suggesting that it helped evaluators identify many usability problems that actually impact users, i.e., higher thoroughness, while attenuating time and effort on issues that were not important.

Usability Information Management: Prototype for Result Exploration Based on an Empirical Analysis of Use Cases

The results of interviews with usability practitioners are presented to describe existing use cases for this type of information, and an information structure for usability information has been created.

A Usability Problem Inspection Tool: Development and Formative Evaluation

This research involves the development and formative evaluation of the Usability Problem Inspection tool, a cost-effective, structured, flexible usability inspection tool that uses the User Action Framework as an underlying knowledge base.

The Axiomatic Usability Evaluation Method

This chapter introduces a new usability evaluation method, the axiomatic evaluation method, which is developed based on the axiomatic design theory – a formalized design methodology that can be used

An Infrastructure to Support Usability Problem Data Analysis

An infrastructure for usability problem data analysis is developed to address the need for better returns on usability engineering investments and consists of four main components: a framework, a process, tools, and semantic analysis technology.

Analysis in practical usability evaluation: a survey study

This work has surveyed 155 usability practitioners on the analysis in their latest usability evaluation and provides six recommendations for future research to better support analysis.

Usability assessment methods

This work discusses the new challenges to usability assessment: (a) using the methods thoughtfully, (b) expanding the scope of assessment beyond usability and productivity to affect end user experience, and emphasizing design solutions to problems in addition to simply finding the problems themselves.

An Exploration of End-User Critical Incident Classification

Results indicate that users are not good at diagnosing their own critical incidents due to the level of detail required for proper classification, although observations suggest that users were able to provide usability information that would not have been captured by an expert observer.



The user action framework: a reliable foundation for usability engineering support tools

How high reliability in terms of agreement by users on what the User Action Framework means and how it is used is essential for its role as a common foundation for the tools is described and supported with strongly positive results of a summative reliability study.

Product usability and process improvement based on usability problem classification

A new taxonomic model (the Usability Problem Taxonomy) is presented which contributes to both product and process improvement and can be used to generate higher quality problem descriptions and to group those problem descriptions prior to prioritization and correction.

A Pair of Techniques for Effective Interface Evaluation: Cognitive Walkthroughs and Think-Aloud Evaluations

This study shows that cognitive walkthroughs find the most severe usability problems along with desirable new features and functionality, while think-aloud evaluations find all types of usability problems.

The Usability Problem Taxonomy: A Framework for Classification and Analysis

The Usability Problem Taxonomy (UPT) is presented, a taxonomic model in which usability problems detected in graphical user interfaces with textual components are classified from both an artifact and a task perspective.

A Comparison of Three Usability Evaluation Methods: Heuristic, Think-Aloud, and Performance Testing

The three testing methodologies were roughly equivalent in their ability to detect a core set of usability problems on a per evaluator basis, but the heuristic and think-aloud evaluations were generally more sensitive, uncovering a broader array of problems in the user interface.

Criteria For Evaluating Usability Evaluation Methods

This article highlights specific challenges that researchers and practitioners face in comparing UEMs and provides a point of departure for further discussion and refinement of the principles and techniques used to approach UEM evaluation and comparison.

The Effectiveness of Usability Evaluation Methods: Determining the Appropriate Criteria

It is found that studies do not always provide the appropriate descriptive statistics to make solid conclusions, especially in terms of validity, and some possible ways to address criterion deficiency and criterion contamination are provided.

A Cost-Effective Evaluation Method for Use by Designers

Heuristic Walkthroughs: Finding the Problems Without the Noise

  • A. Sears
  • Business
    Int. J. Hum. Comput. Interact.
  • 1997
A new technique is described that combines the benefits of heuristic evaluations, cognitive walkthroughs, and usabilityWalkthroughs to provide more structure than heuristic evaluated but less than cognitive walk throughs.