Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems
@article{Andre2003DeterminingTE,
title={Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems},
author={Terence S. Andre},
journal={Human Factors: The Journal of Human Factors and Ergonomics Society},
year={2003},
volume={45},
pages={455 - 482}
}Despite the increased focus on usability and on the processes and methods used to increase usability, a substantial amount of software is unusable and poorly designed. Much of this is attributable to the lack of cost-effective usability evaluation tools that provide an interaction-based framework for identifying problems. We developed the user action framework and a corresponding evaluation tool, the usability problem inspector (UPI), to help organize usability concepts and issues into a…Â
Figures and Tables from this paper
figure 1 
figure 1 
figure 1-1 
figure 2-1 
table 2-2 
figure 2-2 
figure 2-3 
figure 2-4 
table 2-4 
figure 3-1 
figure 3-10 
figure 3-11 
figure 3-2 
figure 3-3 
figure 3-4 
figure 3-5 
figure 3-6 
figure 3-7 
figure 3-8 
figure 3-9 
figure 4-1 
table 4-1 
figure 5-1 
table 5-1 
figure 5-2 
table 5-2 
figure 5-3 
table 5-3 
table 5-4 
figure 5-4 
table 5-5 
table 5-6 
table 5-7 
table 5-8 
figure 6-1 
table 6-1 
table 6-10 
figure 6-10 
table 6-11 
figure 6-11 
table 6-12 
figure 6-12 
table 6-13 
table 6-14 
table 6-15 
table 6-16 
table 6-17 
table 6-18 
table 6-19 
figure 6-2 
table 6-2 
table 6-20 
table 6-21 
table 6-22 
table 6-23 
table 6-24 
table 6-25 
table 6-26 
table 6-27 
figure 6-3 
table 6-3 
table 6-4 
figure 6-4 
table 6-5 
figure 6-5 
table 6-6 
figure 6-6 
table 6-7 
figure 6-7 
table 6-8 
figure 6-8 
table 6-9 
figure 6-9 
table 7-1 
figure 7-1
52 Citations
Validating the User -Centered Hybrid Assessment Tool (User-CHAT): A comparative usability evaluation
- Computer Science
- 2007
The results demonstrated that the User-CHAT attained higher effectiveness scores than the heuristic evaluation and cognitive walkthrough, suggesting that it helped evaluators identify many usability problems that actually impact users, i.e., higher thoroughness, while attenuating time and effort on issues that were not important.
Usability Information Management: Prototype for Result Exploration Based on an Empirical Analysis of Use Cases
- Computer ScienceNordiCHI
- 2016
The results of interviews with usability practitioners are presented to describe existing use cases for this type of information, and an information structure for usability information has been created.
A Usability Problem Inspection Tool: Development and Formative Evaluation
- Business
- 2003
This research involves the development and formative evaluation of the Usability Problem Inspection tool, a cost-effective, structured, flexible usability inspection tool that uses the User Action Framework as an underlying knowledge base.
Assessing the reliability, validity and acceptance of a classification scheme of usability problems (CUP)
- PsychologyJ. Syst. Softw.
- 2014
The Axiomatic Usability Evaluation Method
- Computer Science
- 2014
This chapter introduces a new usability evaluation method, the axiomatic evaluation method, which is developed based on the axiomatic design theory – a formalized design methodology that can be used…
An Infrastructure to Support Usability Problem Data Analysis
- Computer Science
- 2004
An infrastructure for usability problem data analysis is developed to address the need for better returns on usability engineering investments and consists of four main components: a framework, a process, tools, and semantic analysis technology.
Supporting novice usability practitioners with usability engineering tools
- Computer ScienceInt. J. Hum. Comput. Stud.
- 2007
Analysis in practical usability evaluation: a survey study
- BusinessCHI
- 2012
This work has surveyed 155 usability practitioners on the analysis in their latest usability evaluation and provides six recommendations for future research to better support analysis.
Usability assessment methods
- Medicine
- 2006
This work discusses the new challenges to usability assessment: (a) using the methods thoughtfully, (b) expanding the scope of assessment beyond usability and productivity to affect end user experience, and emphasizing design solutions to problems in addition to simply finding the problems themselves.
An Exploration of End-User Critical Incident Classification
- Computer Science
- 2001
Results indicate that users are not good at diagnosing their own critical incidents due to the level of detail required for proper classification, although observations suggest that users were able to provide usability information that would not have been captured by an expert observer.
References
SHOWING 1-10 OF 140 REFERENCES
The user action framework: a reliable foundation for usability engineering support tools
- Computer ScienceInt. J. Hum. Comput. Stud.
- 2001
How high reliability in terms of agreement by users on what the User Action Framework means and how it is used is essential for its role as a common foundation for the tools is described and supported with strongly positive results of a summative reliability study.
Product usability and process improvement based on usability problem classification
- Computer Science
- 1996
A new taxonomic model (the Usability Problem Taxonomy) is presented which contributes to both product and process improvement and can be used to generate higher quality problem descriptions and to group those problem descriptions prior to prioritization and correction.
Understanding Usability Issues Addressed by Three User-System Interface Evaluation Techniques
- Computer ScienceInteract. Comput.
- 1994
A Pair of Techniques for Effective Interface Evaluation: Cognitive Walkthroughs and Think-Aloud Evaluations
- Computer Science
- 1997
This study shows that cognitive walkthroughs find the most severe usability problems along with desirable new features and functionality, while think-aloud evaluations find all types of usability problems.
The Usability Problem Taxonomy: A Framework for Classification and Analysis
- Computer ScienceEmpirical Software Engineering
- 2004
The Usability Problem Taxonomy (UPT) is presented, a taxonomic model in which usability problems detected in graphical user interfaces with textual components are classified from both an artifact and a task perspective.
A Comparison of Three Usability Evaluation Methods: Heuristic, Think-Aloud, and Performance Testing
- Computer Science
- 1993
The three testing methodologies were roughly equivalent in their ability to detect a core set of usability problems on a per evaluator basis, but the heuristic and think-aloud evaluations were generally more sensitive, uncovering a broader array of problems in the user interface.
Criteria For Evaluating Usability Evaluation Methods
- Computer ScienceInt. J. Hum. Comput. Interact.
- 2001
This article highlights specific challenges that researchers and practitioners face in comparing UEMs and provides a point of departure for further discussion and refinement of the principles and techniques used to approach UEM evaluation and comparison.
The Effectiveness of Usability Evaluation Methods: Determining the Appropriate Criteria
- Medicine
- 1999
It is found that studies do not always provide the appropriate descriptive statistics to make solid conclusions, especially in terms of validity, and some possible ways to address criterion deficiency and criterion contamination are provided.
A Cost-Effective Evaluation Method for Use by Designers
- Computer ScienceInt. J. Man Mach. Stud.
- 1991
Heuristic Walkthroughs: Finding the Problems Without the Noise
- BusinessInt. J. Hum. Comput. Interact.
- 1997
A new technique is described that combines the benefits of heuristic evaluations, cognitive walkthroughs, and usabilityWalkthroughs to provide more structure than heuristic evaluated but less than cognitive walk throughs.