Getting access to what goes on in people's heads?: reflections on the think-aloud technique

  title={Getting access to what goes on in people's heads?: reflections on the think-aloud technique},
  author={Janni Nielsen and Torkil Clemmensen and Carsten Yssing},
  booktitle={NordiCHI '02},
One of the basic usability testing techniques the HCI community draws on, and which stands out as unique, is thinking aloud. We introduce the many names, uses and modifications of the classical think aloud technique, and ask the rhetorical question: What do researchers think they get when they ask people to think aloud? We answer it by discussing the classical work of Ericsson and Simon(1984), in particular their distinction between vocalisation, verbalisation and retrospective reports and the… 
This is what I’m doing and why: Reflections on a think-aloud study of digital library users’ information behaviour
The decisions made when planning and conducting a think-aloud study of lawyers" interactive information behaviour are discussed and reflections on the methodologies used are reflected.
This is what i'm doing and why: reflections on a think-aloud study of dl users' information behaviour
This paper discusses and reflects on the decisions made when planning and conducting a think-aloud study of lawyers' interactive information behaviour and is framed by Blandford et al.'s PRET A Rapporter ('ready to report') framework.
Examining the ‘point of frustration’. The think-aloud method applied to online search tasks
Past research on the think-aloud method; its advantages, drawbacks and aptness for tracing online search processes will be examined, with a major concern to describe in detail the design, procedure and framework of analysis of a qualitative study concerned with information needs of professionals in onlinesearch processes.
Think Aloud: Can Eye Tracking Add Value in Detecting Usability Problems?
The analysis of the data showed that the total number of usability problems identified by the participants in the ‘Eye Tracking and Think Aloud’ (ET + TA) condition was higher than the other two conditions, which may lead future researchers to develop robust practice sessions to help participants verbalize and create evaluation rules for eye movement data.
What do usability test moderators say?: 'mm hm', 'uh-huh', and beyond
This study investigates what moderators say by categorizing the moderator verbalizations from 12 test sessions and discusses the content of their verbalizations and the implications of the findings.
Investigation of Indirect Oral Operation Method for Think Aloud Usability Testing
The results demonstrated that the oral operation method was more effective in drawing more utterances for explanation and observation that would be an important source of discovering usability problems although the effect was dependent on the user interface of test objects.
Liberating usability testing
Usability testing aims a direct inquiry into the experience of using an artifact while the artifact is being used, and lists the abstractions in other methods which are typically used to evaluate usability.
The disruptive effect of Think Aloud
Thinking Aloud Thinking Aloud is the most commonly used technique used to test users´ interaction with computers. The assumption is that Think Aloud gives access to what goes on in the users´ minds.
Cultural Cognition in the Thinking-Aloud Method for Usability Evaluation
The importance of matching the task presentation to users’ cultural background and the complexity of the overall relationship between user and evaluator when they have different cultural backgrounds are pointed to.


Thinking aloud: reconciling theory and practice
Thinking-aloud protocols may be the most widely used method in usability testing, but the descriptions of this practice in the usability literature and the work habits of practitioners do not conform
Replacing usability testing with user dialogue
This article outlines four examples to show how the conventional usability-testing format is turned into a dialogue between users and designers, and how this has changed the conception of objectivity of usability testing.
Mindtape: A Tool for Reflection in Participatory Design
The explorative use of video recordings in studies of distributed collaboration shows promising possibilities as a tool for mutual learning processes and may also be used to inform design.
Interaction Design
From the Publisher: Accomplished authors, Preece, Rogers and Sharp, have written a key new textbook on this core subject area. Interaction Design deals with a broad scope of issues, topics and
The use of think-aloud evaluation methods in design
This paper reports on two studies in which teams of two or three trainee designers evaluated a user interface by observing a user working through some set tasks. These users were instructed to think
How usability testing can aid the development of online documentation
This article describes how testing methodologies can be used to test online help systems iteratively and discusses a framework for visualizing usability testing of online documentation through the development cycle.
Telling more than we can know: Verbal reports on mental processes.
Evidence is reviewed which suggests that there may be little or no direct introspective access to higher order cognitive processes. Subjects are sometimes (a) unaware of the existence of a stimulus
Protocol Analysis: Verbal Reports as Data
Since the publication of Ericsson and Simon's work in the early 1980s, verbal data has been used increasingly to study cognitive processes in many areas of psychology, and concurrent and
Interaction Design: Beyond Human-Computer Interaction
Interaction Design offers a cross-disciplinary, practical and process-oriented approach to Human Computer Interaction, showing not just what principles ought to apply to Interaction Design, but crucially how they can be applied.