Getting access to what goes on in people's heads?: reflections on the think-aloud technique

@inproceedings{Nielsen2002GettingAT,
  title={Getting access to what goes on in people's heads?: reflections on the think-aloud technique},
  author={Janni Nielsen and Torkil Clemmensen and Carsten Yssing},
  booktitle={NordiCHI '02},
  year={2002}
}
One of the basic usability testing techniques the HCI community draws on, and which stands out as unique, is thinking aloud. We introduce the many names, uses and modifications of the classical think aloud technique, and ask the rhetorical question: What do researchers think they get when they ask people to think aloud? We answer it by discussing the classical work of Ericsson and Simon(1984), in particular their distinction between vocalisation, verbalisation and retrospective reports and the… 
This is what I’m doing and why: Reflections on a think-aloud study of digital library users’ information behaviour
TLDR
The decisions made when planning and conducting a think-aloud study of lawyers" interactive information behaviour are discussed and reflections on the methodologies used are reflected.
Think Aloud: Can Eye Tracking Add Value in Detecting Usability Problems?
TLDR
The analysis of the data showed that the total number of usability problems identified by the participants in the ‘Eye Tracking and Think Aloud’ (ET + TA) condition was higher than the other two conditions, which may lead future researchers to develop robust practice sessions to help participants verbalize and create evaluation rules for eye movement data.
What do usability test moderators say?: 'mm hm', 'uh-huh', and beyond
TLDR
This study investigates what moderators say by categorizing the moderator verbalizations from 12 test sessions and discusses the content of their verbalizations and the implications of the findings.
Investigation of Indirect Oral Operation Method for Think Aloud Usability Testing
TLDR
The results demonstrated that the oral operation method was more effective in drawing more utterances for explanation and observation that would be an important source of discovering usability problems although the effect was dependent on the user interface of test objects.
Liberating usability testing
TLDR
Usability testing aims a direct inquiry into the experience of using an artifact while the artifact is being used, and lists the abstractions in other methods which are typically used to evaluate usability.
The disruptive effect of Think Aloud
Thinking Aloud Thinking Aloud is the most commonly used technique used to test users´ interaction with computers. The assumption is that Think Aloud gives access to what goes on in the users´ minds.
Cultural Cognition in the Thinking-Aloud Method for Usability Evaluation
TLDR
The importance of matching the task presentation to users’ cultural background and the complexity of the overall relationship between user and evaluator when they have different cultural backgrounds are pointed to.
Cultural cognition in usability evaluation
Embedding complementarity in HCI methods and techniques - designing for the "cultural other"
TLDR
The proposed framework will suggest a theory of complementary positions that insists on solid accounts from all observer positions in relation to perspective, standpoint and focus and reflect critically upon the forty years dominated by a rationalistic, empirical understanding of the user.
...
...

References

SHOWING 1-10 OF 57 REFERENCES
Thinking aloud: reconciling theory and practice
Thinking-aloud protocols may be the most widely used method in usability testing, but the descriptions of this practice in the usability literature and the work habits of practitioners do not conform
Replacing usability testing with user dialogue
TLDR
This article outlines four examples to show how the conventional usability-testing format is turned into a dialogue between users and designers, and how this has changed the conception of objectivity of usability testing.
Mindtape: A Tool for Reflection in Participatory Design
TLDR
The explorative use of video recordings in studies of distributed collaboration shows promising possibilities as a tool for mutual learning processes and may also be used to inform design.
Interaction Design
From the Publisher: Accomplished authors, Preece, Rogers and Sharp, have written a key new textbook on this core subject area. Interaction Design deals with a broad scope of issues, topics and
The use of think-aloud evaluation methods in design
This paper reports on two studies in which teams of two or three trainee designers evaluated a user interface by observing a user working through some set tasks. These users were instructed to think
How usability testing can aid the development of online documentation
TLDR
This article describes how testing methodologies can be used to test online help systems iteratively and discusses a framework for visualizing usability testing of online documentation through the development cycle.
Interaction Design: Beyond Human-Computer Interaction
TLDR
Interaction Design offers a cross-disciplinary, practical and process-oriented approach to Human Computer Interaction, showing not just what principles ought to apply to Interaction Design, but crucially how they can be applied.
Estimating the number of subjects needed for a thinking aloud test
  • J. Nielsen
  • Computer Science
    Int. J. Hum. Comput. Stud.
  • 1994
Abstract Two studies of using the thinking aloud method for user interface testing showed that experimenters who were not usability specialists could use the method. However, they found only 28-30%
Embodied models as simulated users: introduction to this special issue on using cognitive models to improve interface design
TLDR
Cognitive models provide a means for applying what is known from psychology to the design of interfaces, thereby improving their quality and usability, and point to a new route for the future, one in which models built within embodied cognitive architectures provide information for thedesign of better interfaces.
...
...