"Hey Model!" – Natural User Interactions and Agency in Accessible Interactive 3D Models

  title={"Hey Model!" – Natural User Interactions and Agency in Accessible Interactive 3D Models},
  author={Samuel Reinders and Matthew Butler and Kim Marriott},
  journal={Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems},
While developments in 3D printing have opened up opportunities for improved access to graphical information for people who are blind or have low vision (BLV), they can provide only limited detailed and contextual information. Interactive 3D printed models (I3Ms) that provide audio labels and/or a conversational agent interface potentially overcome this limitation. We conducted a Wizard-of-Oz exploratory study to uncover the multi-modal interaction techniques that BLV people would like to use… 

Figures and Tables from this paper

Towards More Transactional Voice Assistants: Investigating the Potential for a Multimodal Voice-Activated Indoor Navigation Assistant for Blind and Sighted Travelers
This study explored the extension of VAs’ capabilities in the context of indoor navigation through mixed-ability focus groups with blind and sighted airport travelers and found high overlap in the difficulties encountered by blind and Sighted travelers.
Tactile cartography in the digital age: A review and research agenda
Spatial media for people who are blind or visually impaired (B/VI) have evolved considerably in the years following Chris Perkins’ review of tactile map research, especially due to the proliferation
Towards Natural Language Interfaces for Data Visualization: A Survey
This article conducts a comprehensive review of the existing V-NLIs and develops categorical dimensions based on a classic information visualization pipeline with the extension of a V-NLI layer.
The Data Visualisation and Immersive Analytics Research Lab at Monash University


Designing Interactions for 3D Printed Models with Blind People
A two-section study with 12 legally blind participants to fill in the gap between existing interactive model technologies and end users' needs, and explore design opportunities for I3Ms.
Accessible Maps for the Blind: Comparing 3D Printed Models with Tactile Graphics
In a controlled study with 16 touch readers, it is found that 3D models were preferred, enabled the use of more easily understood icons, facilitated better short term recall and allowed relative height of map elements to be more easily understanding.
Gesture-Based Interactive Audio Guide on Tactile Reliefs
A gesture-controlled interactive audio guide (IAG) based on recent low-cost depth cameras that operates directly on relief surfaces that promise rapid tactile accessibility to 2.5D spatial information in a home or education setting, to on-line resources, or as a kiosk installation at public places.
Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations
Markit and Talkit are presented, a low-barrier toolkit for creating and interacting with 3D models with audio annotations that describe the model and their elements and can be used by hobbyists, teachers, and friends of blind people.
Designing Interactive 3D Printed Models with Teachers of the Visually Impaired
Researchers have design interactive 3D printed models that provide audio descriptions when a user touches components of a model that should have effective tactile features and contain both auditory and visual content.
Wizard of Oz for participatory design: inventing a gestural interface for 3D selection of neural pathway estimates
A participatory design process in which users invent and test their own gestural selection interfaces using a Wizard of Oz prototype is introduced, helping to yield the design of an interface for 3D pathway selection, a problem that is known to be difficult.
Tickers and Talker: An Accessible Labeling Toolkit for 3D Printed Models
A labeling toolkit that enables users to add and access audio labels to 3D printed models and evaluated Tickers and Talker, a signal processing application that detects and classifies Ticker sounds.
Map Learning with a 3D Printed Interactive Small-Scale Model: Improvement of Space and Text Memorization in Visually Impaired Students
It is argued that affordable home-made interactive small scale models can improve learning for visually impaired students because they are adaptable to any teaching situation including students with specific needs.
LucentMaps: 3D Printed Audiovisual Tactile Maps for Blind and Visually Impaired People
This work proposes an interaction concept for 3D printed audiovisual tactile maps, verify its feasibility and test it with a user study, and includes economic considerations crucial for a broad dissemination of tactile maps for both blind and visually impaired people.