Deaf and Hard-of-hearing Individuals' Preferences for Wearable and Mobile Sound Awareness Technologies

@article{Findlater2019DeafAH,
  title={Deaf and Hard-of-hearing Individuals' Preferences for Wearable and Mobile Sound Awareness Technologies},
  author={Leah Findlater and Bonnie Chinh and Dhruv Jain and Jon Froehlich and Raja S. Kushalnagar and Angela Lin},
  journal={Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems},
  year={2019}
}
To investigate preferences for mobile and wearable sound awareness systems, we conducted an online survey with 201 DHH participants. The survey explores how demographic factors affect perceptions of sound awareness technologies, gauges interest in specific sounds and sound characteristics, solicits reactions to three design scenarios (smartphone, smartwatch, head-mounted display) and two output modalities (visual, haptic), and probes issues related to social context of use. While most… 

Figures and Tables from this paper

Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts
TLDR
The findings characterize uses for vibration in multimodal sound awareness, both for push notification and for immediately actionable sound information displayed through vibrational patterns (tactons) in smartwatch feedback techniques.
Interest and Requirements for Sound-Awareness Technologies Among Deaf and Hard-of-Hearing Users of Assistive Listening Devices
TLDR
It is found that users of assistive listening devices still often miss sounds and rely on other people to obtain information about them, and the importance of awareness of different types of sounds varied according to the environment and the form factor of the sound-awareness technology.
Exploring Sound Awareness in the Home for People who are Deaf or Hard of Hearing
TLDR
A general interest in smarthome-based sound awareness systems is suggested particularly for displaying contextually aware, personalized and glanceable visualizations but key concerns arose related to privacy, activity tracking, cognitive overload, and trust.
Understanding deaf and hard-of-hearing users' interest in sign-language interaction with personal-assistant devices
TLDR
Empirical knowledge of DHH signers' interest in ASL interaction with voice-controlled personal-assistant devices is contributed, providing motivation and foundation for future research, including what to include in future datasets of videos of users giving commands in AsL, needed to create future sign-recognition technology.
Field study of a tactile sound awareness device for deaf users
TLDR
A wearable tactile technology to provide sound feedback to DHH people is explored and it is reported that participants reported that their device increased awareness of sounds by conveying actionable cues and 'experiential' sound information.
Signing-on-the-Fly: Technology Preferences to Reduce Communication Gap between Hearing Parents and Deaf Children
TLDR
The design space of Augmented Reality (AR) and wearable technologies in supporting hearing parents to offer sign language environments for young DHH children is investigated and it is found that Near-Object Projection is most preferred for real-time ASL delivery, and haptic feedback is most Preferred for raising the parent’s awareness of a child’'s attention.
EarVR: Using Ear Haptics in Virtual Reality for Deaf and Hard-of-Hearing People
TLDR
A new prototype called “EarVR” that can be mounted on any desktop or mobile VR Head-Mounted Display (HMD) that analyzes 3D sounds in a VR environment and locates the direction of the sound source that is closest to a user and notifies the user about the sound direction using two vibro-motors placed on the user's ears.
Wearable Subtitles: Augmenting Spoken Communication with Lightweight Eyewear for All-day Captioning
TLDR
Wearable Subtitles is a lightweight 3D-printed proof-of-concept HWD that explores augmenting communication through sound transcription for a full workday using a low-power microcontroller architecture and addresses critical challenges for the adoption of HWDs.
A Taxonomy of Sounds in Virtual Reality
TLDR
A novel taxonomy for VR sounds was able to successfully categorize nearly all sounds in these apps and uncovered additional insights for designing accessible visual and haptic-based sound substitutes for DHH users.
HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users
TLDR
HomeSound, an in-home sound awareness system for Deaf and hard of hearing (DHH) users, consists of a microphone and display, and uses multiple devices installed in each home, similar to the Echo Show or Nest Hub.
...
...

References

SHOWING 1-10 OF 48 REFERENCES
Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing
TLDR
This paper design and evaluate visualizations for spatially locating sound on a head-mounted display (HMD) and developed eight high-level visual sound feedback dimensions, reaffirm past work on challenges faced by persons with hearing loss in group conversations, provide support for the general idea of sound awareness visualizations on HMDs, and reveal preferences for specific design options.
Exploring Sound Awareness in the Home for People who are Deaf or Hard of Hearing
TLDR
A general interest in smarthome-based sound awareness systems is suggested particularly for displaying contextually aware, personalized and glanceable visualizations but key concerns arose related to privacy, activity tracking, cognitive overload, and trust.
A Personalizable Mobile Sound Detector App Design for Deaf and Hard-of-Hearing Users
TLDR
A mobile phone app that alerts deaf and hard-of-hearing people to sounds they care about is designed, and the viability of a basic machine learning algorithm for sound detection is explored.
Can you see what i hear?: the design and evaluation of a peripheral sound display for the deaf
TLDR
Two visual displays for providing awareness of environmental audio to deaf individuals are developed that support both monitoring and notification of sounds, support discovery of new sounds, and do not require a priori knowledge of sounds to be detected.
Visualizing non-speech sounds for the deaf
TLDR
An investigation of peripheral, visual displays to help people who are deaf maintain an awareness of sounds in the environment and presents a set of visual design preferences and functional requirements for peripheral visualizations of non-speech audio that will help improve future applications.
Evaluating non-speech sound visualizations for the deaf
TLDR
An iterative investigation of peripheral, visual displays of ambient sounds, providing valuable information about the sound awareness needs of the deaf and can help to inform further design of such applications.
Design and evaluation of a smartphone application for non-speech sound awareness for people with hearing loss
  • M. Mielke, R. Brück
  • Physics
    2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  • 2015
TLDR
A flexible and mobile assistive device basing on a smartphone that detects and recognizes acoustic events by analysing the acoustic environment of the user and using pattern recognition algorithms the user can define the sounds that should be recognised by the device.
Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing
TLDR
Results show that, while walking, HMD captions can support communication access and improve attentional balance between the speakers(s) and navigating the environment.
Light-Emitting Device for Supporting Auditory Awareness of Hearing-Impaired People during Group Conversations
TLDR
This study proposes a novel wearable device that augments the auditory awareness of hearing impaired people to help them identify the speaker during group conversations by estimating the direction of the sound source and indicating the estimated direction in real time with light-emitting diodes (LEDs).
Design Implications for a Ubiquitous Ambient Sound Display for the Deaf
TLDR
This work gathered design requirements based on a participatory design process including expert interviews, an online questionnaire as well as a design workshop at a local organization for deaf people to explore the applicability of the ceiling for ambient sound visualizations for deaf and hearing-impaired people.
...
...