Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques

  title={Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques},
  author={Shaun K. Kane and Jeffrey P. Bigham and Jacob O. Wobbrock},
  booktitle={International ACM SIGACCESS Conference on Computers and Accessibility},
Recent advances in touch screen technology have increased the prevalence of touch screens and have prompted a wave of new touch screen-based devices. However, touch screens are still largely inaccessible to blind users, who must adopt error-prone compensatory strategies to use them or find accessible alternatives. This inaccessibility is due to interaction techniques that require the user to visually locate objects on the screen. To address this problem, we introduce Slide Rule, a set of audio… 

Figures and Tables from this paper


An application called Slide Rule is developed that uses audio output and gesture input to enable blind people to interact with touch screens and has the potential to significantly increase accessibility on a wide range of touch screen devices.

Access overlays: improving non-visual access to large touch screens for blind users

Three software-based access overlays intended to improve the accessibility of large touch screen interfaces, specifically interactive tabletops are introduced, called edge projection, neighborhood browsing, and touch-and-speak.

Two-button Mobile Interface: Touchscreen Based Text-Entry for Visually-Impaired Users

It was found that the subjects felt the proposed schemes more comfortable to use than the VoiceOver, and the convenience of using only two buttons in the mobile interface also enabled visually-impaired users to be less dependent on auditory feedback while typing texts.

Survey of Eye-Free Text Entry Techniques of Touch Screen Mobile Devices Designed for Visually Impaired Users

A critical review of different keypad layouts designed for visually impaired users and their effect on text entry speed and key issues to extend accessibility and text entry rate of touch screen devices are listed.

A Touch Sensitive User Interface Approach on Smartphones for Visually Impaired and Blind Persons

The suggested new solution for Android mobile phones is to provide specialised ”talking touch” views, such as a ” talking touch list”, which allow fast input with audio feedback, which showed an already promising positive response on first usability studies with the target group.

Making touch-based kiosks accessible to blind users through simple gestures

This study set out to demonstrate that touch-based kiosks can be designed to include blind users without compromising the user experience for non-blind users.

Interacting with mobile devices via VoiceOver: usability and accessibility issues

In this paper we analyze the interaction of blind users with Apple touchscreen devices iPad, iPhone and iPod touch, accessible to the visually-impaired thanks to their pre-installed VoiceOver screen

Finger Based Techniques for Nonvisual Touchscreen Text Entry

This research proposes Finger Based Technique (FBT) for non-visual touch screen device interaction designed for blind users and shows that Single Digit FDI is substantially faster and more accurate than Double DigIt FDI and iPhone voice-over.

Mobile Braille Touch : Improving The Accessibility Of Touchscreen-Based Mobile Devices For The Visually Impaired Person As One Of Learning Media

This research overviews the MBT learning media that consist of six-part module based on braille chorded input and builds on several previous works carried out for develop mobile touchscreen for the visually impaired with four parameters of measurement including speed of braille text entry, depth error analysis, and the lesson and learned for the design of learning media, and evaluation of accessible of eyes-free soft keyboards.

Designing wearable interfaces for blind people

A pair of gloves is developed that is capable to recognise mid-air gestures, and also allows the input and output of text, and it is found that a training based on the user’s gestures is better for recognition accuracy.



Adaptive blind interaction technique for touchscreens

The development of a new technique for touchscreen interaction, based on a single gesture-driven adaptive software button, which is intended to substitute the software keyboard, and provides text-entry functionality is described.

Issues and techniques in touch-sensitive tablet input

It is shown that touch-sensitive tablets have some important properties that differentiate them from other input devices (such as mice and joysticks), and three specific distinctions between touch tablets and one button mice are drawn.

Target size study for one-handed thumb use on small touchscreen devices

A two-phase study to determine optimal target sizes for one-handed thumb use of mobile handheld devices equipped with a touch-sensitive screen found that target size of 9.2 mm for discrete tasks and targets of 7.6 mm for serial tasks should be sufficiently large for one the handed thumb use on touchscreen-based handhelds without degrading performance and preference.

High Precision Touchscreens: Design Strategies and Comparisons with a Mouse

Blindsight: eyes-free access to mobile phones

This work presents blindSight, a prototype application that replaces the traditionally visual in-call menu of a mobile phone with a visual interface based on auditory feedback, and presents the results of two user studies of this prototype.

Improving the accuracy of touch screens: an experimental evaluation of three strategies

The results showed that a touch strategy providing continuous feedback until a selection was confirmed had fewer errors than other touch strategies, with implications for touch screens containing small, densely-packed targets.

Mobile ADVICE: an accessible device for visually impaired capability enhancement

The goal was to design a handheld mobile device to overcome limitations such as reliance on visual display and lack of audio and tactile feedback to enhance the capabilities of visually impaired users of handheld mobile devices.

Earpod: eyes-free menu selection using touch input and reactive audio feedback

The design and evaluation of earPod indicate that earPod is potentially a reasonable eyes-free menu technique for general use, and is a particularly exciting technique for use in mobile device interfaces.

Mobile Messenger for the Blind

Software to use mobile devices by blind users considers a system of instant messenger to favor interaction of blind users with any other user connected to the network to create a messenger system specially tailored to people with visual disabilities.

Can we do without GUIs? Gesture and speech interaction with a patient information system

It was suggested that for a small set of semantically distinct services with memorable and distinct gestures, the absence of a GUI visual display does not impair the usability of a system with gesture input and speech output.