Accessible images (AIMS): a model to build self-describing images for assisting screen reader users

@article{Nengroo2017AccessibleI,
  title={Accessible images (AIMS): a model to build self-describing images for assisting screen reader users},
  author={Ab Shaqoor Nengroo and K. S. Kuppusamy},
  journal={Universal Access in the Information Society},
  year={2017},
  volume={17},
  pages={607-619}
}
Non-visual web access depends on the textual description of various non-text elements of web pages. [] Key Method The proposed AIMS model has been built, targeting toward a web image description ecosystem in which images evolve into a self-description phase. The primary advantage of the proposed AIMS model is the elimination of the redundant description of an image resource at multiple instances. The experiments conducted on a dataset confirm that the AIMS model is capable of embedding and extracting…
X-Ray: Screenshot Accessibility via Embedded Metadata
TLDR
X-Ray, a system that captures and embeds the semantics of the underlying content into images, suggests a method for embedding accessibility metadata into otherwise inaccessible formats, enabling them to retain the more accessible representations that are present at capture time.
Document Navigability: A Need for Print-Impaired
TLDR
This paper proposes a vision based technique to locate the referenced content and extract metadata needed to inline a content summary into the audio narration of internal references to citations, footnotes, figures, tables and equations in scientific documents.
Multisensory Learning System Applying Augmented Reality
TLDR
The present study proposes the development of an augmented reality system for the multi-sensory learning of students in the field of mathematics through the use of Scratch, a programming language that allows people to develop applications without having deep knowledge of the code.
Effects of Cognitive Consistency in Microtask Design with only Auditory Information
TLDR
It is shown that consistency in navigation is an important factor and a principled framework that develops consistent non-visual microtasks is proposed that allows them to produce better results than tasks without consistency.
Improving the Accessibility of Scientific Documents: Current State, User Needs, and a System Solution to Enhance Scientific PDF Accessibility for Blind and Low Vision Users
TLDR
A small sample of papers was evaluated for successful extraction of display equations and categories of paper objects identified for evaluation along with the common errors seen for each category, including semantic categories and common extraction errors.
Identification of Important Images for Understanding Web Pages
TLDR
There are several types of images that are difficult to automatically assess the importance, thus, human-in-the-loop can be a promising approach to identify important ones in the types of image; and there are microtask designs that can result in the similar results but different to each other in terms of other criteria.

References

SHOWING 1-10 OF 41 REFERENCES
A Study on providing Alternative Text of Image for Web Accessibility Improvement
TLDR
The proposed method automatically extracts text from images with text using optical character recognition (OCR) software and uses the extracted text as alternative text for the images.
WebInSight:: making web images accessible
TLDR
WebInSight, a system that automatically creates and inserts alternative text into web pages on-the-fly, is introduced, with three labeling modules based on web context analysis, enhanced optical character recognition (OCR) and human labeling.
Improving accessibility of the web with a computer game
TLDR
Phetch is an enjoyable computer game that collects explanatory descriptions of images, and is an example of a new class of games that provide entertainment in exchange for human processing power.
Image quality assessment: from error visibility to structural similarity
TLDR
A structural similarity index is developed and its promise is demonstrated through a set of intuitive examples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000.
Labeling images with a computer game
TLDR
A new interactive system: a game that is fun and can be used to create valuable output that addresses the image-labeling problem and encourages people to do the work by taking advantage of their desire to be entertained.
VizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World
TLDR
VizLens robustly solves a long-standing challenge in accessibility by deeply integrating crowdsourcing and computer vision, and foreshadows a future of increasingly powerful interactive applications that would be currently impossible with either alone.
Distortion-Free Data Embedding for Images
TLDR
This paper introduces a general approach for high-capacity data embedding that is distortion-free (or lossless) in the sense that after the embedded information is extracted from the stego-image, the authors can revert to the exact copy of the original image before the embedding occurred.
A study on improvement of evaluation method on web accessibility automatic evaluation tool's alternative texts based on OCR
TLDR
A method that enhances accuracy compared to existing automatic evaluation methods by extracting texts from images containing texts and automatically inserting the results as alternative texts was proposed and implemented.
Image Captioning and Visual Question Answering Based on Attributes and Their Related External Knowledge
TLDR
A visual question answering model is designed that combines an internal representation of the content of an image with information extracted from a general knowledge base to answer a broad range of image-based questions.
From captions to visual concepts and back
TLDR
This paper uses multiple instance learning to train visual detectors for words that commonly occur in captions, including many different parts of speech such as nouns, verbs, and adjectives, and develops a maximum-entropy language model.
...
...