• Corpus ID: 16713513

Taxonomy and Overview of Multi-touch Frameworks: Architecture, Scope and Features

  title={Taxonomy and Overview of Multi-touch Frameworks: Architecture, Scope and Features},
  author={Dietrich Kammer and Mandy Keck and Markus Wacker},
Multi-touch hardware has only recently entered the mainstream of information technology. Interaction designers, product developers and users have been influenced by this development. In order to build multitouch applications, programmers have created various reusable frameworks. To obtain an overview of this diversity, we present a list of criteria to classify, evaluate, and select multi-touch frameworks. Our main contribution consists in a taxonomy that we have elaborated out of a vast list of… 

Figures and Tables from this paper

Engineering patterns for multi-touch interfaces
This workshop seeks a consensus on methods, approaches, toolkits, and tools that aid in the engineering of multi-touch interfaces and transcend the differences in available platforms to create a reusable body of knowledge.
Midas: a declarative multi-touch interaction framework
This work presents Midas, a declarative model for the definition and detection of multi-touch gestures where gestures are expressed via logical rules over a set of input facts and highlights how the rule-based language approach leads to improvements in gesture extensibility and reusability.
Liquid: Library for Interactive User Interface Development
This contribution illustrates the application of visual programming in the multi-touch context, presents related work, and explains the workflow of Liquid with the help of an instructive example.
Software requirements for a (more) manageable multi-touch ecosystem
This paper details and explains different needs, discusses potential solutions and presents the first steps taken towards a new multitouch toolkit to address them.
Hacking with multi-touch for Java (MT4j)
The experience using MT4j for developing a number of software applications to support developers working in co-located teams will help developers to understand the nuances of the toolkit and design issues that can be applied to other toolkits for developing multi-user touch based applications.
jQMultiTouch: lightweight toolkit and development framework for multi-touch/multi-device web interfaces
Application developers currently have to deal with the increased proliferation of new touch devices and the diversity in terms of both the native platform support for common gesture-based
Multi-touch Interaction for Interface Prototyping
This dissertation addresses problems by proposing a prototyping tool that runs on a multi-touch tabletop, leveraging the NUI paradigm, and that allows the creation of prototypes suitable for both GUI and multi- touch interfaces.
An Architecture to Support Multi-Touch Collaborative Information Retrieval
There are three main goals of the proposed architecture: to create hardware independence, to separate the gesture recognition and CIR information objects from the application code and to make use of an extensible gesture definition set to allow for application-specific operations.
Formal description of multi-touch interactions
A tool-supported model-based approach suitable for the development of interactive systems featuring multi-touch interactions techniques and demonstrates the possibility to describe touch interaction techniques in a complete and unambiguous way and that the formal description technique is amenable to verification.
Tool support for developing scalable multiuser applications on multi-touch screens
This work presents ChordiAction toolkit that makes use of a novel chorded interaction technique allowing simultaneous multi-user interaction on scalable MT applications and describes the design, the architecture and some efficient customizations practices of the toolkit.


A multitouch software architecture
This work aims to identify the common traits of these systems and present a layered software architecture which abstracts these similarities by defining common interfaces between successive layers, which provides developers with a unified view of the various types of multitouch hardware.
Interactive Design of Multimodal User Interfaces Reducing technical and visual complexity
A software architecture that enables the unification of a great variety of very heterogeneous device drivers and special-purpose toolkits in a common interaction library named ”Squidy” and a visual design environment that minimizes the threshold for its usage but scales well with increasing complexity (ceiling) is introduced.
Sparsh UI: A Multi-Touch Framework for Collaboration and Modular Gesture Recognition
Criteria for evaluating a multi-touch library and “Sparsh UI”— an open source multi- touch library which is a novel attempt to address these issues by enabling developers to easily develop multi- Touch applications are presented.
PyMT: a post-WIMP multi-touch user interface toolkit
This work discusses PyMT's architecture and sample applications to demonstrate how it enables rapid development of prototypes and interaction techniques while being accessible to novice programmers and providing great flexibility and creative freedom to advanced users.
A gestural interaction design model for multi-touch displays
A comprehensive understanding of all possible touch types for touch-sensitive devices is attempted by constructing a design model for touch interaction and clarifying their characteristics, resulting in touch gesture taxonomy.
Ripples: utilizing per-contact visualizations to improve user interaction with touch displays
Ripples is a system which enables visualizations around each contact point on a touch display and, through these visualizations, provides feedback to the user about successes and errors of their touch interactions, engineered to be overlaid on top of existing applications without requiring the applications to be modified in any way.
Objects, Containers, Gestures, and Manipulations: Universal Foundational Metaphors of Natural User Interfaces
This paper compares OCGM to existing paradigms using SRK behavior classification and early childhood cognitive development, and justifies the “universal” and “foundational” descriptors based upon cognitive linguistics and universal grammar.
Gesture Recognition mAnagement Framework for Interactive Tabletop Interfaces
  • Diploma thesis at University of Pisa. December
  • 2008
GestureWorks – true Multitouch for Flash. Website. Retrieved: 2010-04-30. Available at: http://gestureworks
  • GestureWorks – true Multitouch for Flash. Website. Retrieved: 2010-04-30. Available at: http://gestureworks
Breezemultitouch – Multi-touch framework for WPF 3.5. Website. Retrieved: 2010-04- 30. Available at
  • Breezemultitouch – Multi-touch framework for WPF 3.5. Website. Retrieved: 2010-04- 30. Available at