Enhancing Cross-Device Interaction Scripting with Interactive Illustrations

@article{Chi2016EnhancingCI,
  title={Enhancing Cross-Device Interaction Scripting with Interactive Illustrations},
  author={Pei-Yu Chi and Yang Li and Bj{\"o}rn Hartmann},
  journal={Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems},
  year={2016}
}
  • Pei-Yu Chi, Yang Li, B. Hartmann
  • Published 7 May 2016
  • Computer Science
  • Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
Cross-device interactions involve input and output on multiple computing devices. Implementing and reasoning about interactions that cover multiple devices with a diversity of form factors and capabilities can be complex. To assist developers in programming cross-device interactions, we created DemoScript, a technique that automatically analyzes a cross-device interaction program while it is being written. DemoScript visually illustrates the step-by-step execution of a selected portion or the… 

Figures from this paper

UI Testing Cross-Device Applications
TLDR
XD-Testing is introduced, a library that provides explicit and implicit device selectors, device templates and scenarios, as well as a visualiser for application screenshots that is used to author human-readable tests for a cross-device gallery that verify if a UI distributes correctly and if it works as expected despite being distributed.
Improv
TLDR
Improv is presented, a cross-device input framework that allows a user to easily leverage the capability of additional devices to create new input methods for an existing, unmodified application, e.g., creating custom gestures on a smartphone to control a desktop presentation application.
End-user development of cross-device user interfaces
The goal of the XDUI 2016 workshop is to bring together leading and upcoming researchers in the area of multi-device interaction where many different cross-device systems and tools have recently been
Doppio: Tracking UI Flows and Code Changes for App Development
TLDR
Doppio, a tool that automatically tracks and visualizes UI flows and their changes based on source code, is developed, which is able to generate quality visual documentation and helped participants understand unfamiliar source code and track changes.
SketchStudio: Experience Prototyping with 2.5-Dimensional Animated Design Scenarios
TLDR
SketchStudio, a prototyping tool for generating, sharing, and reviewing an animated design scenario involving complex design subjects, and the result of a user study with nine potential users in the design practice and education fields is presented.
A web framework for cross-device gestures between personal devices and public displays
TLDR
This work presents the design and implementation of a Web framework for the development of cross-device user interfaces able to take advantage of both personal devices and public displays, and support various types of gestures and their combinations in such multi-device environments.
Understanding the Challenges and Needs of Programmers Writing Web Automation Scripts
TLDR
Two studies are conducted to study how programmers write web automation scripts and the ways website UI context and script feedback can be helpful, and a set of design findings are provided that detail the kinds of context and feedback developers need while writingweb automation scripts.
The Moving Context Kit: Designing for Context Shifts in Multi-Device Experiences
TLDR
A reusable design kit of scenarios, "hint" cards, and a framework that codifies insights from prior work and a field study that enables designers to engage with complex user needs, situations, and relationships when incorporating novel multi-device techniques into the products they envision.
Tools Strategies and Best Practices for Designing , Evaluating and Sharing Technical HCI Toolkits CHI 2017 Workshop
TLDR
The intention is to share research experiences on methodical toolkits and juxtapose it with the technical toolkit expertise of the workshop participants to steer the discussion towards a holistic understanding that promotes toolk Kits as a research method for HCI and develop a tool-chain that supports the systematic design of high-quality technical toolkiting.
...
1
2
3
...

References

SHOWING 1-10 OF 42 REFERENCES
Interactive development of cross-device user interfaces
TLDR
To support interactive development for multi-device environments, where not all devices may be present at design and run-time, XDStudio supports switching between the two authoring modes, as well as between design and use mode, as required.
Weave: Scripting Cross-Device Wearable Interaction
TLDR
Weave provides a set of high-level APIs, based on JavaScript, for developers to easily distribute UI output and combine sensing events and user input across mobile and wearable devices.
Design as exploration: creating interface alternatives through parallel authoring and runtime tuning
TLDR
Techniques to support design exploration for desktop, mobile, and physical interfaces are described, and this work is situated in a larger design space of tools for explorative programming.
Employing patterns and layers for early-stage design and prototyping of cross-device user interfaces
TLDR
Damask is a prototyping tool that targets web UIs that run on PCs and mobile phones, and prompt-and-response style voice UIs, which found that, in the early stages, designers using patterns and layers in Damask created cross-device UIs which are rated at least as good as those created without patterns and layer.
FrameWire: a tool for automatically extracting interaction logic from paper prototyping tests
TLDR
FrameWire is a computer vision-based system that automatically extracts interaction flows from the video recording of paper prototype user tests and offers two distinct benefits for designers: a structural view of the video Recording that allows a designer or a stakeholder to easily distill and understand the design concept and user interaction behaviors.
Codelets: linking interactive documentation and example code in the editor
TLDR
This paper investigates whether treating examples as "first-class" objects in the code editor - rather than simply as strings of text - will allow programmers to use examples more effectively, and explores this through the creation and evaluation of Codelets.
Reflective physical prototyping through integrated design, test, and analysis
TLDR
d.tools is presented, a toolkit that embodies an iterative-design-centered approach to prototyping information appliances that provides a low threshold for early-stage prototyping, extensible through code for higher-fidelity prototypes.
The designers' outpost: a tangible interface for collaborative web site
TLDR
The Designers' Outpost, a tangible user interface that combines the affordances of paper and large physical workspaces with the advantages of electronic media to support information design, and validation that Outpost supports information architecture work practice.
Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions
TLDR
The results indicate that spatially-aware techniques are preferred by users and can decrease mental demand, effort, and frustration, but only when they are designed with great care.
Sketching storyboards to illustrate interface behaviors
TLDR
This work has developed a tool called SILK that allows designers to quickly sketch an interface electronically, and this electronic sketch is interactive.
...
1
2
3
4
5
...