Enhancing Cross-Device Interaction Scripting with Interactive Illustrations
@article{Chi2016EnhancingCI, title={Enhancing Cross-Device Interaction Scripting with Interactive Illustrations}, author={Pei-Yu Chi and Yang Li and Bj{\"o}rn Hartmann}, journal={Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems}, year={2016} }
Cross-device interactions involve input and output on multiple computing devices. Implementing and reasoning about interactions that cover multiple devices with a diversity of form factors and capabilities can be complex. To assist developers in programming cross-device interactions, we created DemoScript, a technique that automatically analyzes a cross-device interaction program while it is being written. DemoScript visually illustrates the step-by-step execution of a selected portion or the…
25 Citations
UI Testing Cross-Device Applications
- Computer ScienceISS
- 2016
XD-Testing is introduced, a library that provides explicit and implicit device selectors, device templates and scenarios, as well as a visualiser for application screenshots that is used to author human-readable tests for a cross-device gallery that verify if a UI distributes correctly and if it works as expected despite being distributed.
Improv
- Computer ScienceACM Trans. Comput. Hum. Interact.
- 2017
Improv is presented, a cross-device input framework that allows a user to easily leverage the capability of additional devices to create new input methods for an existing, unmodified application, e.g., creating custom gestures on a smartphone to control a desktop presentation application.
End-user development of cross-device user interfaces
- Computer ScienceEICS
- 2016
The goal of the XDUI 2016 workshop is to bring together leading and upcoming researchers in the area of multi-device interaction where many different cross-device systems and tools have recently been…
Doppio: Tracking UI Flows and Code Changes for App Development
- Computer ScienceCHI
- 2018
Doppio, a tool that automatically tracks and visualizes UI flows and their changes based on source code, is developed, which is able to generate quality visual documentation and helped participants understand unfamiliar source code and track changes.
SketchStudio: Experience Prototyping with 2.5-Dimensional Animated Design Scenarios
- Art, Computer ScienceConference on Designing Interactive Systems
- 2018
SketchStudio, a prototyping tool for generating, sharing, and reviewing an animated design scenario involving complex design subjects, and the result of a user study with nine potential users in the design practice and education fields is presented.
A web framework for cross-device gestures between personal devices and public displays
- Computer ScienceMUM
- 2017
This work presents the design and implementation of a Web framework for the development of cross-device user interfaces able to take advantage of both personal devices and public displays, and support various types of gestures and their combinations in such multi-device environments.
Understanding the Challenges and Needs of Programmers Writing Web Automation Scripts
- Computer Science2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)
- 2021
Two studies are conducted to study how programmers write web automation scripts and the ways website UI context and script feedback can be helpful, and a set of design findings are provided that detail the kinds of context and feedback developers need while writingweb automation scripts.
The Moving Context Kit: Designing for Context Shifts in Multi-Device Experiences
- Computer ScienceConference on Designing Interactive Systems
- 2017
A reusable design kit of scenarios, "hint" cards, and a framework that codifies insights from prior work and a field study that enables designers to engage with complex user needs, situations, and relationships when incorporating novel multi-device techniques into the products they envision.
Tools Strategies and Best Practices for Designing , Evaluating and Sharing Technical HCI Toolkits CHI 2017 Workshop
- Computer Science
- 2019
The intention is to share research experiences on methodical toolkits and juxtapose it with the technical toolkit expertise of the workshop participants to steer the discussion towards a holistic understanding that promotes toolk Kits as a research method for HCI and develop a tool-chain that supports the systematic design of high-quality technical toolkiting.
References
SHOWING 1-10 OF 42 REFERENCES
Interactive development of cross-device user interfaces
- Computer ScienceCHI
- 2014
To support interactive development for multi-device environments, where not all devices may be present at design and run-time, XDStudio supports switching between the two authoring modes, as well as between design and use mode, as required.
Weave: Scripting Cross-Device Wearable Interaction
- Computer ScienceCHI
- 2015
Weave provides a set of high-level APIs, based on JavaScript, for developers to easily distribute UI output and combine sensing events and user input across mobile and wearable devices.
Design as exploration: creating interface alternatives through parallel authoring and runtime tuning
- Computer Science, ArtUIST '08
- 2008
Techniques to support design exploration for desktop, mobile, and physical interfaces are described, and this work is situated in a larger design space of tools for explorative programming.
Employing patterns and layers for early-stage design and prototyping of cross-device user interfaces
- Art, Computer ScienceCHI
- 2008
Damask is a prototyping tool that targets web UIs that run on PCs and mobile phones, and prompt-and-response style voice UIs, which found that, in the early stages, designers using patterns and layers in Damask created cross-device UIs which are rated at least as good as those created without patterns and layer.
FrameWire: a tool for automatically extracting interaction logic from paper prototyping tests
- Computer ScienceCHI
- 2010
FrameWire is a computer vision-based system that automatically extracts interaction flows from the video recording of paper prototype user tests and offers two distinct benefits for designers: a structural view of the video Recording that allows a designer or a stakeholder to easily distill and understand the design concept and user interaction behaviors.
Codelets: linking interactive documentation and example code in the editor
- Computer ScienceCHI
- 2012
This paper investigates whether treating examples as "first-class" objects in the code editor - rather than simply as strings of text - will allow programmers to use examples more effectively, and explores this through the creation and evaluation of Codelets.
Reflective physical prototyping through integrated design, test, and analysis
- Computer ScienceUIST
- 2006
d.tools is presented, a toolkit that embodies an iterative-design-centered approach to prototyping information appliances that provides a low threshold for early-stage prototyping, extensible through code for higher-fidelity prototypes.
The designers' outpost: a tangible interface for collaborative web site
- Computer Science, ArtUIST '01
- 2001
The Designers' Outpost, a tangible user interface that combines the affordances of paper and large physical workspaces with the advantages of electronic media to support information design, and validation that Outpost supports information architecture work practice.
Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions
- Computer ScienceCHI
- 2015
The results indicate that spatially-aware techniques are preferred by users and can decrease mental demand, effort, and frustration, but only when they are designed with great care.
Sketching storyboards to illustrate interface behaviors
- Computer Science, ArtCHI Conference Companion
- 1996
This work has developed a tool called SILK that allows designers to quickly sketch an interface electronically, and this electronic sketch is interactive.