Project Zanzibar: A Portable and Flexible Tangible Interaction Platform

@article{Villar2018ProjectZA,
  title={Project Zanzibar: A Portable and Flexible Tangible Interaction Platform},
  author={Nicolas Villar and Daniel Cletheroe and Greg Saul and Christian Holz and Tim Regan and Oscar Salandin and Misha Sra and Hui-Shyong Yeo and William Field and Haiyan Zhang},
  journal={Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems},
  year={2018}
}
We present Project Zanzibar: a flexible mat that can locate, uniquely identify and communicate with tangible objects placed on its surface, as well as sense a user's touch and hover hand gestures. We describe the underlying technical contributions: efficient and localised Near Field Communication (NFC) over a large surface area; object tracking combining NFC signal strength and capacitive footprint detection, and manufacturing techniques for a rollable device form-factor that enables… 
View on ACM
microsoft.com
54 Citations
Highly Influential Citations
3
Background Citations
23
Methods Citations
12

Figures from this paper

54 Citations

Citation Type

Citation Type

Project Zanzibar Demonstration: A Portable and Flexible Tangible Interaction Platform
TLDR
Project Zanzibar is demonstrated, a flexible mat that locates, uniquely identifies, and communicates with tangible objects placed on its surface, as well as senses a user's touch and hover gestures and can extend sensing outside the bounds of the mat.
Project Tasca: Enabling Touch and Contextual Interactions with a Pocket-based Textile Sensor
TLDR
Project Tasca is presented, a pocket-based textile sensor that detects user input and recognizes everyday objects that a user carries in the pockets of a pair of pants that enable a rich variety of subtle, eyes-free, and always-available input, as well as context-driven interactions in wearable scenarios.
Dothraki: Tracking Tangibles Atop Tabletops Through De-Bruijn Tori
TLDR
This work proposes Dothraki, an inside-out tracking technique for tangibles on flat surfaces that efficiently searches the pattern space in order to determine the precise location of the tangible with sub-millimeter accuracy.
Tailored Controls: Creating Personalized Tangible User Interfaces from Paper
TLDR
This work presents a method that allows to quickly and inexpensively create personalized interfaces from plain paper via a simple configuration interface, based on markerless tracking of the user's fingers and the paper shapes on a surface using an RGBD camera mounted above the interaction space.
Itsy-Bits: Fabrication and Recognition of 3D-Printed Tangibles with Small Footprints on Capacitive Touchscreens
TLDR
Itsy-Bits: a fabrication pipeline for 3D printing and recognition of tangibles on capacitive touchscreens with a footprint as small as a fingertip, which reliably identifies and locates a variety of shapes in different sizes and estimates their orientation.
Sensing Posture-Aware Pen+Touch Interaction on Tablets
TLDR
This work proposes sensing techniques that transition between various nuances of mobile and stationary use via postural awareness, and shows how these sensors enable posture-aware pen+touch techniques that adapt interaction and morph user interface elements to suit fine-grained contexts of body-, arm-, hand-, and grip-centric frames of reference.
Body-Centric NFC: Body-Centric Interaction with NFC Devices Through Near-Field Clothing
TLDR
This paper presents an accessible method for fabricating flexible, extensible, and scalable NFC extenders on clothing pieces, and an easy-to-use toolkit for facilitating designers to realize the interactive experiences.
Exploring Tangible Interactions with Radar Sensing
TLDR
This paper explores two research questions with radar as a platform for sensing tangible interaction with the counting, ordering, identification of objects and tracking the orientation, movement and distance of these objects, and details the design space and practical use-cases.
Intermediation Family: Workspace for Sharing Spatial Design among Multiple Users
TLDR
A novel workspace for sharing a virtual space among multiple users with tangible interfaces and multiple perspectives, and two applications were implemented to hear opinions of some users, including a virtual walk-through application and a hands-on room layout application.
NFCSense: Data-Defined Rich-ID Motion Sensing for Fluent Tangible Interaction Using a Commodity NFC Reader
TLDR
NFCSense is presented, a data-defined rich-ID motion sensing technique for fluent tangible interaction design by using commodity near-field communication (NFC) tags and a single NFC tag reader that provides hot-swappable interactivity that enables smooth transitions throughout extended use.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 51 REFERENCES
TUIC: enabling tangible interaction on capacitive multi-touch displays
TLDR
TUIC simulates finger touches on capacitive displays using passive materials and active modulation circuits embedded inside tangible objects, and can be used with multi-touch gestures simultaneously.
PERCs: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays
TLDR
This work introduces PERCs, persistent capacitive tangibles that "know" whether they are currently on a capacitive touch surface or not, and evaluates detection rates, timing performance, and positional and angular accuracy for PERCs on a variety of unmodified, commercially available multi-touch devices.
Designing tangible magnetic appcessories
TLDR
This paper describes the design and construction of eight magnetic appcessories, cheap, robust physical interfaces that leverage magnets (and the magnetic sensing built into mobile devices) to support reliable and expressive tangible interactions with digital content.
Tangible bits: towards seamless interfaces between people, bits and atoms
TLDR
Tangible Bits allows users to "grasp & manipulate" bits in the center of users’ attention by coupling the bits with everyday physical objects and architectural surfaces and ambient media for background awareness.
Tangible interfaces for remote communication and collaboration
TLDR
The design and prototype implementation of inTouch are discussed, along with control strategies for extending the physical link over an arbitrary distance, and the broader implications of Synchronized Distributed Physical Objects in the design of distributed multi-user systems are considered.
SLAP widgets: bridging the gap between virtual and physical controls on tabletops
TLDR
Empirical studies show that SLAPWidgets are easy to use and outperform virtual controls significantly in terms of accuracy and overall interaction time.
Pre-Touch Sensing for Mobile Interaction
TLDR
A self-capacitance touchscreen that can sense multiple fingers above a mobile device, as well as grip around the screen's edges is explored, which enables hybrid touch + hover gestures, and illustrates how pre-touch sensing offers an intriguing new back-channel for mobile interaction.
SmartSkin: an infrastructure for freehand manipulation on interactive surfaces
TLDR
A new sensor architecture for making interactive surfaces that are sensitive to human hand and finger gestures that can be integrated within the surface, and which does not suffer from lighting and occlusion problems.
Bricks: laying the foundations for graspable user interfaces
TLDR
This work introduces the concept of Graspable User Interfaces that allow direct control of electronic or virtual objects through physical handles for control, and presents a design space for Bricks which lay the foundation for further exploring and developing Graspables User Inter interfaces.
The DigitalDesk calculator: tangible manipulation on a desk top display
TLDR
The motivation behind this work is discussed, the Digi talDesk, tangible manipulation, and the calculator prototype are described, and implementation details are discussed and ideas for the future of tangible manipulation are discussed.
...
1
2
3
4
5
...