Acoustruments: passive, acoustically-driven, interactive controls for handheld devices

  title={Acoustruments: passive, acoustically-driven, interactive controls for handheld devices},
  author={Gierad Laput and Eric Brockmeyer and Moshe Mahler and Scott E. Hudson and Chris Harrison},
  journal={ACM SIGGRAPH 2015 Emerging Technologies},
Smartphones and handheld devices are increasingly being used in interactive applications beyond their conventional touchscreens. For example, tangibles allow users to interact with mobile devices using physical objects both on screen and around the device. Similarly, there is a growing class of auxiliary devices that require a smartphone to be docked, transforming an otherwise simple object into something with rich interactivity. However, these auxiliary devices still require numerous… 

Figures from this paper

Instrumenting Our World, Ourselves, and Our Livestock
This installment of Notes from the Community covers the many different ways the authors instrument their world, ourselves, and their stuff, and the inevitable discussions of privacy, power, and sheep.
A survey on acoustic sensing
A first survey of recent advances in acoustic sensing using commodity hardware is presented and a general framework that categorizes main building blocks of acoustic sensing systems is proposed, i.e., the physical layer, processing layer, and application layer is proposed.
SqueezaPulse: Adding Interactive Input to Fabricated Objects Using Corrugated Tubes and Air Pulses
The underlying acoustic theory used to inform the design, an informal examination of the effect of different 3D-printed corrugations on air signatures, and the resulting SqueezaPulse implementation are described.
BaroTouch: A Technique for Touch Force Sensing Using a Waterproof Device's Built-in Barometer
A technique that leverages a waterproof mobile device’s built-in barometer to measure the touch force and the relationship between the sensor value and the touch positions or forces using weights with three devices: two smartphones and a smartwatch.
Blowhole: Blowing-Activated Tags for Interactive 3D-Printed Models
Requiring no special printing techniques, components, or assembly and working on consumer-level 3D printers, Blowhole adds acoustically resonant cavities to the interior of a model with unobtrusive openings at the surface of the object.
Detecting Position of a Device by Swept Frequency of Microwave on Two-Dimensional Communication System
A machine learning technique is used to learn the accumulated power pattern data to predict the position of the device and the accuracy of the position detection was 79.1% when the antenna is moved at 12mm intervals.
Gesture Recognition Method Utilizing Ultrasonic Active Acoustic Sensing
A method for gesture recognition that utilizes active acoustic sensing, which transmits acoustic signals to a target, and recognizes the target’s state by analyzing the response, which is not adversely affected by audible-range sounds generated by the environment and body movements.
Making Ritual Machines: The Mobile Phone as a Networked Material for Research Products
The phone is surveyed and deconstructed as a material that can be worked to a vast range of technical effects, extended by hardware and configured by software, and offered the Interaction Design community seven specific and actionable techniques for using mobile telephones in Research Products.
Mobile Music, Sensors, Physical Modeling, and Digital Fabrication: Articulating the Augmented Mobile Instrument
Two concepts are presented, extended, and unified in this paper: mobile device augmentation towards musical instruments design and the concept of hybrid instruments. The first consists of using
Passively augmenting mobile devices towards hybrid musical instrument design
A framework to quickly design and prototype passive mobile device augmentations to leverage existing features of the device for the end goal of mobile musical instruments is introduced.


Acoustruments: Passive, Acoustically-Driven, Interactive Controls for Handheld Devices
This work introduces Acoustruments: low-cost, passive, and power-less mechanisms, made from plastic, that can bring rich, tangible functionality to handheld devices, introducing a cheap and passive method for adding interactive controls to consumer products.