ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers

@article{Laput2016ViBandHB,
  title={ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers},
  author={Gierad Laput and Robert Xiao and Chris Harrison},
  journal={Proceedings of the 29th Annual Symposium on User Interface Software and Technology},
  year={2016}
}
Smartwatches and wearables are unique in that they reside on the body, presenting great potential for always-available input and interaction. [] Key Method For example, we can use bio-acoustic data to classify hand gestures such as flicks, claps, scratches, and taps, which combine with on-device motion tracking to create a wide range of expressive input modalities.
AudioTouch: Minimally Invasive Sensing of Micro-Gestures via Active Bio-Acoustic Sensing
We present AudioTouch, a minimally invasive approach for sensing micro-gestures using active bio-acoustic sensing. It only requires attaching two piezo-electric elements, acting as a surface mounted
HAND GESTURE RECOGNITION USING BIOACOUSTIC RE- SPONSE
TLDR
This study developed a wearable wristband sensor provided with a transducer and a contact microphone, and made the individual multi-layer perceptron (MLP) model by fine-tuning the pre-trained MLP model, applying it to estimate hand gestures.
Vibrosight: Long-Range Vibrometry for Smart Environment Sensing
TLDR
This work presents Vibrosight, a new approach to sense activities across entire rooms using long-range laser vibrometry, which can sense physical vibrations at one specific point, making it robust to interference from other activities and noisy environments.
A Low Latency On-Body Typing System through Single Vibration Sensor
TLDR
A portable, cost efficient text-entry system, termed ViType, which first leverages a single small form factor sensor to achieve a practical user input with much lower sampling rates, and designs a set of novel mechanisms, including a fine-grained feature extraction to process the vibration signals.
SoundCraft: Enabling Spatial Interactions on Smartwatches using Hand Generated Acoustics
TLDR
The algorithm, which is described, adopts from the MUltiple SIgnal Classification (MUSIC) technique, that enables robust localization and classification of the acoustics when the microphones are required to be placed at close proximity is described.
Interferi: Gesture Sensing using On-Body Acoustic Interferometry
TLDR
This work built and tested a series of worn sensor configurations, which were used to identify useful transducer arrangements and machine learning fea-tures for interferi, and created final prototypes for the hand and face, which show great promise and illuminate an inter-esting sensing technique for HCI applications.
CapBand: Battery-free Successive Capacitance Sensing Wristband for Hand Gesture Recognition
TLDR
A wrist muscles-to-gesture model is built, based on which a hand gesture classification method using both motion and static features is developed, and a kernel-based on-wrist localization technique to detect the CapBand's position on the user's wrist is proposed.
SELF-SYNCHRONOUS INPUT FOR WEARABLES
TLDR
SelfSync is presented, a gesture interface that enables users to define and perform actions simultaneously in a subtle manner, using a combination of hand, head and leg gestures, without paying attention to the device.
Upsampling Inertial Sensor Data from Wearable Smart Devices using Neural Networks
TLDR
This study proposes a new method for generating high sampling rate signals from the low-sampled signals by upsampling theLow-Sampled signals using interpolation with an artificial neural network.
Continuous Measurement of Interactions with the Physical World with a Wrist-Worn Backscatter Reader
TLDR
WearID is a low-power wrist-worn backscatter reader that allows ubiquitous sensing of interaction with tagged objects, and is roughly 6× more power efficient than state-of-art commercial readers, provides 3D coverage of 30 to 50 cm around the wrist despite body blockage, and can be used to reliably detect hand-based interactions.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 71 REFERENCES
Serendipity: Finger Gesture Recognition using an Off-the-Shelf Smartwatch
TLDR
Serendipity is the first to explore the feasibility of using solely motion sensors on everyday wearable devices to detect fine-grained gestures, and has the potential to be applied to cross-device interactions, or as a tool for research in fields involving finger and hand motion.
WristFlex: low-power gesture input with wrist-worn pressure sensors
TLDR
Using an array of force sensitive resistors worn around the wrist, the interface can distinguish subtle finger pinch gestures with high accuracy (>80 %) and speed and it is demonstrated that the number of gestures can be extended with orientation data from an accelerometer.
Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch
TLDR
It is shown that motion energy measured at the smartwatch is sufficient to uniquely identify user's hand and finger gestures and will enable many novel applications like remote control and finger-writing-based input to devices using smartwatch.
Tomo: Wearable, Low-Cost Electrical Impedance Tomography for Hand Gesture Recognition
TLDR
Tomo, a wearable, low-cost system using Electrical Impedance Tomography (EIT) to recover the interior impedance geometry of a user's arm is presented, allowing hand gestures and direct touch manipulation to work synergistically to support interactive tasks on small screens.
Hambone: A Bio-Acoustic Gesture Interface
TLDR
Hambone is a lightweight, unobtrusive system that affords quick access, subtlety, and multitasking capabilities for gesture-based mobile device interaction and a discussion of future opportunities in bio-acoustic gesture- based interfaces.
A wearable system that knows who wears it
TLDR
This paper presents a wearable system that unobtrusively recognizes the person wearing it, and demonstrates that this system continues to recognize a subset of these subjects even several months later.
The sound of one hand: a wrist-mounted bio-acoustic fingertip gesture interface
TLDR
It is discovered that gentle fingertip gestures such as tapping, rubbing, and flicking make quiet sounds that travel by bone conduction throughout the hand, and this phenomenon is harnessed to build a wristband-mounted bio-acoustic fingertip gesture interface.
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers
TLDR
This work describes a method for the recognition of activities that are characterized by a hand motion and an accompanying sound using microphones and three-axis accelerometers mounted at two positions on the user's arms using on-body sensing.
OsteoConduct: wireless body-area communication based on bone conduction
TLDR
The experimental results demonstrate that mechanical stimuli can be reliably transmitted through the human musculoskeletal system with power consumption of multiple mW and show that excitations generated by human teeth clacks can be readily employed by users to interact with computers and body-area devices.
A Wearable Gesture Recognition Device for Detecting Muscular Activities Based on Air-Pressure Sensors
TLDR
A new method for recognizing the muscular activities is proposed based on air-pressure sensors and air-bladders that is useful for mobile devices due to its great signal-to-noise ratio (SNR) and fast response time.
...
1
2
3
4
5
...