Your noise is my command: sensing gestures using the body as an antenna

@article{Cohn2011YourNI,
  title={Your noise is my command: sensing gestures using the body as an antenna},
  author={Gabe Cohn and Dan Morris and Shwetak N. Patel and Desney S. Tan},
  journal={Proceedings of the SIGCHI Conference on Human Factors in Computing Systems},
  year={2011}
}
Touch sensing and computer vision have made human-computer interaction possible in environments where keyboards, mice, or other handheld implements are not available or desirable. However, the high cost of instrumenting environments limits the ubiquity of these technologies, particularly in home scenarios where cost constraints dominate installation decisions. Fortunately, home environments frequently offer a signal that is unique to locations and objects within the home: electromagnetic noise… 

Figures from this paper

Smart environments without cameras : Electrical Field Sensing for Human-Computer Interaction Ubiquitous Computing
TLDR
This work will highlight some disadvantages of computer vision systems for gesture recognition, give an overview of the state of the art in electric field sensing for Human-Computer Interaction and introduce different methods for capturing gestures with electric fields by evaluating the robustness of these methods.
Ready, Steady, Touch!
TLDR
The feasibility to detect contact between the finger and static objects is demonstrated, and a single nail-mounted IMU on the index finger provides sufficient data to train a binary touch status classifier with an accuracy above 95%, generalised across users.
Humantenna: using the body as an antenna for real-time whole-body interaction
TLDR
This paper uses the human body as an antenna for sensing whole-body gestures and shows robust gesture recognition with an average accuracy of 93% across 12 whole- body gestures, and promising results for robust location classification within a building.
SideSwipe: detecting in-air gestures around mobile devices using actual GSM signal
TLDR
SideSwipe is introduced, a novel system that enables in-air gestures both above and around a mobile device that leverages the actual GSM signal to detect hand gestures around the device.
AtaTouch: Robust Finger Pinch Detection for a VR Controller Using RF Return Loss
TLDR
AtaTouch is a novel, robust sensing technique for detecting the closure of a finger pinch that utilizes a change in the coupled impedance of an antenna and human fingers when the thumb and finger form a loop.
i-me TOUCH: detecting human touch interaction
i-me TOUCH is able to detect when one human touches another. By observing the different patterns of conductivity between two humans, the system is also able to record touch gestures such as tapping
LightWave: using compact fluorescent lights as sensors
TLDR
LightWave, a sensing approach that turns ordinary compact fluorescent light bulbs into sensors of human proximity, is described and it is shown that CFLs can function as more general-purpose sensors for distributed human motion detection and ambient temperature sensing.
Magic finger: always-available input through finger instrumentation
TLDR
A small device worn on the fingertip, which supports always-available input that senses touch through an optical mouse sensor and senses texture through a micro RGB camera, allowing contextual actions to be carried out based on the particular surface being touched.
Electrick: Low-Cost Touch Sensing Using Electric Field Tomography
TLDR
It is shown that Electrick can enable new interactive opportunities on a diverse set of objects and surfaces that were previously static, and is compatible with commonplace manufacturing methods, such as spray/brush coating, vacuum forming, and casting/molding enabling a wide range of possible uses and outputs.
Emerging Input Technologies for Always-Available Mobile Interaction
TLDR
It is asserted that this could have the same magnitude of impact that mobile computing had on enabling tasks that were not possible with traditional desktop computers, and the properties of sensors and input systems that may enable this shift to always-available computing are surveyed.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 24 REFERENCES
“Body coupled FingerRing”: wireless wearable keyboard
TLDR
A really wearable input device “FingeRing” is developed for coming wearable PDAs, and a new symbol coding method that combines order and chord typing is proposed, and useful typing patterns are chosen by typing speed evaluations.
Enabling always-available input with muscle-computer interfaces
TLDR
This work presents a system that classifies finger gestures on a physical surface in real-time and introduces a bi-manual paradigm that enables use in interactive systems and shows generalizability across different arm postures.
Skinput: appropriating the body as an input surface
We present Skinput, a technology that appropriates the human body for acoustic transmission, allowing the skin to be used as an input surface. In particular, we resolve the location of finger taps on
Applying electric field sensing to human-computer interfaces
TLDR
A non-contact sensor based on the interaction of a person with electric fields for human-computer interface is investigated and empirical and analytical approaches to transform sensor measurements into position information are discussed.
DiamondTouch: a multi-user touch technology
TLDR
A technique for creating a touch-sensitive input device which allows multiple, simultaneous users to interact in an intuitive fashion and results obtained with a small prototype device are presented.
Personal Area Networks: Near-Field Intrabody Communication
TLDR
The concept of Personal Area Networks (PANs) is presented to demonstrate how electronic devices on and near the human body can exchange digital information by capacitively coupling picoamp currents through the body.
At the Flick of a Switch: Detecting and Classifying Unique Electrical Events on the Residential Power Line (Nominated for the Best Paper Award)
TLDR
This work uses machine learning techniques to recognize electrically noisy events such as turning on or off a particular light switch, a television set, or an electric stove and indicates that the system can learn and classify various electrical events with accuracies ranging from 85-90%.
ElectriSense: single-point sensing using EMI for electrical event detection and classification in the home
TLDR
This paper's results show that ElectriSense can identify and classify the usage of individual devices with a mean accuracy of 93.82% and shows both analytically and by in-home experimentation that EMI signals are stable and predictable based on the device's switching frequency characteristics.
PL-Tags: Detecting Batteryless Tags through the Power Lines in a Building
TLDR
It is contended that the PL-Tag system is another class of potential batteryfree approaches researchers can use for building pervasive computing applications that require minimal additional infrastructure.
SNUPI: sensor nodes utilizing powerline infrastructure
TLDR
This work explores the use of the home powerline as a large distributed antenna capable of receiving signals from ultra-low-power wireless sensor nodes and thus allowing nodes to be detected at ranges that are otherwise impractical with traditional over-the-air reception.
...
1
2
3
...