Learn More
An interactive environment has been developed that uses a pair of Doppler radars to measure upper-body kinematics (velocity, direction of motion, amount of motion) and a grid of piezoelectric wires hidden under a 6 x 10 foot carpet to monitor dynamic foot position and pressure. This system has been used in an audio installation, where users launch and(More)
To build robots that engage in fluid face-to-face spoken conversations with people, robots must have ways to connect what they say to what they see. A critical aspect of how language connects to vision is that language encodes points of view. The meaning of my left and your left differs due to an implied shift of visual perspective. The connection of(More)
As an outgrowth of our interest in dense wireless sensing and expressive applications of wearable computing, we have developed the world's most versatile human-computer interface for the foot. By dense wireless sensing, we mean the remote acquisition of many different parameters with a compact, autonomous sensor cluster. We have developed such a low-power(More)
Lifton This paper describes four different systems that we have developed for capturing various manners of gesture near interactive surfaces. The first is a low-cost scanning laser rangefinder adapted to accurately track the position of bare hands in a plane just above a large projection display. The second is an acoustic system that detects the position of(More)
We introduce an approach for physically-grounded natural language interpretation by robots which reacts appropriately to unanticipated physical changes in the environment and dynamically assimilates new information pertinent to ongoing tasks. At the core of the approach is a model of object schemas that enables a robot to encode beliefs about physical(More)
— Human cognition makes extensive use of visu-alization and imagination. As a first step towards giving a robot similar abilities, we have built a robotic system that uses a perceptually-coupled physical simulator to produce an internal world model of the robot's environment. Real-time perceptual coupling ensures that the model is constantly kept in(More)
We have developed a passive tag reader optimized for applications in human-computer interaction. It sweeps through a 50-300 kHz read frequency, flagging any magnetically-coupled resonators in that range. It is a minimally-complicated circuit, and is able to provide the center frequency, resonance width, and amplitude for each detected tag over a serial line(More)
We describe a new kind of musical interface based on magnetic tagging technology that can turn essentially any object into a continuous controller with both contact and noncontact degrees of freedom. Our system responds to magnetically-coupled resonant tags (simple inductor/capacitor combinations or magnetostrictor strips) that are within range of the(More)