Learn More
The Human Speechome Project is an effort to observe and computationally model the longitudinal course of language development of a single child at an unprecedented scale. The idea is this: Instrument a child’s home so that nearly everything the child hears and sees from birth to three is recorded. Develop a computational model of language learning that(More)
A number of recent theories of semantic representation propose two-way interaction of semantic and perceptual information. These theories are supported by a growing body of experiments that show widespread interactivity of semantic and perceptual levels of processing. In the current experiment, participants classified ambiguous colors into one of two color(More)
This paper describes a robotic puppeteering system used in a theatrical production involving one robot and two human performers on stage. We draw from acting theory and human-robot interaction to develop a hybrid-control puppeteering interface which combines reactive expressive gestures and parametric behaviors with a point-of-view eye contact module. Our(More)
We introduce a system for visualizing, annotating, and analyzing very large collections of longitudinal audio and video recordings. The system, TotalRecall, is designed to address the requirements of projects like the Human Speechome Project, for which more than 100,000 hours of multitrack audio and video have been collected over a twentytwo month period.(More)
The use of natural language should be added to a robot system without sacrificing responsiveness to the environment. In this paper, we present a robot that manipulates objects on a tabletop in response to verbal interaction. Reactivity is maintained by using concurrent interaction processes, such as visual trackers and collision detection processes. The(More)
A synchrotron radiation source emits coherent infrared (IR) radiation when the electron bunch length is comparable to the wavelength of the emitted radiation (see for example [1, 2]). To generate coherent radiation in the far IR (THz) region, a ’low alpha mode’ has been devised at the ANKA storage ring operating at 1.3 GeV. The corresponding(More)
HouseFly is an interactive data browsing and visualization system that synthesizes audio-visual recordings from multiple sensors, as well as the meta-data derived from those recordings, into a unified viewing experience. The system is being applied to study human behavior in both domestic and retail situations grounded in longitudinal video recordings.(More)
We introduce an approach for physically-grounded natural language interpretation by robots which reacts appropriately to unanticipated physical changes in the environment and dynamically assimilates new information pertinent to ongoing tasks. At the core of the approach is a model of object schemas that enables a robot to encode beliefs about physical(More)