Firmata is a generic protocol for communicating with mi-crocontrollers from software on a host computer. The central goal is to make the microcontroller an extension of the programming environment on the host computer in a manner that feels natural in that programming environment. It was designed to be open and flexible so that any programming environment… (More)
Mapping has been discussed for decades, yet there is not standard catalog of mapping methods. The Mapping Library for Pd is a fledgling library of mapping primitives with the aim of cataloging existing mapping methods. Also included are techniques for conditioning sensor data to make it usable in the context of instrument design.
The music community has long had a strong interest in hap-tic technology. Recently, more effort has been put into making it more and more accessible to instrument designers. This paper covers some of these technologies with the aim of helping instrument designers add haptic feedback to their instruments. We begin by giving a brief overview of practical… (More)
In this paper we discuss our progress on the HID toolkit, a collection of software modules for the Pure Data and Max/MSP programming environments that provide unified, user-friendly and cross-platform access to human interface devices (HIDs) such as joysticks, digitizer tablets, and stomp-pads. These HIDs are ubiquitous, inexpensive and capable of sensing a… (More)
The [hid] toolkit is a set of software objects for designing gestural instruments. All too frequently, computer performers are tied to the keyboard/mouse/monitor model, narrowly constraining the range of possible gestures. A multitude of off-the-shelf input devices are readily available, making it easy to utilize a broader range of gestures. Human Interface… (More)
StickMusic is an instrument comprised of two haptic devices, a joystick and a mouse, which control a phase vocoder in real time. The purpose is to experiment with ideas of how to apply haptic feedback when controlling synthesis algorithms that have no direct analogy to methods of generating sound in the physical world.
Computer music performance environments have evolved greatly in recent years, allowing complex control and interaction with sound in real time. But the interaction has too frequently been tied to the keyboard-mouse-monitor model, narrowly constraining the range of possible gestures the performer can use. The range of human interface devices has also greatly… (More)
We report on the development and initial experiences with Moveable Type, an art installation in the ground-floor lobby of the recently completed New York Times Building in New York City. Physically, the piece is divided into two large display grids suspended along both sides of the building's main lobby facing Eighth Avenue. Each grid is comprised of 280… (More)