ControllAR: Appropriation of Visual Feedback on Control Surfaces

  title={ControllAR: Appropriation of Visual Feedback on Control Surfaces},
  author={Florent Berthaut and Alex Jones},
  journal={Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces},
  • Florent Berthaut, Alex Jones
  • Published 2016
  • Computer Science, Engineering
  • Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces
Despite the development of touchscreens, many expert systems for working with digital multimedia content, such as in music composition and performance, video editing or visual performance, still rely on control surfaces. This can be due to the accuracy and appropriateness of their sensors, the haptic feedback that they offer, and most importantly the way they can be adapted to the specific subset of gestures and tasks that users need to perform. On the other hand, visual feedback on controllers… Expand
Revgest: augmenting gestural musical instruments with revealed virtual objects
A novel approach of visual feedback that allow for additional expressiveness, second a software pipeline for pixel-level feedback and control that ensures tight coupling between sound and visuals, and third, a design space for extending gestural control using revealed interfaces. Expand
PrintARface: Supporting the Exploration of Cyber-Physical Systems through Augmented Reality
This paper designed, implemented and evaluated a prototype called PrintARface, that extends a physical 3D printer by incorporating virtual components, and reflects upon the evaluation of the prototype provide insights that foster the development of hardware-related appropriation support by encompassing augmented reality-based human–machine interfaces. Expand
bf-pd: Enabling Mediated Communication and Cooperation in Improvised Digital Orchestras
Bf-pd is a new software library built in the PureData (Pd) language which enables communication and cooperation between digital instruments and provides a “collaboration window” from which musicians can easily view each others’ activity and share control of instrument parameters and other musical data. Expand


iVoLVER: Interactive Visual Language for Visualization Extraction and Reconstruction
The design and implementation of iVoLVER is presented, a tool that allows users to create visualizations without textual programming and demonstrates the flexibility and expressive power of the tool through a set of scenarios. Expand
Exposing the scaffolding of digital instruments with hardware-software feedback loops
A new approach to digital instrument design which lets the performer alter and subvert the instrument's internal operation through circuit-bending techniques, which uses low-latency feedback loops between software and analog hardware to expose the internal working of the instrument. Expand
Through the combining glass
This paper explores the potential of optical combiners to merge the space in front and behind them, presents this design space, identifies novel augmentations/interaction opportunities and explores the design space using three prototypes. Expand
Transmogrification: causal manipulation of visualizations
A transmogrifier is a novel interface that enables quick, on-the-fly graphic transformations, opening the door to alternative ways of exploring and displaying existing visualizations, and enabling free-form prototyping of new visualizations. Expand
DiskPlay: in-track navigation on turntables
In a observational study with four professional DJs, participants valued the co-location of visual feedback with the control vinyl on the turntable as the most important cue for in-track navigation. Expand
Evaluating the benefits of real-time feedback in mobile augmented reality with hand-held devices
This work adds real-time feedback to the AR overlay to show significant benefits for mobile AR with feedback and reveals some problems with the other techniques. Expand
In-track navigation on turntables
  • Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12
  • 2012
Toucheo: multitouch and stereo combined in a seamless workspace
A new system that efficiently combines direct multitouch interaction with co-located 3D stereoscopic visualization, and a rich and unified workspace where users benefit simultaneously from the advantages of both direct and indirect interaction, and from 2D and 3D visualizations is proposed. Expand
Beyond performance: Feature awareness in personalized interfaces
A design space of personalized interfaces is outlined and several factors that could affect the tradeoff between core task performance and awareness are presented, which provide a set of design implications that should be considered for personalized interfaces. Expand
Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure
This work presents Prefab, a system for implementing advanced behaviors through the reverse engineering of the pixels in graphical interfaces,formed by how user interface toolkits paint interfaces, which features a separation of the modeling of widget layout from the recognition of widget appearance. Expand