Learn More
In this paper, we describe CogSketch, an open-domain sketch understanding system built on the nuSketch architecture. CogSketch captures the multi-modal, unconstrained nature of sketching by focusing on reasoning over recognition. We describe this approach, as well as two application domains for CogSketch: cognitive modeling, and education.
Sketching is a powerful means of working out and communicating ideas. Sketch understanding involves a combination of visual, spatial, and conceptual knowledge and reasoning, which makes it both challenging to model and potentially illuminating for cognitive science. This paper describes CogSketch, an ongoing effort of the NSF-funded Spatial Intelligence and(More)
This paper shows how a software toolkit can allow graphic designers to make camera-based interactive environments in a short period of time without experience in user interface design or machine vision. The Attention Meter, a vision-based input toolkit, gives users an analysis of faces found in a given image stream, including facial expression, body motion,(More)
This paper shows how a software toolkit enables graphic designers to make camera-based interactive environments in a short period of time without requiring experience in user interface design or machine vision. The Attentive Interaction Design Toolkit, a vision-based input toolkit, gives users an analysis of faces found in a given image stream, including(More)
Spatial reasoning plays a critical role in STEM problem solving. Physics assessments, for example, are rich in diagrams and pictures, which help people understand concrete physical scenarios and abstract aspects of physical reasoning. In this paper we describe a system that analyzes sketched diagrams to solve qualitative physics problems from a popular(More)
We have become accustomed to a digital desktop that is customizable and anticipates our needs. What if our physical work surfaces could interact with us in the same way? We have recently completed a working prototype of a work surface that automatically adjusts to individual users and anticipates their needs. The work surface is a large sink and counter(More)
  • Jon Wetzel, Aq, Kurt Vanlehn, Pradeep Chaudhari, Avaneesh Desai, Jingxian Feng +7 others
  • 2016
This paper describes Dragoon, a simple intelligent tutoring system which teaches the construction of models of dynamic systems. Modeling is one of eight practices dictated in two new sets of educational standards in the USA, and Dragoon is one of the first systems for teaching model construction for dynamic systems. Dragoon can be classified as a step-based(More)