StrikeAPose: revealing mid-air gestures on public displays

@article{Walter2013StrikeAPoseRM,
  title={StrikeAPose: revealing mid-air gestures on public displays},
  author={Robert Walter and Gilles Bailly and J{\"o}rg M{\"u}ller},
  journal={Proceedings of the SIGCHI Conference on Human Factors in Computing Systems},
  year={2013}
}
We investigate how to reveal an initial mid-air gesture on interactive public displays. [] Key Method Spatial division permanently shows the gesture on a dedicated screen area. Temporal division interrupts the application to reveal the gesture. Integration embeds gesture hints directly in the application. We also propose a novel initial gesture called Teapot to illustrate our strategies. We report on a laboratory and field study. Our main findings are: A large percentage of all users execute the gesture…

Figures from this paper

ShapelineGuide: Teaching Mid-Air Gestures for Large Interactive Displays
TLDR
Sh ShapelineGuide is presented, a dynamic visual guide that supports users of large interactive displays while performing mid-air gestures and helps users with regard to learning the gestures as well as decreases execution times and cognitive load.
Cuenesics: using mid-air gestures to select items on interactive public displays
TLDR
A design space for hand-gesture based mid-air selection techniques on interactive public displays is proposed, along with four specific techniques that were evaluated at three different locations in the the field.
Eliciting Mid-Air Gestures for Wall-Display Interaction
TLDR
A guessability study where 20 participants performed gestures for 25 actions on a three-meter wide display is presented and user-defined mid-air gestures for wall-display interaction are described and characterize the types of gesture users prefer for this context.
Towards Learnable Gestures for Exploring Hierarchical Information Spaces at a Large Public Display
TLDR
This work presents the design and evaluation of learnable gestures for exploring a hierarchical information space on a public display, and draws on a series of in-the-wild studies, observing how people learn 4 gestures combined with explanatory icons and a skeleton representation for feedback.
Gestu-Wan - An Intelligible Mid-Air Gesture Guidance System for Walk-up-and-Use Displays
TLDR
Gestu-Wan is presented, an intelligible gesture guidance system designed to support mid-air gesture-based interaction for walk-up-and-use displays and compared with a static gesture guide, which shows that it can help users with both performing complex gestures as well as understanding how the gesture recognizer works.
On Gesture Combination: An Exploration of a Solution to Augment Gesture Interaction
TLDR
This work proposes a design space to characterize the temporal and spatial combination aspects, and the gesture types used by the combination, and reports results from three user studies in the context of smart TV interaction.
MirrorTouch: combining touch and mid-air gestures for public displays
TLDR
It was found that clear affordances for touch were necessary when mid-air gestures were present and a call-to-action caused significantly more users to touch than a button, and small variations in the application did lead to considerable user increase.
Gesture Elicitation Study on How to Opt-in & Opt-out from Interactions with Public Displays
TLDR
This paper explores how people could use different kinds of gestures or voice commands to explicitly opt-in or opt-out of interactions with public installations, and shows overall preference for hand and arm gestures, and generally a higher acceptance for gestural interaction in the entertainment setting.
Information wall: evaluation of a gesture-controlled public display
TLDR
Information Wall is introduced, a gesture-controlled public information display that provides multi-user access to contextually relevant local information using remote pointing and mid-air gestures and is presented with practical guidelines for gesture- controlled public display design.
Exploring Cross-Modal Training via Touch to Learn a Mid-Air Marking Menu Gesture Set
TLDR
It is argued that cross-modal learning can be an effective mechanism for introducing users to mid-air gestural input, and it is shown that marking menu touch gestures transfer directly to knowledge of mid- air gestures, allowing performance of these gestures without intervention.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 45 REFERENCES
Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits
TLDR
The findings from a field study that was conducted at the Vancouver Aquarium to investigate how visitors interact with a large interactive table exhibit using multi-touch gestures show that gestures are not executed in isolation but linked into sequences where previous gestures influence the formation of subsequent gestures.
GestureBar: improving the approachability of gesture-based interfaces
TLDR
GestureBar is evaluated in a formal experiment showing that users can perform complex, ecologically valid tasks in a purely gestural system without training, introduction, or prior gesture experience when using GestureBar, discovering and learning a high percentage of the gestures needed to perform the tasks optimally, and significantly outperforming a state of the art crib sheet.
ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures
TLDR
ShadowGuides provides on-demand assistance to the user by combining visualizations of the user's current hand posture as interpreted by the system and available postures and completion paths necessary to finish the gesture (feedforward).
User-defined gestures for surface computing
TLDR
The findings indicate that users rarely care about the number of fingers they employ, that one hand is preferred to two, that desktop idioms strongly influence users' mental models, and that some commands elicit little gestural agreement, suggesting the need for on-screen widgets.
Comparing Free Hand Menu Techniques for Distant Displays Using Linear, Marking and Finger-Count Menus
TLDR
This paper presents the adaptation of three menu techniques for free hand interaction: Linear menu, Marking menu and Finger-Count menu, and shows that Finger- count requires more mental demand than other techniques.
Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces
TLDR
A set of bimanual continuous gestures that embody these principles are developed and explored within a prototype tabletop publishing application and carried out a user evaluation to assess the usability of these gestures and use the results and observations to suggest future design guidelines.
“Put-that-there”: Voice and gesture at the graphics interface
  • R. Bolt
  • Art, Computer Science
    SIGGRAPH '80
  • 1980
TLDR
The work described herein involves the user commanding simple shapes about a large-screen graphics display surface, and because voice can be augmented with simultaneous pointing, the free usage of pronouns becomes possible, with a corresponding gain in naturalness and economy of expression.
OctoPocus: a dynamic guide for learning gesture-based command sets
We describe OctoPocus, an example of a dynamic guide that combines on-screen feedforward and feedback to help users learn, execute and remember gesture sets. OctoPocus can be applied to a wide range
LightGuide: projected visualizations for hand movement guidance
TLDR
This work presents four novel interaction techniques that are focused on guiding a user's hand in mid-air and quantifies the performance of LightGuide in a user study comparing each of the on-body visualizations to hand animation videos on a computer display in both time and accuracy.
FizzyVis: designing for playful information browsing on a multitouch public display
TLDR
FizzyVis is a walk-up-and-use interface that displays information through bubbles reacting to touches, and its design goals are evaluated, supporting playful use through catching curiosity, projecting users in a playful state of mind, enabling easy and explorative information browsing, enticing playful gesturing and collective play, and rewarding finish.
...
1
2
3
4
5
...