• Publications
  • Influence
Policy Shaping: Integrating Human Feedback with Reinforcement Learning
TLDR
A long term goal of Interactive Reinforcement Learning is to incorporate nonexpert human feedback to solve complex tasks. Expand
  • 222
  • 34
  • PDF
Teachable robots: Understanding human teaching behavior to build more effective robot learners
TLDR
This paper presents a series of five experiments analyzing the scenario of a human teaching a virtual robot to perform a novel task within a reinforcementbased learning framework. Expand
  • 330
  • 31
  • PDF
Effects of nonverbal communication on efficiency and robustness in human-robot teamwork
TLDR
Nonverbal communication plays an important role in coordinating teammates' actions for collaborative activities. Expand
  • 467
  • 23
  • PDF
Reinforcement Learning with Human Teachers: Evidence of Feedback and Guidance with Implications for Learning Performance
TLDR
We present findings from a human user study showing that people use the reward signal not only to provide feedback about past actions, but also to provide future directed rewards to guide subsequent actions. Expand
  • 237
  • 19
  • PDF
Trajectories and keyframes for kinesthetic teaching: A human-robot interaction perspective
TLDR
Kinesthetic teaching is an approach to providing demonstrations to a robot in Learning from Demonstration whereby a human physically guides a robot to perform a skill. Expand
  • 202
  • 12
  • PDF
Designing robot learners that ask good questions
  • M. Cakmak, A. Thomaz
  • Computer Science
  • 7th ACM/IEEE International Conference on Human…
  • 5 March 2012
TLDR
We identify three types of questions (label, demonstration and feature queries) and discuss how a robot can use these while learning new skills. Expand
  • 190
  • 11
  • PDF
Cheese: tracking mouse movement activity on websites, a tool for user modeling
TLDR
We have developed a straightforward way to record all mouse movements on a page, and conducted a user study to analyze and investigate mouse behavior trends. Expand
  • 177
  • 9
  • PDF
Tutelage and socially guided robot learning
  • A. Thomaz, C. Breazeal
  • Computer Science
  • IEEE/RSJ International Conference on Intelligent…
  • 28 September 2004
TLDR
We view the problem of machine learning as a collaboration between the human and the machine. Expand
  • 164
  • 9
  • PDF
Teaching and working with robots as a collaboration
TLDR
We use collaborative discourse with accompanying gestures and social cues to teach a humanoid robot a structurally complex task. Expand
  • 168
  • 8
  • PDF
Keyframe-based Learning from Demonstration
TLDR
We present a framework for learning skills from novel types of demonstrations that consist of keyframes; a sparse set of points in the state space that produces the intended skill when visited in sequence. Expand
  • 160
  • 7
  • PDF
...
1
2
3
4
5
...