Backchannel opportunity prediction for social robot listeners

  title={Backchannel opportunity prediction for social robot listeners},
  author={Hae Won Park and Mirko Gelsomini and Jin Joo Lee and Tonghui Zhu and Cynthia Breazeal},
  journal={2017 IEEE International Conference on Robotics and Automation (ICRA)},
This paper investigates how a robot that can produce contingent listener response, i.e., backchannel, can deeply engage children as a storyteller. We propose a backchannel opportunity prediction (BOP) model trained from a dataset of children's dyad storytelling and listening activities. Using this dataset, we gain better understanding of what speaker cues children can decode to find backchannel timing, and what type of nonverbal behaviors they produce to indicate engagement status as a listener… Expand
A Model-Free Affective Reinforcement Learning Approach to Personalization of an Autonomous Social Robot Companion for Early Literacy Education
An affective reinforcement learning approach to train a personalized policy for each student during an educational activity where a child and a robot tell stories to each other is proposed, which successfully personalized to each child to boost their engagement and outcomes. Expand
Child–Robot Relationship Formation: A Narrative Review of Empirical Research
This narrative review aimed to elucidate which robot-related characteristics predict relationship formation between typically-developing children and social robots in terms of closeness and trust.Expand
Automatic Detection of Backchannels in Russian Dialogue Speech
This paper deals with acoustic properties of backchannels – those turns within a dialogue which do not convey information but signify that the speaker is listening to his/her interlocutor (uh-huh, hmExpand
Autonomy, social agency, and the integration of human and robot environments
There is a growing wave of new autonomous robots poised for use in human environments, from the self-driving car to the delivery drone. By leaving the confinement of factories and warehouses for cityExpand
After You: Doorway Negotiation for Human-Robot and Robot-Robot Interaction
  • Jack Thomas, R. Vaughan
  • Computer Science
  • 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  • 2018
This work proposes and test an autonomous robot behavior for socially-compliant navigation of doorways with both human and robot interlocutors, and demonstrates an “assertive” robot that negotiates right-of-way when faced with a human or other robot. Expand


Telling Stories to Robots: The Effect of Backchanneling on a Child's Storytelling *
A backchannel prediction model based on observed nonverbal behaviors of 4–6 year-old children, which produces contingent backchannel responses that conveys an increased perception of an attentive listener, and children prefer telling stories to the BOP model robot. Expand
A probabilistic multimodal approach for predicting listener backchannels
This paper shows how sequential probabilistic models can automatically learn from a database of human-to-human interactions to predict listener backchannels using the speaker multimodal output features (e.g., prosody, spoken words and eye gaze). Expand
Crowdsourcing Backchannel Feedback : Understanding the Individual Variability from the Crowds
A data collection framework known as Parasocial Consensus Sampling (PCS) is explored to examine and characterize some of individual variability in backchannel feedback and indicates that common personality traits can capture much of this variability. Expand
Can Children Catch Curiosity from a Social Robot?
It is shown that some of the child’s curiosity measures are significantly higher after interacting with a curious robot, compared to a non-curious one, while others do not. Expand
Storytelling with robots : effects of robot language level on children's language learning
Examination of the potential of a sociable robotic learning/teaching companion in supplementing children's early language education found that children in the adaptive condition maintained or increased the amount and diversity of the language they used during interactions with the robot. Expand
Prosodic features which cue back-channel responses in English and Japanese
Back-channel feedback, responses such as uh-uh from a listener, is a pervasive feature of conversation. It has long been thought that the production of back-channel feedback depends to a large extentExpand
A conversational robot with vocal and bodily fillers for recovering from awkward silence at turn-takings
The results of this study show that people feel awkward during silences, even when in conversation with a robot, and that the robot's conversational fillers help mitigate awkwardness and express a cooperative attitude in verbal interactions with people. Expand
Personalizing Robot Tutors to Individuals’ Learning Differences
Although the robot’s personalizations were less sophisticated than what a human tutor can do, the results are presented as evidence that even relatively simple personalizations can yield significant benefits in educational or assistive human-robot interactions. Expand
Recognizing engagement in human-robot interaction
An initial computational model for recognizing engagement between a human and a humanoid robot is developed and implemented and packaged as a node in the open-source Robot Operating System (ROS) framework. Expand
Acquisition of back channel listener responses to adequate messages
Back channel listener responses could be among the last conversational skills acquired. Listener responses (i.e., headnods, umhums) were observed in 36 normal children (12 each at ages 7.5, 9.5, andExpand