• Corpus ID: 77394426

Building Real-World Chatbot Interviewers: Lessons from a Wizard-of-Oz Field Study

@inproceedings{Zhou2019BuildingRC,
  title={Building Real-World Chatbot Interviewers: Lessons from a Wizard-of-Oz Field Study},
  author={Michelle X. Zhou and Carolyn Wang and Gloria Mark and Huahai Yang and Kevin Xu},
  booktitle={IUI Workshops},
  year={2019}
}
We present a Wizard-of-Oz field study, where a humanassisted chatbot interviewed 53 actual job applicants each in a 30-minute, text-based conversation. A detailed analysis of the chat transcripts and user feedback revealed users’ likes and dislikes of the chatbot, as well as the patterns of their interaction with the chatbot. Our findings yield a set of practical design suggestions for building effective, realworld chatbot interviewers that appear intelligent with even limited NLP or… 
View Paper
research.ibm.com
5 Citations
Background Citations
1

5 Citations

Citation Type

Citation Type

Wizard-of-Oz Testing as an Instrument for Chatbot Development An experimental Pre-study for Setting up a Recruiting Chatbot Prototype
Chatbots can be utilized to automate various business processes to add value for companies and users – for example, in the form of efficiency enhancement. Throughout the process of chatbot…
Submitting surveys via a conversational interface: an evaluation of user acceptance and approach effectiveness
TLDR
It is shown that users clearly appreciate the Conversational form and prefer it over a traditional approach and that, from a data collection point of view, the conversational method shows the same reliability and a higher response quality with respect to a traditional questionnaire.
Preliminary Findings of using Chat-bots as a Course FAQ Tool
TLDR
The preliminary findings of an admin-updatable Dialogflow-based chat-bot deployed on an instant messaging platform (Telegram) to handle all course queries shows that chat-bots are a viable tool to disseminate information to students and it is possible to build such an agent with a limited set of question.
Conversational Interfaces for Explainable AI: A Human-Centred Approach
TLDR
Conversational Interfaces are proposed to be the perfect setting to enable the user to enquire information and explanation directly from an intelligent agent, and both requirements of users and obstacles in the implementation of protocols for interacting agents are disclosed.
A Psychologist Chatbot Developing Experience
TLDR
A quality of experience framework is applied to explore the factors that impact stakeholders and influence design priories and the conclusions regarding the leveraging cloud platforms and the technical customisation required for non-standard chatbot use cases are presented.

References

SHOWING 1-10 OF 25 REFERENCES
Confiding in and Listening to Virtual Agents: The Effect of Personality
TLDR
An intelligent virtual interviewer that engages with a user in a text-based conversation and automatically infers the user's psychological traits, such as personality, and develops two virtual interviewers with distinct personalities that are deployed in a real-world recruiting event.
Embodied Conversational Agent-Based Kiosk for Automated Interviewing
TLDR
An automated kiosk that uses embodied intelligent agents to interview individuals and detect changes in arousal, behavior, and cognitive effort by using psychophysiological information systems was created and smiling agents were perceived as more likable than neutral demeanor agents.
Revealing sensitive information in personal interviews: Is self-disclosure easier with humans or avatars and under what conditions?
TLDR
Results from an exploratory study designed to investigate topic sensitivity affects individuals' preference to disclose to a human or an ECA interviewer contribute to an understanding of when and why ECA interviewers can effectively replace human interviewers.
SimSensei kiosk: a virtual human interviewer for healthcare decision support
TLDR
SimSensei Kiosk is presented, an implemented virtual human interviewer designed to create an engaging face-to-face interaction where the user feels comfortable talking and sharing information and development of a fully automatic virtual interviewer able to engage users in 15-25 minute interactions.
Computers are social actors
TLDR
Five experiments provide evidence that individuals’ interactions with computers are fundamentally social, and show that social responses to computers are not the result of conscious beliefs that computers are human or human-like.
Active Listening in Peer Interviews: The Influence of Message Paraphrasing on Perceptions of Listening Skill
Perhaps no communication skill is identified as regularly as active listening in training programs across a variety of disciplines and activities. Yet little empirical research has examined specific…
It's only a computer: Virtual humans increase willingness to disclose
TLDR
It is suggested that automated VHs can help overcome a significant barrier to obtaining truthful patient information and be rated by observers as more willing to disclose.
Personalization in HRI: A longitudinal field experiment
TLDR
The results show that, as compared with the social service alone, adding personalized service improved rapport, cooperation, and engagement with the robot during service encounters.
KnowMe and ShareMe: understanding automatically discovered personality traits from social media and user sharing preferences
TLDR
The findings show there is a potential feasibility of automatically deriving one's personality traits from social media with various factors impacting the accuracy of models, and their implications for designing a new generation of privacy-preserving, hyper-personalized systems.
The effect of interviewer experience, attitudes, personality and skills on respondent co-operation with face-to-face surveys
This paper examines the role of interviewers' experience, attitudes, personality traits and inter-personal skills in determining survey co-operation, conditional on contact. We take the perspective…
...
1
2
3
...