VirBot: A Virtual Reality Robot Driven With Multimodal Commands


In this paper we show how symbolic Artiicial Intelligence (AI) techniques can be used to develop intelligent Virtual Reality (VR) environments. We have developed an expert system architecture for building intelligent agents that respond to voice and gesture commands in virtual environments. To demonstrate the utility of this we present a simple application that allows a user to drive a virtual robot (the VirBot) around a virtual environment with multimodal commands. This software agent is able to accept spoken commands from the user, interpret them using natural language understanding and interact with and modify the virtual environment. Command recognition is further improved by the use of contextual information. Context is encoded using scripts, making it easy to compose inferences about events for which there is incomplete or fuzzy information. This reduces command recognition error rates by 31%.

Cite this paper

@inproceedings{SavageCarmona2007VirBotAV, title={VirBot: A Virtual Reality Robot Driven With Multimodal Commands}, author={Jesus Savage-Carmona and Mark Billinghurst}, year={2007} }