Implementation of a Speech Enabled Virtual Reality Training Tool for Human-Robot Interaction

Hudson, C. R., Bethel, C. L., Carruth, D. W., Pleva, M., Ondas, S., & Juhar, J. (2018). Implementation of a Speech Enabled Virtual Reality Training Tool for Human-Robot Interaction. 2018 World Symposium on Digital Intelligence for Systems and Machines (DISA). Košice, Slovakia: IEEE. DOI:10.1109/DISA.2018.8490615.

This paper presents the outline and implementation of a virtual reality-based training tool for interacting with the Julius Open-Source Voice Recognition Software. This implementation builds on our previously designed tool for training police officers the command words associated with an integration of Julius with a robotic system with which they trained. By expanding the design into virtual reality, it was possible to increase realism of training as well as rapidly prototype and test new interfaces to support individuals' interactions with the voice recognition system. A simulated wearable display was provided to allow officers to look up the commands they needed and to provide feedback on what the voice recognition system detected. Additional functionality was incorporated to support new interaction methods such as push to talk and push to confirm.