Reference : Combining Virtual and Robot Assistants - A Case Study about Integrating Amazon's Alex...
Scientific congresses, symposiums and conference proceedings : Paper published in a book
Engineering, computing & technology : Mechanical engineering
Combining Virtual and Robot Assistants - A Case Study about Integrating Amazon's Alexa as a Voice Interface in Robotics
Jungbluth, Jan mailto [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > >]
Krieger, Rolf mailto []
Gerke, Wolfgang mailto []
Plapper, Peter mailto [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Engineering Research Unit >]
Robotix-Academy Conference for Industrial Robotics (RACIR) 2018
Müller, Rainer
Plapper, Peter mailto
Brüls, Oliver
Gerke, Wolfgang
Abba, Gabriel
Vette-Steinkamp, Mattihas
Robotics-Academy Conference for Industrial Robotics 2018
from 04-06-2018 to 05-06-2018
University of Luxembourg
[en] Virtual Assistant ; Robot Assistant ; Voice-Interface
[en] Virtual assistants such as Alexa, Siri, Cortana and Google Assistant increasingly find ways to enter our homes and everyday lives, where they serve as powerful human-machine interfaces to control devices through natural language. In this work, we explore the use of virtual assistants to control single components within an intelligent industrial robot assistant system for disassembly applications. Following a short introduction and an overview of commercially available virtual assistants, we present our system architecture, which integrates Amazon's Alexa through an Echo Dot device. Utilizing the Alexa Skill Kit, we build a voice user interface that contains dialogs to control various device functions and assistive system behaviors. By connecting Alexa Voice Service with Amazon’s Lambda and IoT web services, we can parametrize machine commands depending on the user's voice input and, through a Raspberry Pi, which routes messages between the internet and decoupled machine network, send them to the devices within the intelligent robot assistance system. With the reversed communication flow, we can update and store the current state of the devices in the Amazon Web Services IoT Shadow. Utilizing the IoT Shadow, we are able to inform the user upon request about the current state of the devices by synthesize speech with the Alexa Voice Services and vocalize it through the Echo Dot. One implemented assistive system behavior and the related dialog to activate the behavior is further explained in this work. In the conclusion, we address our gathered positive and negative experience to date.

File(s) associated to this reference

Fulltext file(s):

Open access
RACIR CR Combining Virtual and Robot Assistants.pdfAuthor preprint784.41 kBView/Open

Additional material(s):

File Commentary Size Access
Open access
Alexa-Sprachsteuerung_02.mp4312.77 MBView/Open

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.