Deep Learning and Bayesian Networks for Labelling User Activity Context Through Acoustic Signals
English
Rodriguez Lera, Francisco Javier[University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)]
Biomedical Applications Based on Natural and Artificial Computing: International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2017, Corunna, Spain, June 19-23, 2017, Proceedings, Part II
Ferrández Vicente, José Manuel
Álvarez-Sánchez, José Ramón
de la Paz López, Félix
Toledo Moreo, Javier
Adeli, Hojjat
Springer International Publishing
213--222
Yes
978-3-319-59773-7
Cham
International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2017
June 19-23, 2017
A Coruña
Spain
[en] Context awareness in autonomous robots is usually performed combining localization information, objects identification, human interaction and time of the day. We think that gathering environmental sounds we can improve context recognition. With that purpose, we have designed, developed and tested an Environment Recognition Component (ERC) that provides an extra input to our Context-Awareness Component (CAC) and increases the rate of labeling correctly users' activities. First element, the Environment Recognition Component (ERC) uses convolutional neural networks to classify acoustic signals and providing information to the Context-Awareness Component (CAC) which infers the user activity using a hierarchical Bayesian network. The work described in this paper evaluates the results of the labeling process in two HRI scenarios: robot and user sharing room and robot, and when the human and the robot are in different rooms. The results showed better accuracy when the ERC uses acoustic signals.
[University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)]
