Chatbots; Conversational agents; Dialogue systems; Emojis; Health and wellbeing; Information tracking.; Information tracking; Wellbeing; Software; Human-Computer Interaction; Computer Vision and Pattern Recognition; Computer Networks and Communications
Abstract :
[en] The recent rise of conversational interfaces have made it possible to integrate this technology into various domains, among which is health. Dialogue systems and conversational agents can bring a lot into healthcare to reduce cost, increase efficiency and provide continuing care, albeit its infancy and complexity about building natural dialogues. However, the design guidelines to design dialogues for conversational agents are usually based on common knowledge, and less frequently on empirical evidence. For example, the use of emojis in conversational agent dialogues is still a debated issue, and the added value of adding such graphical elements is mainly anecdotal. In this work, we present an empirical study comparing users feedback when interacting with chatbot applications that use different dialogue styles, i.e., plain text or text with emoji, when asking different health related questions. The analysis found that when participants had to score an interaction with a chatbot that asks personal questions on their mental wellbeing, they rated the interaction with higher scores with respect to enjoyment, attitude and confidence. Differently, participants rated with lower scores a chatbot that uses emojis when asking information on their physical wellbeing compared to a dialogue with plain text. We believe this work can contribute to the research on integrating conversational agents in the health and wellbeing context and can serve as a guidance in the design and development of interfaces for text-based dialogue systems.
Disciplines :
Computer science
Author, co-author :
Fadhil, Ahmed; ICT4G, Fondazione Bruno Kessler (FBK), Trento, Italy
Schiavo, Gianluca; I3, Fondazione Bruno Kessler (FBK), Trento, Italy
Wang, Yunlong; HCI Group, University of Konstanz, Konstanz, Germany
YILMA, Bereket Abera ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS) ; Luxembourg Institute of Science and Technology, Luxembourg City, Luxembourg, Luxembourg
External co-authors :
yes
Language :
English
Title :
The effect of emojis when interacting with conversational interface assisted health coaching system
Original title :
[en] The effect of emojis when interacting with conversational interface assisted health coaching system
Publication date :
21 May 2018
Event name :
Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare
Event place :
New York, Usa
Event date :
21-05-2018 => 24-05-2018
By request :
Yes
Audience :
International
Main work title :
Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare, PervasiveHealth 2018
Hadeel Al-Zubaide and Ayman A Issa. 2011. Ontbot: Ontology based chatbot. In Innovation in Information & Communication Technology (ISIICT), 2011 Fourth International Symposium on. IEEE, 7-12.
Timothy Armstrong and Fiona Bull. 2006. Development of the World Health Organization Global Physical Activity Questionnaire (GPAQ). Journal of Public Health 14, 2 (2006), 66-70. https://doi.org/10.1007/s10389-006-0024-x
Rik Crutzen, Gjalt-Jorn Y Peters, Sarah Dias Portugal, Erwin M Fisser, and Jorne J Grolleman. 2011. An artificially intelligent chat agent that answers adolescents' questions related to sex, drugs, and alcohol: an exploratory study. Journal of Adolescent Health 48, 5 (2011), 514-519.
Ahmed Fadhil. 2018. Beyond Patient Monitoring: Conversational Agents Role in Telemedicine & Healthcare Support For Home-Living Elderly Individuals. arXiv preprint arXiv:1803.06000 (2018).
Ahmed Fadhil. 2018. Can a Chatbot Determine My Diet?: Addressing Challenges of Chatbot Application for Meal Recommendation. arXiv preprint arXiv:1802.09100 (2018).
Ahmed Fadhil and Silvia Gabrielli. 2017. Addressing challenges in promoting healthy lifestyles: the al-chatbot approach. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare. ACM, 261-265.
Kathleen Kara Fitzpatrick, Alison Darcy, and Molly Vierhile. 2017. Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial. JMIR Mental Health 4, 2 (2017), e19.
Arthur C Graesser, Kurt VanLehn, Carolyn P Rosé, Pamela W Jordan, and Derek Harter. 2001. Intelligent tutoring systems with conversational dialogue. AI magazine 22, 4 (2001), 39.
Susan Herring and Ashley Dainas. 2017. "Nice Picture Comment" Graphicons in Facebook Comment Threads. In Proceedings of the 50th Hawaii International Conference on System Sciences (2017). 2185-2194.
Jennifer Hill, W Randolph Ford, and Ingrid G Farreras. 2015. Real conversations with artificial intelligence: A comparison between human-human online conversations and human-chatbot conversations. Computers in Human Behavior 49 (2015), 245-250.
Alexander Hogenboom, Daniella Bal, Flavius Frasincar, Malissa Bal, Franciska de Jong, and Uzay Kaymak. 2013. Exploiting emoticons in sentiment analysis. In Proceedings of the 28th Annual ACM Symposium on Applied Computing. ACM, 703-710.
Jiyou Jia. 2003. The study of the application of a keywords-based chatbot system on the teaching of foreign languages. arXiv preprint cs/0310018 (2003).
Clare-Marie Karat, John Vergo, and David Nahamoo. 2002. Conversational interface technologies. In The human-computer interaction handbook. L. Erlbaum Associates Inc., 169-186.
Ryan Kelly and Leon Watts. 2015. Characterising the inventive appropriation of emoji as relationally meaningful in mediated close personal relationships. Experiences of Technology Appropriation: Unanticipated Users, Usage, Circumstances, and Design (2015).
Lorenz Cuno Klopfenstein, Saverio Delpriori, Silvia Malatini, and Alessandro Bogliolo. 2017. The Rise of Bots: A Survey of Conversational Interfaces, Patterns, and Paradigms. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 555-565.
Abbas Saliimi Lokman and Jasni Mohamad Zain. 2010. One-match and all-match categories for keywords matching in chatbot. American Journal of Applied Sciences 7, 10 (2010), 1406-1411.
Rosemarijn Looije, Mark A Neerincx, and Vincent de Lange. 2008. Children's responses and opinion on three bots that motivate, educate and play. Journal of Physical Agents 2, 2 (2008), 13-20.
Xuan Lu, Wei Ai, Xuanzhe Liu, Qian Li, Ning Wang, Gang Huang, and Qiaozhu Mei. 2016. Learning from the ubiquitous language: an empirical analysis of emoji usage of smartphone users. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 770-780.
Roger C Mayer, James H Davis, and F David Schoorman. 1995. An integrative model of organizational trust. Academy of management review 20, 3 (1995), 709-734.
Henning Pohl, Christian Domin, and Michael Rohs. 2017. Beyond Just Text: Semantic Emoji Similarity Modeling to Support Expressive Communication. ACM Trans. Comput.-Hum. Interact. 24, 1, Article 6 (March 2017), 42 pages. https: //doi.org/10.1145/3039685
Matthias Romppel, Elmar Braehler, Marcus Roth, and Heide Glaesmer. 2013. What is the General Health Questionnaire-12 assessing? Comprehensive Psychiatry 54, 4 (2013), 406-413. https://doi.org/10.1016/j.comppsych.2012.10.010
Iulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C Courville, and Joelle Pineau. 2016. Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models.. In AAAI. 3776-3784.
Bayan Abu Shawar and Eric Atwell. 2003. Using dialogue corpora to train a chatbot. In Proceedings of the Corpus Linguistics 2003 conference. 681-690.
Bayan Abu Shawar and Eric Atwell. 2007. Chatbots: are they really useful?. In LDV Forum, Vol. 22. 29-49.
Marcin Skowron, Mathias Theunis, Stefan Rank, and Arvid Kappas. 2013. Affect and Social Processes in Online Communication-Experiments with an Affective Dialog System. IEEE Transactions on Affective Computing 4, 3 (2013), 267-279. https://doi.org/10.1109/T-AFFC.2013.16
Lawrence R Wheeless and Jams Grotz. 1976. Conceptualization and measurement of reported self-disclosure. Human Communication Research 2, 4 (1976), 338-346.
Ruobing Xie, Zhiyuan Liu, Rui Yan, and Maosong Sun. 2016. Neural Emoji Recommendation in Dialogue Systems. arXiv preprint arXiv:1612.04609 (2016).
Rui Zhou, Jasmine Hentschel, and Neha Kumar. 2017. Goodbye Text, Hello Emoji: Mobile Communication on WeChat in China. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 748-759.