CUI@CHI 2024: Building Trust in CUIs - From Design to Deployment

chatbots; conversational agents; conversational AI; conversational user interfaces; reliance; trust; voice assistants; Chatbots; Conversational agents; Conversational AI; Conversational user interface; Human-computer interaction researches; Language model; Reliance; Trust; Users' experiences; Voice assistant; Human-Computer Interaction; Computer Graphics and Computer-Aided Design; Software; Computer Science - Human-Computer Interaction

Abstract :

[en] Conversational user interfaces (CUIs) have become an everyday technology for people the world over, as well as a booming area of research. Advances in voice synthesis and the emergence of chatbots powered by large language models (LLMs), notably ChatGPT, have pushed CUIs to the forefront of human-computer interaction (HCI) research and practice. Now that these technologies enable an elemental level of usability and user experience (UX), we must turn our attention to higher-order human factors: trust and reliance. In this workshop, we aim to bring together a multidisciplinary group of researchers and practitioners invested in the next phase of CUI design. Through keynotes, presentations, and breakout sessions, we will share our knowledge, identify cutting-edge resources, and fortify an international network of CUI scholars. In particular, we will engage with the complexity of trust and reliance as attitudes and behaviours that emerge when people interact with conversational agents.

Disciplines :

Computer science

Author, co-author :

Desai, Smit ; University of Illinois at Urbana-Champaign, Urbana-Champaign, United States

Wei, Christina Ziying ; University of Toronto, Toronto, Canada

Sin, Jaisie ; University of British Columbia, Toronto, Canada

DUBIEL, Mateusz ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

Zargham, Nima ; Digital Media Lab, University of Bremen, Bremen, Germany

Ahire, Shashank ; Leibniz University Hannover, Hannover, Germany

Porcheron, Martin ; Bold Insight, London, United Kingdom

Kuzminykh, Anastasia ; University of Toronto, Toronto, Canada

Lee, Minha ; Eindhoven University of Technology, Eindhoven, Netherlands

Candello, Heloisa ; IBM Research, São Paulo, Brazil

More authors (3 more)

External co-authors :

yes

Language :

English

Title :

CUI@CHI 2024: Building Trust in CUIs - From Design to Deployment

Publication date :

11 May 2024

Event name :

Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Event place :

Hybrid, Honolulu, Usa

Event date :

11-05-2024 => 16-05-2024

Audience :

International

Main work title :

CHI 2024 - Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Sytems

Publisher :

Association for Computing Machinery

ISBN/EAN :

9798400703317

Peer reviewed :

Peer reviewed

Additional URL :

https://dl.acm.org/doi/pdf/10.1145/3613905.3636287

Available on ORBilu :

since 17 April 2025

Statistics

Number of views

77 (5 by Unilu)

Number of downloads

24 (0 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

WoS citations^™

Bibliography

Shashank Ahire. 2023. Designing a Smart Speaker for Emergent Users: Human Plus AI Response. In Proceedings of the 13th Indian Conference on Human- Computer Interaction (Hyderabad, India) (IndiaHCI '22). Association for Computing Machinery, New York, NY, USA, 67-72. https://doi.org/10.1145/3570211. 3570217
Shashank Ahire, Michael Rohs, and Simon Benjamin. 2022. Ubiquitous Work Assistant: Synchronizing a Stationary and a Wearable Conversational Agent to Assist KnowledgeWork. In Proceedings of the 1st Annual Meeting of the Symposium on Human-Computer Interaction for Work (Durham, NH, USA) (CHIWORK '22). Association for Computing Machinery, New York, NY, USA, Article 3, 9 pages. https://doi.org/10.1145/3533406.3533420
Vino Avanesi, Johanna Rockstroh, Thomas Mildner, Nima Zargham, Leon Reicherts, Maximilian A. Friehs, Dimosthenis Kontogiorgos, NinaWenig, and Rainer Malaka. 2023. From C-3PO to HAL: Opening The Discourse About The Dark Side of Multi-Modal Social Agents. In Proceedings of the 5th International Conference on Conversational User Interfaces (Eindhoven, Netherlands) (CUI '23). Association for Computing Machinery, New York, NY, USA, Article 62, 7 pages. https://doi.org/10.1145/3571884.3597441
Tita Alissa Bach, Amna Khan, Harry Hallock, Gabriela Beltrão, and Sonia Sousa. 2022. A Systematic Literature Review of User Trust in AI-Enabled Systems: An HCI Perspective. International Journal of Human-Computer Interaction 0, 0 (2022), 1-16. https://doi.org/10.1080/10447318.2022.2138826
Mehrdad Bahrini, Nima Zargham, Johannes Pfau, Stella Lemke, Karsten Sohr, and Rainer Malaka. 2020. Good vs. Evil: Investigating the Effect of Game Premise in a Smart Home Security Educational Game. In Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play (Virtual Event, Canada) (CHI PLAY '20). Association for Computing Machinery, New York, NY, USA, 182-187. https://doi.org/10.1145/3383668.3419887
Mehrdad Bahrini, Nima Zargham, AlexanderWolff, Dennis-Kenji Kipker, Karsten Sohr, and Rainer Malaka. 2022. It's Long and Complicated! Enhancing One-Pager Privacy Policies in Smart Home Applications. In Nordic Human-Computer Interaction Conference (Aarhus, Denmark) (NordiCHI '22). Association for Computing Machinery, New York, NY, USA, Article 73, 13 pages. https://doi.org/10.1145/3546155.3546657
Michael Bonfert, Nima Zargham, Florian Saade, Robert Porzel, and Rainer Malaka. 2021. An Evaluation of Visual Embodiment for Voice Assistants on Smart Displays. In CUI 2021-3rd Conference on Conversational User Interfaces. ACM, New York, NY, USA, 1-11.
Andriana Boudouraki, Joel E Fischer, Stuart Reeves, and Sean Rintel. 2023. " Being in on the Action" in Mobile Robotic Telepresence: Rethinking Presence in Hybrid Participation. In Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. 63-71.
Eugene Cho. 2019. Hey Google, Can I Ask You Something in Private?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 258:1-258:9. https://doi.org/10.1145/3290605.3300488 event-place: Glasgow, Scotland Uk.
Minji Cho, Sang-su Lee, and Kun-Pyo Lee. 2019. Once a Kind Friend is Now a Thing: Understanding How Conversational Agents at Home are Forgotten. In Proceedings of the 2019 on Designing Interactive Systems Conference (DIS '19). Association for Computing Machinery, New York, NY, USA, 1557-1569. https://doi.org/10.1145/3322276.3322332
Leigh Clark, Nadia Pantidi, Orla Cooney, Philip Doyle, Diego Garaialde, Justin Edwards, Brendan Spillane, Emer Gilmartin, Christine Murad, Cosmin Munteanu, et al. 2019. What makes a good conversation? Challenges in designing truly conversational agents. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1-12.
Benjamin R. Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. "What can i help you with?": Infrequent users' experiences of intelligent personal assistants. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). Association for Computing Machinery, New York, NY, USA, 1-12. https://doi.org/10.1145/3098279.3098539
Smit Desai and Jessie Chin. 2023. OK Google, Let's Learn: Using Voice User Interfaces for Informal Self-Regulated Learning of Health Topics among Younger and Older Adults. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 847, 21 pages. https://doi.org/10.1145/3544548.3581507
Smit Desai, Morgan Lundy, and Jessie Chin. 2023. "A Painless Way to Learn:" Designing an Interactive Storytelling Voice User Interface to Engage Older Adults in Informal Health Information Learning. In Proceedings of the 5th International Conference on Conversational User Interfaces (Eindhoven, Netherlands) (CUI '23). Association for Computing Machinery, New York, NY, USA, Article 5, 16 pages. https://doi.org/10.1145/3571884.3597141
Smit Desai, Tanusree Sharma, and Pratyasha Saha. 2023. Using ChatGPT in HCI Research-A Trioethnography. In Proceedings of the 5th International Conference on Conversational User Interfaces. 1-6.
Smit Desai and Michael Twidale. 2022. Is Alexa like a computer? A search engine? A friend? A silly child? Yes. In Proceedings of the 4th Conference on Conversational User Interfaces (CUI '22). Association for Computing Machinery, New York, NY, USA, 1-4. https://doi.org/10.1145/3543829.3544535
Smit Desai and Michael Twidale. 2023. Metaphors in Voice User Interfaces: A Slippery Fish. ACM Trans. Comput.-Hum. Interact. 30, 6, Article 89, 37 pages. https://doi.org/10.1145/3609326
Mateusz Dubiel, Alessandra Cervone, and Giuseppe Riccardi. 2019. Inquisitive mind: A conversational news companion. In Proceedings of the 1st International Conference on Conversational User Interfaces. 1-3.
Mateusz Dubiel, Sylvain Daronnat, and Luis A. Leiva. 2022. Conversational Agents Trust Calibration: A User-Centred Perspective to Design. In Proceedings of the 4th Conference on Conversational User Interfaces (CUI '22). Association for Computing Machinery, New York, NY, USA, 1-6. https://doi.org/10.1145/3543829.3544518
Mateusz Dubiel, Martin Halvey, Pilar Oplustil Gallegos, and Simon King. 2020. Persuasive synthetic speech: Voice perception and user behaviour. In Proceedings of the 2nd Conference on Conversational User Interfaces. 1-9.
Justin Edwards and Elaheh Sanoubari. 2019. A need for trust in conversational interface research. In Proceedings of the 1st International Conference on Conversational User Interfaces (CUI '19). Association for Computing Machinery, New York, NY, USA, 1-3. https://doi.org/10.1145/3342775.3342809
Dimosthenis Kontogiorgos, Andre Pereira, Olle Andersson, Marco Koivisto, Elena Gonzalez Rabal, Ville Vartiainen, and Joakim Gustafson. 2019. The Effects of Anthropomorphism and Non-Verbal Social Behaviour in Virtual Assistants. In Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents (IVA '19). Association for Computing Machinery, New York, NY, USA, 133-140. https://doi.org/10.1145/3308532.3329466 event-place: Paris, France.
Anastasia Kuzminykh, Jenny Sun, Nivetha Govindaraju, Jeff Avery, and Edward Lank. 2020. Genie in the Bottle: Anthropomorphized Perceptions of Conversational Agents. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1-13. https://doi.org/10.1145/3313831.3376665
Effie Lai-Chong Law, Asbjørn Følstad, Jonathan Grudin, and Björn Schuller. 2022. Conversational Agent as Trustworthy Autonomous System (Trust-CA)(Dagstuhl Seminar 21381). In Dagstuhl Reports, Vol. 11. Schloss Dagstuhl-Leibniz-Zentrum für Informatik.
John D. Lee and Katrina A. See. 2004. Trust in automation: Designing for appropriate reliance. Human Factors 46, 1 (2004), 50-80. https://doi.org/10.1518/hfes. 46.1.50-30392
Minha Lee, Lily Frank, Yvonne De Kort, and Wijnand IJsselsteijn. 2022. Where is Vincent? Expanding our emotional selves with AI. In Proceedings of the 4th Conference on Conversational User Interfaces (CUI '22). Association for Computing Machinery, New York, NY, USA, 1-11. https://doi.org/10.1145/3543829.3543835
Minha Lee, Lily Frank, and Wijnand IJsselsteijn. 2021. Brokerbot: A cryptocurrency chatbot in the social-technical gap of trust. Computer Supported Cooperative Work (CSCW) 30, 1 (2021), 79-117.
Q. Vera Liao and Jennifer Wortman Vaughan. 2023. AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap. arXiv:2306.01941 (Aug. 2023). https://doi.org/10.48550/arXiv.2306.01941 arXiv:2306.01941 [cs].
Ewa Luger and Abigail Sellen. 2016. "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 5286-5297. https://doi.org/10.1145/2858036.2858288
Donald McMillan, Razan Jaber, Benjamin R. Cowan, Joel E. Fischer, Bahar Irfan, Ronald Cumbal, Nima Zargham, and Minha Lee. 2023. Human-Robot Conversational Interaction (HRCI). In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (Stockholm, Sweden) (HRI '23). Association for Computing Machinery, New York, NY, USA, 923-925. https://doi.org/10.1145/3568294.3579954
Bonnie M Muir. 1987. Trust between humans and machines, and the design of decision aids. International journal of man-machine studies 27, 5-6 (1987), 527-539.
Chinasa T. Okolo, Srujana Kamath, Nicola Dell, and Aditya Vashistha. 2021. "It cannot do all of my work": Community Health Worker Perceptions of AIEnabled Mobile Health Applications in Rural India. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, 1-20. https://doi.org/10.1145/3411764.3445420
Claudio S. Pinhanez. 2021. Expose Uncertainty, Instill Distrust, Avoid Explanations: Towards Ethical Guidelines for AI. arXiv:2112.01281 (Nov. 2021). https://doi.org/10.48550/arXiv.2112.01281 arXiv:2112.01281 [cs].
Alisha Pradhan, Leah Findlater, and Amanda Lazar. 2019. "Phantom Friend" or "Just a Box with Information": Personification and Ontological Categorization of Smart Speaker-based Voice Assistants by Older Adults. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 214:1-214:21. https://doi.org/10.1145/3359316
Alisha Pradhan, Amanda Lazar, and Leah Findlater. 2020. Use of intelligent voice assistants by older adults with low technology use. ACM Transactions on Computer-Human Interaction (TOCHI) 27, 4 (2020), 1-27.
Minjin Rheu, Ji Youn Shin, Wei Peng, and Jina Huh-Yoo. 2021. Systematic Review: Trust-Building Factors and Implications for Conversational Agent Design. International Journal of Human-Computer Interaction 37, 1 (Jan. 2021), 81-96. https://doi.org/10.1080/10447318.2020.1807710
Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I. Hong. 2018. "Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 857-868. https://doi.org/10.1145/3196709.3196772 00000 event-place: Hong Kong, China.
Jaisie Sin, Cosmin Munteanu, Numrita Ramanand, and Yi Rong Tan. 2021. VUI influencers: How the media portrays voice user interfaces for older adults. In Proceedings of the 3rd Conference on Conversational User Interfaces. 1-13.
Linda J Skitka, Kathleen L Mosier, and Mark Burdick. 1999. Does automation bias decision-making? International Journal of Human-Computer Studies 51, 5 (1999), 991-1006.
Clara Strathmann, Jessica Szczuka, and Nicole Krämer. 2020. She Talks to Me as If She Were Alive: Assessing the Social Reactions and Perceptions of Children toward Voice Assistants and Their Appraisal of the Appropriateness of These Reactions. In Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (IVA '20). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3383652.3423906 event-place: Virtual Event, Scotland, UK.
Matthias Söllner, Axel Hoffmann, and Jan Marco Leimeister. 2016. Why different trust relationships matter for information systems users. European Journal of Information Systems 25, 3 (May 2016), 274-287. https://doi.org/10.1057/ejis.2015. 17
Takane Ueno, Yuto Sawa, Yeongdae Kim, Jacqueline Urakami, Hiroki Oura, and Katie Seaborn. 2022. Trust in Human-AI Interaction: Scoping Out Models, Measures, and Methods. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA '22). Association for Computing Machinery, New York, NY, USA, 1-7. https://doi.org/10.1145/3491101.3519772
Christina Ziying Wei, Young-Ho Kim, and Anastasia Kuzminykh. 2023. The Bot on Speaking Terms: The Effects of Conversation Architecture on Perceptions of Conversational Agents. In Proceedings of the 5th International Conference on Conversational User Interfaces (CUI '23). Association for Computing Machinery, New York, NY, USA, 1-16. https://doi.org/10.1145/3571884.3597139
Katharina Weitz, Dominik Schiller, Ruben Schlagowski, Tobias Huber, and Elisabeth André. 2019. "Do you trust me?": Increasing User-Trust by Integrating Virtual Agents in Explainable AI Interaction Design. In Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents (IVA '19). Association for Computing Machinery, New York, NY, USA, 7-9. https://doi.org/10.1145/3308532.3329441
Katharina Weitz, Dominik Schiller, Ruben Schlagowski, Tobias Huber, and Elisabeth André. 2021. "Let me explain!": Exploring the potential of virtual agents in explainable AI interaction design. Journal on Multimodal User Interfaces 15, 2 (June 2021), 87-98. https://doi.org/10.1007/s12193-020-00332-0
Nima Zargham, Michael Bonfert, Robert Porzel, Tanja Doring, and Rainer Malaka. 2021. Multi-Agent Voice Assistants: An Investigation Of User Experience. In 20th International Conference on Mobile and Ubiquitous Multimedia (Leuven, Belgium) (MUM 2021). Association for Computing Machinery, New York, NY, USA, 98-107. https://doi.org/10.1145/3490632.3490662
Nima Zargham, Leon Reicherts, Michael Bonfert, Sarah Theres Voelkel, Johannes Schoening, Rainer Malaka, and Yvonne Rogers. 2022. Understanding Circumstances for Desirable Proactive Behaviour of Voice Assistants: The Proactivity Dilemma. In Proceedings of the 4th Conference on Conversational User Interfaces (Glasgow, United Kingdom) (CUI '22). Association for Computing Machinery, New York, NY, USA, Article 3, 14 pages. https://doi.org/10.1145/3543829.3543834