Designing AI Personalities: Enhancing Human-Agent Interaction Through Thoughtful Persona Design

Zargham, Nima; DUBIEL, Mateusz; Desai, Smit; Mildner, Thomas; Belz, Hanz-Joachim

doi:10.1145/3701571.3701608

Download

Paper published in a book (Scientific congresses, symposiums and conference proceedings)

Designing AI Personalities: Enhancing Human-Agent Interaction Through Thoughtful Persona Design

Zargham, Nima; DUBIEL, Mateusz; Desai, Smit et al.

2024 • In Matviienko, Andrii (Ed.) Proceedings of MUM 2024 the 23rd International Conference on Mobile and Ubiquitous Multimedia

Peer reviewed

Permalink
https://hdl.handle.net/10993/67447

DOI
10.1145/3701571.3701608

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

MUM_24.pdf

Author postprint (708.1 kB)

Download

All documents in ORBilu are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

AI Agents; Conversational Agents; conversational user interfaces; Personas; Speech Interfaces; Artificial intelligence agent; Conversational agents; Conversational user interface; Educational tools; Human-agent interaction; Persona; Research communities; Smart homes; Speech interface; Users' experiences; Human-Computer Interaction; Computer Networks and Communications; Computer Vision and Pattern Recognition; Software

Abstract :

[en] In the rapidly evolving field of artificial intelligence (AI) agents, designing the agent's characteristics is crucial for shaping user experience. This workshop aims to establish a research community focused on AI agent persona design for various contexts, such as in-car assistants, educational tools, and smart home environments. We will explore critical aspects of persona design, such as voice, embodiment, and demographics, and their impact on user satisfaction and engagement. Through discussions and hands-on activities, we aim to propose practices and standards that enhance the ecological validity of agent personas. Topics include the design of conversational interfaces, the influence of agent personas on user experience, and approaches for creating contextually appropriate AI agents. This workshop will provide a platform for building a community dedicated to developing AI agent personas that better fit diverse, everyday interactions.

Disciplines :

Computer science

Author, co-author :

Zargham, Nima ; Digital Media Lab, University of Bremen, Bremen, Germany

DUBIEL, Mateusz ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

Desai, Smit; Northeastern University

Mildner, Thomas; University of Bremen > Digital Media Lab

Belz, Hanz-Joachim

External co-authors :

yes

Language :

English

Title :

Designing AI Personalities: Enhancing Human-Agent Interaction Through Thoughtful Persona Design

Publication date :

01 December 2024

Event name :

ACM Mobile and Ubiquitous Multimedia 2024

Event place :

Stockholm, Sweden

Event date :

01-12-2024 => 04-12-2024

Audience :

International

Main work title :

Proceedings of MUM 2024 the 23rd International Conference on Mobile and Ubiquitous Multimedia

Editor :

Matviienko, Andrii

Publisher :

Association for Computing Machinery

ISBN/EAN :

9798400712838

Peer reviewed :

Peer reviewed

Additional URL :

https://dl.acm.org/doi/10.1145/3701571.3701608

European Projects :

HE - 101071147 - SYMBIOTIK - Context-aware adaptive visualizations for critical decision making
H2020 - 951846 - MUHAI - Meaning and Understanding in Human-centric AI

Funders :

Horizon 2020 FET program of the European Union
European Innovation Council Pathfinder program
European Union

Funding text :

This work was partially funded by Klaus Tschira Foundation, the FET-Open Project 951846 "MUHAI - Meaning and Understanding for Human-centric AI funded by the EU program Horizon 2020, as well as the German Research Foundation DFG as part of Collaborative Research Center (Sonderforschungsbereich) 1320 "EASE - Everyday Activity Science and Engineering", University of Bremen (http://www.ease-crc.org/). This work is in part supported by European Innovation Council Pathfinder program (SYMBIOTIK project, grant 101071147).

Available on ORBilu :

since 25 January 2026

Statistics

Number of views

4 (0 by Unilu)

Number of downloads

0 (0 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

WoS citations^™

Bibliography

Fraser Allison, Marcus Carter, Martin Gibbs, and Wally Smith. 2018. Design Patterns for Voice Interaction in Games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY'18). Association for Computing Machinery, New York, NY, USA, 5-17. https://doi.org/10.1145/3242671.3242712
Vino Avanesi, Johanna Rockstroh, Thomas Mildner, Nima Zargham, Leon Reicherts, Maximilian A. Friehs, Dimosthenis Kontogiorgos, NinaWenig, and Rainer Malaka. 2023. From C-3PO to HAL: Opening The Discourse About The Dark Side of Multi-Modal Social Agents. In Proceedings of the 5th International Conference on Conversational User Interfaces (Eindhoven, Netherlands) (CUI'23). Association for Computing Machinery, New York, NY, USA, Article 62, 7 pages. https://doi.org/10.1145/3571884.3597441
Michael Bonfert, Nima Zargham, Florian Saade, Robert Porzel, and Rainer Malaka. 2021. An Evaluation of Visual Embodiment for Voice Assistants on Smart Displays. In CUI 2021-3rd Conference on Conversational User Interfaces. ACM, New York, NY, USA, 1-11.
Leigh Clark, Philip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlögl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, Justin Edwards, et al. 2019. The state of speech in HCI: Trends, themes and challenges. Interacting with computers 31, 4 (2019), 349-371.
Smit Desai and Jessie Chin. 2021. Hey Google, Can You Help Me Learn?. In Proceedings of the 3rd Conference on Conversational User Interfaces (Bilbao (online), Spain) (CUI'21). Association for Computing Machinery, New York, NY, USA, Article 6, 4 pages. https://doi.org/10.1145/3469595.3469601
Smit Desai and Jessie Chin. 2023. OK Google, Let's Learn: Using Voice User Interfaces for Informal Self-Regulated Learning of Health Topics among Younger and Older Adults. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI'23). Association for Computing Machinery, New York, NY, USA, Article 847, 21 pages. https://doi.org/10.1145/ 3544548.3581507
Smit Desai, Mateusz Dubiel, and Luis A. Leiva. 2024. Examining Humanness as a Metaphor to Design Voice User Interfaces. In Proceedings of the 6th ACM Conference on Conversational User Interfaces (CUI'24). Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/3640794.3665535
Smit Desai and Michael Twidale. 2022. Is Alexa like a computer? A search engine? A friend? A silly child? Yes.. In Proceedings of the 4th Conference on Conversational User Interfaces (Glasgow, United Kingdom) (CUI'22). Association for Computing Machinery, New York, NY, USA, Article 21, 4 pages. https: //doi.org/10.1145/3543829.3544535
Smit Desai and Michael Twidale. 2023. Metaphors in Voice User Interfaces: A Slippery Fish. ACM Transactions on Computer-Human Interaction 30, 6 (Sept. 2023), 89:1-89:37. https://doi.org/10.1145/3609326
Smit Desai, Christina Ziying Wei, Jaisie Sin, Mateusz Dubiel, Nima Zargham, Shashank Ahire, Martin Porcheron, Anastasia Kuzminykh, Minha Lee, Heloisa Candello, Joel E Fischer, Cosmin Munteanu, and Benjamin R. Cowan. 2024. CUI@CHI 2024: Building Trust in CUIs-From Design to Deployment. In Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (CHI EA'24). Association for Computing Machinery, New York, NY, USA, Article 460, 7 pages. https://doi.org/10.1145/3613905.3636287
Philip R. Doyle, Justin Edwards, Odile Dumbleton, Leigh Clark, and Benjamin R. Cowan. 2019. Mapping Perceptions of Humanness in Intelligent Personal Assistant Interaction. In Proceedings of the 21st International Conference on Human- Computer Interaction with Mobile Devices and Services (Taipei, Taiwan) (Mobile- HCI'19). Association for Computing Machinery, New York, NY, USA, Article 5, 12 pages. https://doi.org/10.1145/3338286.3340116
Mateusz Dubiel. 2018. Towards Human-Like Conversational Search Systems. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (New Brunswick, NJ, USA) (CHIIR'18). Association for Computing Machinery, New York, NY, USA, 348-350. https://doi.org/10.1145/3176349.3176360
Mateusz Dubiel, Alessandra Cervone, and Giuseppe Riccardi. 2019. Inquisitive mind: a conversational news companion. In Proceedings of the 1st International Conference on Conversational User Interfaces (Dublin, Ireland) (CUI'19). Association for Computing Machinery, New York, NY, USA, Article 6, 3 pages. https://doi.org/10.1145/3342775.3342802
Mateusz Dubiel, Sylvain Daronnat, and Luis A. Leiva. 2022. Conversational Agents Trust Calibration: A User-Centred Perspective to Design. In Proceedings of the 4th Conference on Conversational User Interfaces (Glasgow, United Kingdom) (CUI'22). Association for Computing Machinery, New York, NY, USA, Article 30, 6 pages. https://doi.org/10.1145/3543829.3544518
Mateusz Dubiel, Smit Desai, Nima Zargham, and Anuschka Schmitt. 2024. Voicecraft: Designing Task-specific Voice Assistant Personas. In Proceedings of the 6th ACM Conference on Conversational User Interfaces (Luxembourg, Luxembourg) (CUI'24). Association for Computing Machinery, New York, NY, USA, Article 66, 3 pages. https://doi.org/10.1145/3640794.3670000
Mateusz Dubiel, Martin Halvey, Pilar Oplustil Gallegos, and Simon King. 2020. Persuasive Synthetic Speech: Voice Perception and User Behaviour. In Proceedings of the 2nd Conference on Conversational User Interfaces (Bilbao, Spain) (CUI'20). Association for Computing Machinery, New York, NY, USA, Article 6, 9 pages. https://doi.org/10.1145/3405755.3406120
Mateusz Dubiel, Luis A. Leiva, Kerstin Bongard-Blanchy, and Anastasia Sergeeva. 2024. "Hey Genie, You Got Me Thinking About My Menu Choices!": Impact of Proactive Feedback on User Perception and Reflection in Decision-making Tasks. https://doi.org/10.1145/3685274 Just Accepted.
Colin M. Gray, Johanna T. Gunawan, René Schäfer, Nataliia Bielova, Lorena Sanchez Chamorro, Katie Seaborn, Thomas Mildner, and Hauke Sandhaus. 2024. Mobilizing Research and Regulatory Action on Dark Patterns and Deceptive Design Practices. In Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (CHI EA'24). Association for Computing Machinery, NewYork, NY, USA, Article 482, 6 pages. https://doi.org/10.1145/3613905.3636310
Colin M. Gray, Cristiana Teixeira Santos, Nataliia Bielova, and Thomas Mildner. 2024. An Ontology of Dark Patterns Knowledge: Foundations, Definitions, and a Pathway for Shared Knowledge-Building. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1-22. https: //doi.org/10.1145/3613904.3642436
Angel Hsing-Chi Hwang, John Oliver Siy, Renee Shelby, and Alison Lentz. 2024. In Whose Voice?: Examining AI Agent Representation of People in Social Interaction through Generative Speech. In Proceedings of the 2024 ACM Designing Interactive Systems Conference (Copenhagen, Denmark) (DIS'24). Association for Computing Machinery, New York, NY, USA, 224-245. https: //doi.org/10.1145/3643834.3661555
Martin Jentsch, Maresa Biermann, and Evelyn Schweiger. 2019. Talking to Stupid?!? Improving Voice User Interfaces. In Mensch und Computer 2019 - Usability Professionals. Gesellschaft für Informatik e.V. Und German UPA e.V., Bonn.
Rabia Khan and Antonella De Angeli. 2009. The attractiveness stereotype in the evaluation of embodied conversational agents. In IFIP Conference on Human- Computer Interaction. Springer, Springer, Heidelberg, Germany, 85-97.
Irene Lopatovska, Katrina Rink, Ian Knight, Kieran Raines, Kevin Cosenza, Harriet Williams, Perachya Sorsche, David Hirsch, Qi Li, and Adrianna Martinez. 2019. Talk to me: Exploring user interactions with the Amazon Alexa. Journal of Librarianship and Information Science 51, 4 (2019), 984-997. https://doi.org/10. 1177/0961000618759414 arXiv:https://doi.org/10.1177/0961000618759414
Ewa Luger and Abigail Sellen. 2016. "Like Having a Really Bad PA": The Gulf Between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI'16). ACM, New York, NY, USA, 5286-5297. https://doi.org/10.1145/2858036.2858288
Donald McMillan, Razan Jaber, Benjamin R. Cowan, Joel E. Fischer, Bahar Irfan, Ronald Cumbal, Nima Zargham, and Minha Lee. 2023. Human-Robot Conversational Interaction (HRCI). In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (Stockholm, Sweden) (HRI'23). Association for Computing Machinery, New York, NY, USA, 923-925. https://doi.org/10.1145/3568294.3579954
Meta. 2023. Introducing New AI Experiences Across Our Family of Apps and Devices. https://about.fb.com/news/2023/09/introducing-ai-powered-assistantscharacters- and-creative-tools/
Thomas Mildner, Orla Cooney, Anna-Maria Meck, Marion Bartl, Gian-Luca Savino, Philip R Doyle, Diego Garaialde, Leigh Clark, John Sloan, Nina Wenig, Rainer Malaka, and Jasmin Niess. 2024. Listening to the Voices: Describing Ethical Caveats of Conversational User Interfaces According to Experts and Frequent Users. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1-18. https://doi.org/10.1145/3613904.3642542
Thomas Mildner, Philip Doyle, Gian-Luca Savino, and Rainer Malaka. 2022. Rules Of Engagement: Levelling Up To Combat Unethical CUI Design. In 4th Conference on Conversational User Interfaces. ACM, Glasgow United Kingdom, 1-5. https: //doi.org/10.1145/3543829.3544528
Robert J. Moore and Raphael Arar. 2019. Conversational UX Design: A Practitioner's Guide to the Natural Conversation Framework. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3304087
Nasim Motalebi, Eugene Cho, S. Shyam Sundar, and Saeed Abdullah. 2019. Can Alexa be your Therapist? How Back-Channeling Transforms Smart-Speakers to be Active Listeners. In Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing (Austin, TX, USA) (CSCW'19 Companion). Association for Computing Machinery, New York, NY, USA, 309-313. https://doi.org/10.1145/3311957.3359502
Christine Murad and Cosmin Munteanu. 2019. "I Don't Know What You're Talking about, HALexa": The Case for Voice User Interface Guidelines. In Proceedings of the 1st International Conference on Conversational User Interfaces (Dublin, Ireland) (CUI'19). Association for Computing Machinery, New York, NY, USA, Article 9, 3 pages. https://doi.org/10.1145/3342775.3342795
Leon Reicherts, Nima Zargham, Michael Bonfert, Yvonne Rogers, and Rainer Malaka. 2021. May I Interrupt? Diverging Opinions On Proactive Smart Speakers. In Proceedings of the 3rd Conference on Conversational User Interfaces (Bilbao (online), Spain) (CUI'21). Association for Computing Machinery, New York, NY, USA, Article 34, 10 pages. https://doi.org/10.1145/3469595.3469629
Jingqing Ruan, Yihong Chen, Bin Zhang, Zhiwei Xu, Tianpeng Bao, Guoqing Du, Shiwei Shi, Hangyu Mao, Xingyu Zeng, and Rui Zhao. 2023. TPTU: Task Planning and Tool Usage of Large Language Model-based AI Agents., arXiv-2308 pages. https://openreview.net/forum?id=GrkgKtOjaH
Anuschka Schmitt, Naim Zierau, Andreas Janson, and Jan Marco Leimeister. 2021. Voice as a contemporary frontier of interaction design.
Milka Trajkova and Aqueasha Martin-Hammond. 2020. "Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo. Association for Computing Machinery, New York, NY, USA, 1-13. https://doi.org/10.1145/ 3313831.3376760
IsaacWang and J. Ruiz. 2021. Examining the Use of Nonverbal Communication in Virtual Agents. International Journal of Human-Computer Interaction 37 (2021), 1648-1673. https://doi.org/10.1080/10447318.2021.1898851
Beste F. Yuksel, Penny Collisson, and Mary Czerwinski. 2017. Brains or Beauty: How to Engender Trust in User-Agent Interactions. ACM Trans. Internet Technol. 17, 1, Article 2 (Jan. 2017), 20 pages. https://doi.org/10.1145/2998572
Nima Zargham. 2024. Expanding Speech Interaction for Domestic Activities. Ph.D. Dissertation. University of Bremen.
Nima Zargham, Dmitry Alexandrovsky, Jan Erich, Nina Wenig, and Rainer Malaka. 2022. "I Want It That Way": Exploring Users' Customization and Personalization Preferences for Home Assistants. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA'22). Association for Computing Machinery, New York, NY, USA, Article 270, 8 pages. https://doi.org/10.1145/3491101.3519843
Nima Zargham, Dmitry Alexandrovsky, Thomas Mildner, Robert Porzel, and Rainer Malaka. 2023. "Let's Face It": Investigating User Preferences for Virtual Humanoid Home Assistants. In Proceedings of the 11th International Conference on Human-Agent Interaction (Gothenburg, Sweden) (HAI'23). Association for Computing Machinery, New York, NY, USA, 246-256. https://doi.org/10.1145/ 3623809.3623821
Nima Zargham, Michael Bonfert, Robert Porzel, Tanja Doring, and Rainer Malaka. 2021. Multi-Agent Voice Assistants: An Investigation Of User Experience. In 20th International Conference on Mobile and Ubiquitous Multimedia (Leuven, Belgium) (MUM 2021). Association for Computing Machinery, New York, NY, USA, 98-107. https://doi.org/10.1145/3490632.3490662
Nima Zargham, Leon Reicherts, Michael Bonfert, Sarah Theres Voelkel, Johannes Schoening, Rainer Malaka, and Yvonne Rogers. 2022. Understanding Circumstances for Desirable Proactive Behaviour of Voice Assistants: The Proactivity Dilemma. In Proceedings of the 4th Conference on Conversational User Interfaces (Glasgow, United Kingdom) (CUI'22). Association for Computing Machinery, New York, NY, USA, Article 3, 14 pages. https://doi.org/10.1145/3543829.3543834