Voicecraft: Designing Task-specific Voice Assistant Personas

Design; Personas; Speech Interfaces; Design and evaluations; Ecological validity; Information search; Interaction design; Online shopping; Research communities; Speech interface; Task-oriented; Human-Computer Interaction; Software

Abstract :

[en] Voicecraft workshop aims to establish a research community focused on the design and evaluation of Voice Assistant (VA) personas for both task-oriented functions (e.g., information search, online shopping) and personal growth applications (e.g., coaching, mindful reflection, tutoring). Through discussion and collaborative efforts, we will seek to propose a set of practices and standards that will help to improve the ecological validity of VA personas. In particular, we will explore topics such as the interaction design of voice-based interfaces, the impact of agent personas on the user experience, and the approaches for designing such VA agents. This workshop will serve as a platform to build a better-equipped community to explore VA personas that provide a better fit to range of everyday interaction scenarios.

Disciplines :

Computer science

Author, co-author :

DUBIEL, Mateusz ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

Desai, Smit ; University of Illinois, United States ; Northeastern University, United States

Zargham, Nima ; Digital Media Lab, University of Bremen, Germany

Schmitt, Anuschka ; University of St. Gallen, Switzerland

External co-authors :

yes

Language :

English

Title :

Voicecraft: Designing Task-specific Voice Assistant Personas

Publication date :

08 July 2024

Event name :

ACM Conversational User Interfaces 2024

Event place :

Luxembourg City, Luxembourg

Event date :

08-07-2024 => 10-07-2024

Audience :

International

Main work title :

Proceedings of the 6th Conference on ACM Conversational User Interfaces, CUI 2024

Publisher :

Association for Computing Machinery, Inc

ISBN/EAN :

9798400705113

Peer reviewed :

Peer reviewed

Additional URL :

https://dl.acm.org/doi/pdf/10.1145/3640794.3670000

European Projects :

HE - 101071147 - SYMBIOTIK - Context-aware adaptive visualizations for critical decision making

Funders :

List
LuxAI
Universite du Luxembourg
European Innovation Council Pathfinder program
European Union

Funding text :

This work is in part supported by European Innovation Council Pathfinder program (SYMBIOTIK project, grant 101071147).

Available on ORBilu :

since 18 April 2025

Statistics

Number of views

64 (0 by Unilu)

Number of downloads

24 (0 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

WoS citations^™

Bibliography

Pascal Belin, Bibi Boehme, and Phil McAleer. 2017. The sound of trustworthiness: Acoustic-based modulation of perceived voice personality. PloS one 12, 10 (2017), e0185651.
Julia Cambre and Chinmay Kulkarni. 2019. One voice fits all' Social implications and research challenges of designing voices for smart devices. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1-19.
Vijay Chidambaram, Yueh-Hsuan Chiang, and Bilge Mutlu. 2012. Designing persuasive robots: how robots might persuade people using vocal and nonverbal cues. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction. 293-300.
M. Sadek, R. A. Calvo, and C. Mougenot. Trends, Challenges and Processes in Conversational Agent Design: Exploring Practitioners' Views through Semi-Structured Interviews. In Proceedings of the 5th International Conference on Conversational User Interfaces (CUI '23), pages 1-10, New York, NY, USA, July 2023. Association for Computing Machinery.
Leigh Clark, Philip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlogl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, Justin Edwards, et al. 2019. The state of speech in HCI: Trends, themes and challenges. Interacting with computers 31, 4 (2019), 349-371.
Smit Desai and Michael Twidale. Metaphors in Voice User Interfaces: A Slippery Fish. ACM Transactions on Computer-Human Interaction, 30(6):89:1-89:37, September 2023.
Smit Desai and Jessie Chin. Hey Google, Can You Help Me Learn' In Proceedings of the 3rd Conference on Conversational User Interfaces (CUI '21), Bilbao (online), Spain, 2021. Association for Computing Machinery. DOI: 10.1145/3469595.3469601. ISBN: 9781450389983. Article No. : 6, Number of pages: 4. Keywords: Computer-Based Learning Environments, Informal Learning, Metacognition, Self-Regulated Learning, Voice User Interface.
Smit Desai and Jessie Chin. OK Google, Let's Learn: Using Voice User Interfaces for Informal Self-Regulated Learning of Health Topics among Younger and Older Adults. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), Hamburg, Germany, 2023. Association for Computing Machinery. DOI: 10.1145/3544548.3581507. ISBN: 9781450394215. Article No. : 847, Number of pages: 21. Keywords: Aging, Conversational agent(s), Health information, Informal Learning, Interaction fluency, Metacognition, Self-regulated learning, Technology acceptance, Voice assistant(s), Voice user interface(s).
Smit Desai, Xinhui Hu, Morgan Lundy, and Jessie Chin. Using Experience-Based Participatory Approach to Design Interactive Voice User Interfaces for Delivering Physical Activity Programs with Older Adults. In Proceedings of the 11th International Conference on Human-Agent Interaction (HAI '23), pages 180-190, Gothenburg, Sweden, 2023. Association for Computing Machinery. DOI: 10.1145/3623809.3623827. ISBN: 9798400708244. Keywords: Co-design, Conversational agents, Older Adults, Participatory Design, Physical Activity, Voice User Interfaces.
Mateusz Dubiel, Sylvain Daronnat, and Luis A Leiva. 2022. Conversational Agents Trust Calibration: A User-Centred Perspective to Design. In Proceedings of the 4th Conference on Conversational User Interfaces. 1-6.
Mateusz Dubiel, Martin Halvey, Pilar Oplustil Gallegos, and Simon King. 2020. Persuasive synthetic speech: Voice perception and user behaviour. In Proceedings of the 2nd Conference on Conversational User Interfaces. 1-9.
Aaron C Elkins and Douglas C Derrick. 2013. The sound of trust: voice as a measurement of trust during interactions with embodied conversational agents. Group decision and negotiation 22, 5 (2013), 897-913.
Andrew Gibiansky, Sercan Arik, Gregory Diamos, John Miller, Kainan Peng, Wei Ping, Jonathan Raiman, and Yanqi Zhou. 2017. Deep voice 2: Multi-speaker neural text-To-speech. Advances in neural information processing systems 30 (2017).
Phil McAleer, Alexander Todorov, and Pascal Belin. 2014. How do you say 'Hello'' Personality impressions from brief novel voices. PloS one 9, 3 (2014), e90779.
Nasim Motalebi, Eugene Cho, S. Shyam Sundar, and Saeed Abdullah. Can Alexa be your Therapist' How Back-Channeling Transforms Smart-Speakers to be Active Listeners. In Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing (CSCW '19 Companion), pages 309-313, Austin, TX, USA, 2019. Association for Computing Machinery. DOI: 10.1145/3311957.3359502. ISBN: 9781450366922. Keywords: wellbeing, smartspeakers, conversational agents, back-channeling, active listening.
Anuschka Schmitt, Naim Zierau, Andreas Janson, and Jan Marco Leimeister. 2021. Voice as a contemporary frontier of interaction design. In European Conference on Information Systems (ECIS).-Virtual.
Mateusz Dubiel, Anastasia Sergeeva, and Luis A Leiva. 2024. Impact of Voice Fidelity on Decision Making: A Potential Dark Pattern'. In Proceedings of the 29th International Conference on Intelligent User Interfaces. 181-194.
Klie, L. AI Breathes Life into an Industry on the Edge. Speech Technology Magazine. 29, 4-5 (2024)
Zargham, N., Bonfert, M., Porzel, R., Doring, T. & Malaka, R. Multi-Agent Voice Assistants: An Investigation of User Experience. Proceedings Of The 20th International Conference On Mobile And Ubiquitous Multimedia. pp. 98-107 (2021)