Are you sure you want to order that? On Appropriateness of Voice-only Proactive Feedback Strategies

DUBIEL, Mateusz; BONGARD, Kerstin; LEIVA, Luis A.; SERGEEVA, Anastasia

doi:10.1145/3571884.3604312

Download

Paper published in a book (Scientific congresses, symposiums and conference proceedings)

Are you sure you want to order that? On Appropriateness of Voice-only Proactive Feedback Strategies

DUBIEL, Mateusz; BONGARD, Kerstin; LEIVA, Luis A. et al.

2023 • In Proceedings of the ACM Conference on Conversational User Interfaces (CUI)

Peer reviewed

Permalink
https://hdl.handle.net/10993/55823

DOI
10.1145/3571884.3604312

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

Fostering_Reflection_CUI2023.pdf

Author postprint (1.16 MB)

Download

All documents in ORBilu are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

Conversational Agents; Synthetic Speech; Design Ethics; Trust

Abstract :

[en] Conversational agents (CAs) that deliver proactive interventions can benefit users by reducing their cognitive workload and improving performance. However, little is known regarding how such interventions would impact perception of CA’s appropriateness in voice-only, decision-making tasks. We conducted a within-subjects experiment (N=30) to evaluate the effect of CA’s feedback delivery strategy at three levels (no feedback, unsolicited, and solicited feedback) in an interactive food ordering scenario. We discovered that unsolicited feedback was perceived to be more appropriate than solicited feedback. Our results provide preliminary insights regarding the impact of proactive feedback on CA perception in decision-making tasks.

Research center :

University of Luxembourg: Department of Computer Science - FSTM

Disciplines :

Computer science

Author, co-author :

DUBIEL, Mateusz ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

BONGARD, Kerstin ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

LEIVA, Luis A. ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

SERGEEVA, Anastasia ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

External co-authors :

Language :

English

Title :

Are you sure you want to order that? On Appropriateness of Voice-only Proactive Feedback Strategies

Publication date :

20 July 2023

Event name :

5th Conference on Conversational User Interfaces (CUI 2023)

Event organizer :

Association for Computing Machinery (ACM)

Event place :

Eindhoven, Netherlands

Event date :

from 19-07-2023 to 21-07-2022

Audience :

International

Main work title :

Proceedings of the ACM Conference on Conversational User Interfaces (CUI)

Publisher :

ACM, United States

Peer reviewed :

Peer reviewed

Focus Area :

Computational Sciences

Additional URL :

https://dl.acm.org/doi/10.1145/3571884.3604312

European Projects :

HE - 101071147 - SYMBIOTIK - Context-aware adaptive visualizations for critical decision making

FnR Project :

FNR15722813 - Brainsourcing For Affective Attention Estimation, 2021 (01/02/2022-31/01/2025) - Luis Leiva

Funders :

Union Européenne

Available on ORBilu :

since 22 August 2023

Statistics

Number of views

142 (27 by Unilu)

Number of downloads

116 (11 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenAlex citations

Bibliography

Tawfiq Ammari, Jofish Kaye, Janice Y Tsai, and Frank Bentley. 2019. Music, Search, and IoT: How People (Really) Use Voice Assistants. ACM Trans. Comput. Hum. Interact. 26, 3 (2019), 17-1.
Yulia E Chentsova Dutton. 2012. Butting in vs. being a friend: Cultural differences and similarities in the evaluation of imposed social support. J. Soc. Psychol. 152, 4 (2012), 493-509.
Michael Chourdakis, Thrasivoulos Tzellos, Chryssa Pourzitaki, Konstantinos A Toulis, George Papazisis, and Dimitrios Kouvelas. 2011. Evaluation of dietary habits and assessment of cardiovascular disease risk factors among Greek university students. Appetite 57, 2 (2011), 377-383.
Leigh Clark, Nadia Pantidi, Orla Cooney, Philip Doyle, Diego Garaialde, Justin Edwards, Brendan Spillane, Emer Gilmartin, Christine Murad, Cosmin Munteanu, et al. 2019. What makes a good conversation Challenges in designing truly conversational agents. In Proc. CHI. 1-12.
Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz studies-why and how. Knowl Based Syst. 6, 4 (1993), 258-266.
Janna T Deelstra, Maria CW Peeters, Wilmar B Schaufeli, Wolfgang Stroebe, Fred RH Zijlstra, and Lorenz P Van Doornen. 2003. Receiving instrumental support at work: When help is not welcome. J. Appl. Psychol. 88, 2 (2003), 324.
Tiffany D Do, Ryan P McMahan, and Pamela J Wisniewski. 2022. A New Uncanny Valley The Effects of Speech Fidelity and Human Listener Gender on Social Perceptions of a Virtual-Human Speaker. In Proc. CHI. 1-11.
Philip R Doyle, Justin Edwards, Odile Dumbleton, Leigh Clark, and Benjamin R Cowan. 2019. Mapping perceptions of humanness in intelligent personal assistant interaction. In Proc. MobileHCI. 1-12.
Justin Edwards, Christian Janssen, Sandy Gould, and Benjamin R Cowan. 2021. Eliciting spoken interruptions to inform proactive speech agent design. In Proc. CUI. 1-12.
Isaac Elias, Heiga Zen, Jonathan Shen, Yu Zhang, Jia Ye, R. J. Skerry-Ryan, and YonghuiWu. 2021. Parallel Tacotron 2: A Non-Autoregressive Neural TTS Model with Differentiable Duration Modeling. CoRR abs/2103.14574 (2021).
Andrew Gibiansky, Sercan Arik, Gregory Diamos, John Miller, Kainan Peng, Wei Ping, Jonathan Raiman, and Yanqi Zhou. 2017. Deep voice 2: Multi-speaker neural text-to-speech. Adv Neural Inf Process Syst. 30 (2017).
Ella Glikson and Anita Williams Woolley. 2020. Human trust in artificial intelligence: Review of empirical research. Acad. Manag. Ann. 14, 2 (2020), 627-660.
Daena J Goldsmith. 2000. Soliciting advice: The role of sequential placement in mitigating face threat. Commun. Monogr. 67, 1 (2000), 1-19.
Ted Grover, Kael Rowan, Jina Suh, Daniel McDuff, and Mary Czerwinski. 2020. Design and evaluation of intelligent agent prototypes for assistance with focus and productivity at work. In Proc. IUI. 390-400.
Dietmar Jannach. 2022. Evaluating conversational recommender systems. Artif. Intell. Rev. (2022).
Matthias Kraus, NicolasWagner, andWolfgang Minker. 2020. Effects of proactive dialogue strategies on human-computer trust. In Proc. UMAP. 107-116.
Matthias Kraus, Nicolas Wagner, Nico Untereiner, and Wolfgang Minker. 2022. Including Social Expectations for Trustworthy Proactive Human-Robot Dialogue. In Proc. UMAP. 23-33.
Katharina Kühne, Martin H Fischer, and Yuefang Zhou. 2020. The human takes it all: Humanlike synthesized voices are perceived as less eerie and more likable. evidence from a subjective ratings study. Frontiers in neurorobotics (2020), 105.
Ewa Luger and Abigail Sellen. 2016. " Like Having a Really Bad PA" The Gulf between User Expectation and Experience of Conversational Agents. In Proc. CHI. 5286-5297.
Michal Luria, Rebecca Zheng, Bennett Huffman, Shuangni Huang, John Zimmerman, and Jodi Forlizzi. 2020. Social boundaries for personal agents in the interpersonal space of the home. In Proc. CHI. 1-12.
Erina L MacGeorge, Bo Feng, Ginger L Butler, and Sara K Budarz. 2004. Understanding advice in supportive interactions: Beyond the facework and message evaluation paradigm. Hum. Commun. Res. 30, 1 (2004), 42-70.
Janne A Martikainen, Erkki JO Soini, David E Laaksonen, and Leo Niskanen. 2011. Health economic consequences of reducing salt intake and replacing saturated fat with polyunsaturated fat in the adult Finnish population: Estimates based on the FINRISK and FINDIET studies. Eur J Clin Nutr. 65, 10 (2011), 1148-1155.
Manolis Mavrikis, Beate Grawemeyer, Alice Hansen, and Sergio Gutierrez-Santos. 2014. Exploring the potential of speech recognition to support problem solving and reflection. In Int. J. Technol. Enhanc. Learn. Springer, 263-276.
National Public Media. 2022. The Smart Audio Report | National Public Media-nationalpublicmedia.com. https://www.nationalpublicmedia.com/insights/ reports/smart-audio-report/. [Accessed 04-Apr-2023].
John W Mullennix, Steven E Stern, Stephen J Wilson, and Corrie-lynn Dyson. 2003. Social perception of male and female computer synthesized speech. Comput. Hum. Behav. 19, 4 (2003), 407-424.
Lingyun Qiu and Izak Benbasat. 2009. Evaluating anthropomorphic product recommendation agents: A social relationship perspective to designing information systems. J Manag Inf Syst. 25, 4 (2009), 145-182.
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021. Zero-shot text-to-image generation. In Proc. ICML. PMLR, 8821-8831.
Leon Reicherts, Yvonne Rogers, Licia Capra, Ethan Wood, Tu Dinh Duong, and Neil Sebire. 2022. It's Good to Talk: A Comparison of Using Voice Versus Screen-Based Interactions for Agent-Assisted Tasks. ACM Trans. Comput. Hum. Interact. 29, 3 (2022), 1-41.
Leon Reicherts, Nima Zargham, Michael Bonfert, Yvonne Rogers, and Rainer Malaka. 2021. May I Interrupt Diverging Opinions on Proactive Smart Speakers. In Proc. CUI. 1-10.
Julian B Rotter. 1980. Interpersonal trust, trustworthiness, and gullibility. American psychologist 35, 1 (1980), 1.
Katie Seaborn, Norihisa P Miyake, Peter Pennefather, and Mihoko Otake-Matsuura. 2021. Voice in human-agent interaction: A survey. ACM Comput. Surv. 54, 4 (2021), 1-43.
Ben Shneiderman. 2020. Human-centered artificial intelligence: Three fresh ideas. AIS Trans. Hum.-Comput. Interact. 12, 3 (2020), 109-124.
Kathleen S Verderber, Rudolph F Verderber, and Cynthia Berryman-Fink. 2004. Inter-act: Interpersonal communication concepts, skills, and contexts. Oxford University Press New York.
Sarah Theres Völkel, Daniel Buschek, Malin Eiband, Benjamin R Cowan, and Heinrich Hussmann. 2021. Eliciting and Analysing Users' Envisioned Dialogues with Perfect Voice Assistants. In Proc. CHI. 1-15.
Nima Zargham, Leon Reicherts, Michael Bonfert, Sarah Theres Völkel, Johannes Schöning, Rainer Malaka, and Yvonne Rogers. 2022. Understanding Circumstances for Desirable Proactive Behaviour of Voice Assistants: The Proactivity Dilemma. In Proc. CUI.