Mediated human-human interaction; Recommender systems; User-centered design; User experience; Natural language
Abstract :
[en] Meetings are recurrent organizational tasks intended to drive progress in an interdisciplinary and collaborative manner. They are, however, prone to inefficiency due to factors such as differing knowledge among participants. The research goal of this paper is to design a recommendation-based meeting assistant that can improve the efficiency of meetings by helping to contextualize the information being discussed and reduce distractions for listeners. Following a Wizard-of-Oz setup, we gathered user feedback by thematically analyzing focus group discussions and identifying this kind of system’s key challenges and requirements. The findings point to shortcomings in contextualization and raise concerns about distracting listeners from the main content. Based on the findings, we have developed a set of design recommendations that address context, interactivity and personalization issues. These recommendations could be useful for developing a meeting assistant that is tailored to the needs of meeting participants, thereby helping to optimize the meeting experience.
Disciplines :
Computer science
Author, co-author :
Alcaraz, Benoît ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)
Hosseini Kivanani, Nina ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)
Najjar, Amro
Bongard-Blanchy, Kerstin ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)
External co-authors :
no
Language :
English
Title :
User Requirement Analysis for a Real-Time NLP-Based Open Information Retrieval Meeting Assistant
Publication date :
March 2023
Event name :
45th European Conference on Information Retrieval (ECIR 2023)
FNR14839977 - Collaboration 21 - Leveraging Technologies For Enhanced Collaborative Work And Learning Experiences, 2020 (15/09/2021-14/09/2027) - Vincent Koenig
Alcaraz, B., Hosseini-Kivanani, N., Najjar, A.: IRRMA: an image recommender robotic meeting assistant. In: Dignum, F., Mathieu, P., Corchado, J.M., De La Pri-eta, F. (eds.) Advances in Practical Applications of Agents, Multi-Agent Systems, and Complex Systems Simulation. The PAAMS Collection. PAAMS 2022. LNCS, vol. 13616. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-18192-4_36
Amershi, S., et al.: Guidelines for human-AI interaction. In: Proceedings of the 2019 Chi Conference on Human Factors in Computing Systems, pp. 1–13 (2019)
Assayag, M., et al.: Meeting assistant application. In: Sixteenth Annual Conference of the International Speech Communication Association (2015)
Ball, J.: The double diamond: a universally accepted depiction of the design process (2022). www.designcouncil.org.uk/our-work/news-opinion/double-diamond-universally-accepted-depiction-design-process
Baraglia, J., Cakmak, M., Nagai, Y., Rao, R.P., Asada, M.: Efficient human-robot collaboration: when should a robot take initiative? Int. J. Robot. Res. 36(5–7), 563–579 (2017)
Billings, D.R., Schaefer, K.E., Chen, J.Y., Hancock, P.A.: Human-robot interaction: developing trust in robots. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, pp. 109–110 (2012)
Çano, E., Morisio, M.: Hybrid recommender systems: a systematic literature review. Intell. Data Anal. 21(6), 1487–1524 (2017)
Champiri, Z.D., Mujtaba, G., Salim, S.S., Yong Chong, C.: User experience and recommender systems. In: 2019 2nd International Conference on Computing, Mathematics and Engineering Technologies (iCoMET), pp. 1–5 (2019). https://doi.org/10.1109/ICOMET.2019.8673410
Chiu, M.C., Huang, J.H., Gupta, S., Akman, G.: Developing a personalized recommendation system in a smart product service system based on unsupervised learning model. Comput. Ind. 128, 103421 (2021)
Clarke, V., Braun, V., Hayfield, N.: Thematic analysis. Qualit. Psychol. a practical guide to research methods 222, 248 (2015)
Dahlbäck, N., Jönsson, A., Ahrenberg, L.: Wizard of OZ studies-why and how. Knowl.-Based Syst. 6(4), 258–266 (1993)
Do, V., Corbett-Davies, S., Atif, J., Usunier, N.: Online certification of preference-based fairness for personalized recommender systems. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, pp. 6532–6540 (2022)
Ehnes, J.: A tangible interface for the AMI content linking device-the automated meeting assistant. In: 2009 2nd Conference on Human System Interactions, pp. 306–313. IEEE (2009)
Fessenden, T.: Focus groups 101 (2022). www.nngroup.com/articles/focus-groups-definition/
Ge, Y., et al.: A survey on trustworthy recommender systems. arXiv preprint arXiv:2207.12515 (2022)
Hassenzahl, M.: User experience (UX) towards an experiential perspective on product quality. In: Proceedings of the 20th Conference on l’Interaction Homme-Machine, pp. 11–15 (2008)
Herse, S., et al.: Do you trust me, blindly? factors influencing trust towards a robot recommender system. In: 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 7–14. IEEE (2018)
Höffler, T.N., Leutner, D.: Instructional animation versus static pictures: a meta-analysis. Learn. Instr. 17(6), 722–738 (2007)
Isbister, K., Nakanishi, H., Ishida, T., Nass, C.: Helper agent: designing an assistant for human-human interaction in a virtual meeting space. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 57–64 (2000)
Lallemand, C., Mercier, E.: Optimizing the use of the sentence completion survey technique in user research: a case study on the experience of e-reading. In: CHI Conference on Human Factors in Computing Systems, pp. 1–18 (2022)
Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Holzinger, A. (ed.) USAB 2008. LNCS, vol. 5298, pp. 63–76. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-89350-9_6
van Maris, A., Lehmann, H., Natale, L., Grzyb, B.: The influence of a robot’s embodiment on trust: a longitudinal study. In: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 313–314 (2017)
Martijn, M., Conati, C., Verbert, K.: “knowing me, knowing you”: personalized explanations for a music recommender system. User Model. User-Adapt. Inter. 32(1), 215–252 (2022). https://doi.org/10.1007/s11257-021-09304-9
Milano, S., Taddeo, M., Floridi, L.: Recommender systems and their ethical challenges. AI Soc. 35(4), 957–967 (2020)
Popescu-Belis, A., et al.: The AMIDA automatic content linking device: just-in-time document retrieval in meetings. In: Popescu-Belis, A., Stiefelhagen, R. (eds.) MLMI 2008. LNCS, vol. 5237, pp. 272–283. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-85853-9_25
Popescu-Belis, A., Kilgour, J., Nanchen, A., Poller, P.: The ACLD: speech-based just-in-time retrieval of meeting transcripts, documents and websites. In: Proceedings of the 2010 International Workshop On Searching Spontaneous Conversational Speech, pp. 45–48 (2010)
Rae, I., Takayama, L., Mutlu, B.: In-body experiences: embodiment, control, and trust in robot-mediated communication. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1921–1930 (2013)
Renjith, S., Sreekumar, A., Jathavedan, M.: An extensive study on the evolution of context-aware personalized travel recommender systems. Inf. Process. Manage. 57(1), 102078 (2020)
Sinha, R., Swearingen, K.: The role of transparency in recommender systems. In: CHI2002 Extended Abstracts On Human Factors In Computing Systems, pp. 830– 831 (2002)
Still, B., Crane, K.: Fundamentals of user-centered design: a practical approach. CRC Press (2017)
Stroessner, S.J., Benitez, J.: The social perception of humanoid and non-humanoid robots: effects of gendered and machinelike features. Int. J. Soc. Robot. 11(2), 305– 315 (2019)
Symeonidis, P., Nanopoulos, A., Manolopoulos, Y.: Moviexplain: a recommender system with explanations. In: Proceedings of the Third ACM Conference on Recommender systems, pp. 317–320 (2009)
Thompson, P., James, A., Stanciu, E.: Agent based ontology driven virtual meeting assistant. In: Kim, T., Lee, Y., Kang, B.-H., Ślęzak, D. (eds.) FGIT 2010. LNCS, vol. 6485, pp. 51–62. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-17569-5_8
Tur, G., Tur, G., et al.: The CALO meeting assistant system. IEEE Trans. Audio Speech Lang. Process. 18(6), 1601–1611 (2010)
Wu, W., He, L., Yang, J.: Evaluating recommender systems. In: Seventh International Conference on Digital Information Management (ICDIM 2012), pp. 56–61. IEEE (2012)
Zhang, S., Yao, L., Sun, A., Tay, Y.: Deep learning based recommender system: a survey and new perspectives. ACM Comput. Surv. (CSUR) 52(1), 1–38 (2019)
