Paper published in a book (Scientific congresses, symposiums and conference proceedings)
Reading Aloud in Human-Computer Interaction: How Spatial Distribution of Digital Text Units at an Interactive Tabletop Contributes to the Participants’ Shared Understanding
Heuser, Svenja; Arend, Béatrice; Sunnen, Patrick
2020 • In Staphanidis, Constantine; Kurosu, Masaaki; Degen, Helmutet al. (Eds.) HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence
[en] This paper is concerned with how the spatial distribution of written informings in a serious game activity at an interactive tabletop (ITT) induces participants to read aloud interactionally relevant information to each other in the process of co-constructing a shared understanding.
Engaging in an unfamiliar game activity, the participants are all equally dependent on written informings from the interface that serve as a game manual and provide crucial information for jointly achieving the game task(s). When it comes to making use of these written informings, we find the participants to read them aloud, making them accountable within the group.
Our findings from multimodal video analysis of two reading-aloud cases suggest that the written informing’s directionality and distribution (here, either designed as ‘distributed’ or ‘shared’ among the interface) regulate the participants’ access to information. And that participants who cannot visually access the information they are interested in reading (aloud) co-organize fine-grained joint successive actions build on and actualized by read-aloud utterances. These joint actions allow them to align their orientation and share their understanding of game activity-relevant content.
Research center :
Faculty of Humanities, Education and Social Sciences > Department of Social Sciences > Institute of Education and Society
Disciplines :
Social & behavioral sciences, psychology: Multidisciplinary, general & others
Author, co-author :
Heuser, Svenja ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Social Sciences (DSOC)
Arend, Béatrice ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Social Sciences (DSOC)
Sunnen, Patrick ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Social Sciences (DSOC)
External co-authors :
no
Language :
English
Title :
Reading Aloud in Human-Computer Interaction: How Spatial Distribution of Digital Text Units at an Interactive Tabletop Contributes to the Participants’ Shared Understanding
Publication date :
2020
Event name :
22nd International Conference on Human-Computer Interaction
Event place :
Copenhagen, Denmark
Event date :
from 19-07-2020 to 24-07-2020
Audience :
International
Main work title :
HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence
Arnseth, H.C., Ludvigsen, S., Wasson, B., Mørch, A.: Collaboration and problem solving in distributed collaborative learning. In: Dillenbourg, P., et al. (eds.) European Perspectives on Computer-Supported Collaborative Learning: Proceedings of Euro-CSCL 2001, pp. 75–82 (2001)
Arend, B., Heuser, S., Maquil, V., Afkari, H., Sunnen, P.: Being a space mining crew: how participants jointly discover their complementary resources while engaging into a serious game at an interactive tabletop (ITT). In: Gadille, M., Caraguel, V. (eds.) Building the New Millenium Skills for Project Management in Higher Education: How Virtual Worlds Can Help Teachers And Students?, EDULEARN20, 12th Annual International Conference on Education and New Learning Technologies (2020)
Evans, J.: Translating board games: multimodality and play. J. Specialised Transl. 20, 15–32 (2013)
Antle, A., Wise, A.: Getting down to details: using theories of cognition and learning to inform tangible user interface design. Interact. Comput. 25(1), 1–20 (2013)
Anastasiou, D., Maquil, V., Ras, E., Fal, M.: Design implications for a user study on a tangible tabletop. In: Proceedings of the 15th International Conference on Interaction Design and Children, pp. 499–505. ACM, New York (2016)
Sunnen, P., Arend, B., Maquil, V.: ORBIT-overcoming breakdowns in teams with interactive tabletops. In: Kay, J., Luckin, R. (eds.), Rethinking Learning in the Digital Age: Making the Learning Sciences Count, 13th International Conference of the Learning Sciences (ICLS) 2018, London, UK, pp. 1459–1460 (2018)
Psathas, G.: Conversation Analysis: The Study of Talk-in-Interaction, vol. 35. Sage Publications, Thousand Oaks (1994)
Mondada, L.: The organization of concurrent courses of action in surgical demonstrations. In: Streeck, J., et al. (eds.). Embodied Interaction. Language and Body in the Material World, pp. 207–226. Cambridge University Press, Cambridge (2011)
Thorne, S.L., Fischer, I., Lu, X.: The semiotic ecology and linguistic complexity of an online game world. ReCALL 24(3), 279–301 (2012)
Mason, J.: Video games as technical communication ecology. Techn. Commun. Q. 22(3), 219–236 (2013)
Šiaučiūnė, V., Liubinienė, V.: Video game localization: the analysis of in-game texts. Stud. Lang. 19, 46–55 (2011)
Woodruff, A., Szymanski, M.H., Aoki, P.M., Hurst, A.: The conversational role of electronic guidebooks. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) Ubicomp 2001: Ubiquitous Computing, UbiComp 2001, vol. 2201, pp. 187–208. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45427-6_16
Sunnen, P., Arend, B., Heuser, S., Afkari, H., Maquil, V.: Developing an interactive tabletop mediated activity to induce collaboration by implementing design considerations based on cooperative learning principles. In: Stephanidis, C., Antona, M. (eds.) 22nd HCI International Conference 2020. Denmark, Springer, Copenhagen (2020). https://doi.org/10.1007/978-3-030-50729-9_45
Thorsen, N.: Intonation and text in Standard Danish. Ann. Rep. Inst. Copenhagen 18, 185–242 (1984)
Lass, N.J., Lutz, D.R.: The consistency of temporal speech characteristics in a repetitive oral reading task. Lang. Speech 18(3), 227–235 (1975)
Local, J., Walker, G.: How phonetic features project more talk. J. Int. Phonetic Assoc. 42(3), 255–280 (2012)
Swerts, M., Geluykens, R.: Prosody as a marker of information flow in spoken discourse. Lang. Speech 37(1), 21–43 (1994)
Roschelle, J., Teasley, S.D.: The construction of shared knowledge in collaborative problem solving. In: O’Malley, C. (ed.) Computer Supported Collaborative Learning, NATO ASI Series, vol. 128, pp. 69–97. Springer, Berlin (1995). https://doi.org/10.1007/978-3-642-850 98-1_5
Mulder, I., Swaak, J., Kessels, J.: Assessing group learning and shared understanding in technology-mediated interaction. J. Educ. Technol. Soc. 5(1), 35–47 (2002)
Schegloff, E., Jefferson, G., Sacks, H.: A simplest systematics for the organization of turn-taking for conversation. Language 50(4), 696–735 (1974)
Deppermann, A.: Multimodal interaction from a conversation analytic perspective. J. Pragmat. 46(1), 1–7 (2013)
Selting, M., Auer, P., Barth-Weingarten, P., et al.: A system for transcribing talk-in-interaction: GAT 2, translated and adapted for English by Couper-Kuhlen, E., Barth-Weingarten, P. (eds.) Gesprächsforschung-Online-Zeitschrift zur verbalen Interaktion 12, pp. 1–51 (2011)
Szczepek Reed, B., Reed, D., Haddon, E.: NOW or NOT NOW: Coordinating restarts in the pursuit of learnables in vocal master classes. Res. Lang. Soc. Interact. 46(1), 22–46 (2013)
Proske, N.: Zur Funktion und Klassifikation gesprächsorganisatorischer Imperative. In: Diskursmarker im Deutschen Reflexionen und Analysen, pp. 73–101. Verlag für Gesprächsforschung, Göttingen (2017)
Lerner, G. H.: Turn-sharing. In: The Language of Turn and Sequence, pp. 225–256. Oxford University Press, New York (2002)
Pfänder, S., Couper-Kuhlen, E.: Turn-sharing revisited: an exploration of simultaneous speech in interactions between couples. J. Pragmat. 147, 22–48 (2019)
