Eliciting Meaningful Collaboration Metrics: Design Implications for Self-Tracking Technologies at Work

Lushnikova, Alina; Bongard, Kerstin; Koenig, Vincent; Lallemand, Carine

doi:10.1007/978-3-031-42286-7_36

Download

Paper published in a book (Scientific congresses, symposiums and conference proceedings)

Eliciting Meaningful Collaboration Metrics: Design Implications for Self-Tracking Technologies at Work

Lushnikova, Alina; Bongard, Kerstin; Koenig, Vincent et al.

2023 • In Human-Computer Interaction – INTERACT 2023

Peer reviewed

Permalink
https://hdl.handle.net/10993/55268

DOI
10.1007/978-3-031-42286-7_36

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

Eliciting meaningful collaboration metrics_Interact.pdf

Publisher postprint (583.71 kB)

Download

All documents in ORBilu are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

collaboration; self-tracking; group-tracking; personal informatics; computer-supported collaborative work; office work; experience; metrics

Abstract :

[en] As the workplace collaboration software market is booming, there is an opportunity to design tools to support reflection and self-regulation of collaboration practices. Building on approaches from personal informatics (PI), we aim to understand and promote the use of data to enable employees to explore their work practices, specifically collaboration. Focused on the preparation stage of PI (deciding to track and tools selection), we invited office workers (N=15, knowledge workers in academia) to identify meaningful aspects of their collaboration experience and report them in a logbook for two weeks. We then conducted semi-structured interviews with participants to identify and reflect on metrics related to collaboration experience. We contribute new insights into employees’ motivations and envisioned metrics reflecting their collaboration, including the personal, social, and organizational considerations for collecting and sharing this data. We derive design implications for self-tracking technologies for collaboration.

Disciplines :

Social & behavioral sciences, psychology: Multidisciplinary, general & others

Author, co-author :

Lushnikova, Alina ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

Bongard, Kerstin ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

Koenig, Vincent ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

Lallemand, Carine ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

External co-authors :

Language :

English

Title :

Eliciting Meaningful Collaboration Metrics: Design Implications for Self-Tracking Technologies at Work

Publication date :

2023

Event name :

INTERACT 2023

Event date :

From 28-08-2023 to 01-09-2023

Audience :

International

Main work title :

Human-Computer Interaction – INTERACT 2023

Publisher :

Springer

Collection name :

Lecture Notes in Computer Science 14144

Peer reviewed :

Peer reviewed

FnR Project :

FNR14839977 > Vincent Koenig > C21 > Collaboration 21 - Leveraging Technologies For Enhanced Collaborative Work And Learning Experiences > 15/09/2021 > 14/09/2027 > 2020

Funders :

FNR - Fonds National de la Recherche

Available on ORBilu :

since 01 June 2023

Statistics

Number of views

96 (10 by Unilu)

Number of downloads

36 (6 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

Bibliography

Abtahi, P., et al.: Understanding physical practices and the role of technology in manual self-tracking. Proc. ACM on Inter. Mob. Wear. Ubiq. Technol. 4(4), 1–24 (2020). https://doi.org/10.1145/3432236
Anderson, N.R., West, M.A.: Measuring climate for work group innovation: development and validation of the team climate inventory. Journ. of Org. Behav. 19, 235–258 (1998). https://doi.org/10.1002/(SICI)1099-1379(199805)19:3〈235::AID-JOB837〉3.0.CO;2-C
Bedwell, W.L., Wildman, J.L., DiazGranados, D., Salazar, M., Kramer, W.S., Salas, E.: Collaboration at work: an integrative multilevel conceptualization. Hum. Res. Manag. Review 22, 128–145 (2012). https://doi.org/10.1016/j.hrmr.2011.11. 007
Bowler, R.D., Bach, B., Pschetz, L.: Exploring uncertainty in digital scheduling, and the wider implications of unrepresented temporalities in HCI. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. CHI 2022, ACM, New York (2022). https://doi.org/10.1145/3491102.3502107
Briggs, R.O., Reinig, B.A., Vreede, G.J.D.: Meeting satisfaction for technology-supported groups: an empirical validation of a goal-attainment model. Small Group Res. 37, 585–611 (2006). https://doi.org/10.1177/1046496406294320
van Bussel, T., van den Heuvel, R., Lallemand, C.: Habilyzer: Empowering office workers to investigate their working habits using an open-ended sensor kit. In: 2022 CHI Conference on Human Factors in Computing Systems Extended Abstracts, pp. 1–8. ACM, New York (2022). https://doi.org/10.1145/3491101.3519849
Simsek Caglar, P., Roto, V., Vainio, T.: User experience research in the work context: maps, gaps and Agenda. Proc. ACM Hum.-Comput. Interact. 6(CSCW1), 1–28 (2022). https://doi.org/10.1145/3512979
Chen, D., Zhang, Y., Lin, Y.: Group awareness and group awareness tools in computer-supported collaborative learning: A literature review. In: 2022 International Symposium on Educational Technology (ISET), pp. 18–22 (2022). https://doi.org/10.1109/ISET55194.2022.00013
Cho, J., Xu, T., Zimmermann-Niefield, A., Voida, S.: Reflection in theory and reflection in practice: An exploration of the gaps in reflection support among personal informatics apps. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, CHI 2022, ACM, New York (2022). https://doi. org/10.1145/3491102.3501991
Choe, E.K., Lee, N.B., Lee, B., Pratt, W., Kientz, J.A.: Understanding quantified-selfers’ practices in collecting and exploring personal data. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1143–1152. ACM, New York (2014). https://doi.org/10.1145/2556288.2557372
Chung, C.F., Dew, K., Cole, A., Zia, J., Fogarty, J., et al.: Boundary negotiating artifacts in personal informatics: patient-provider collaboration with patient-generated data. In: Proceedings of the 19th ACM Conference on Computer-supported Cooperative Work and Social Computing, pp. 770–786. CSCW 2016, ACM, New York (2016). https://doi.org/10.1145/2818048.2819926
Coşkun, A., Karahanoǧlu, A.: Data sensemaking in self-tracking: towards a new generation of self-tracking tools. Int. Journ. of Hum.-Comp. Inter. 0(0), 1–22 (2022). https://doi.org/10.1080/10447318.2022.2075637
Daskalova, N., Desingh, K., Papoutsaki, A., Schulze, D., Sha, H., Huang, J.: Lessons learned from two cohorts of personal informatics self-experiments. Proc. ACM on Inter. Mob. Wear. Ubiq. Technol. 1(3), 1–22 (2017)
Denefleh, T., Berger, A., Kurze, A., Bischof, A., Frauenberger, C.: Sensorstation: exploring simple sensor data in the context of a shared apartment. In: Proceedings of the 2019 on Designing Interactive Systems Conference, pp. 683–695. ACM, New York (2019). https://doi.org/10.1145/3322276.3322309
van Dijk, E.T.K., Westerink, J.H., Beute, F., IJsselsteijn, W.A.: Personal informatics, self-insight, and behavior change: A critical review of current literature. Hum.-Comp. Inter. 32, 268–296 (2017). https://doi.org/10.1080/07370024.2016. 1276456, https://doi.org/10.1080/07370024.2016.1276456
Epstein, D.A., Caldeira, C., Figueiredo, M.C., Lu, X., Silva, L.M., et al.: Mapping and taking stock of the personal informatics literature. Proc. ACM on Interact. Mob. Wearable Ubiq. Technol. 4(4), 1–38 (2020)
Epstein, D.A., Ping, A., Fogarty, J., Munson, S.A.: A lived informatics model of personal informatics. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 731–742. ACM, New York (2015). https://doi.org/10.1145/2750858.2804250
Feustel, C., Aggarwal, S., Lee, B., Wilcox, L.: People like me: designing for reflection on aggregate cohort data in personal informatics systems. Proc. ACM on Inter. Mob. Wear. Ubiq. Technol. 2(3), 1–21 (2018)
Gutwin, C., Greenberg, S.: A descriptive framework of workspace awareness for real-time groupware. Comput. Support. Coop. Work (CSCW) 11(3), 411–446 (2002)
Häkkilä, J., Poguntke, R., Harjuniemi, E., Hakala, L., Colley, A., Schmidt, A.: Businec-studying the effects of a busyness signifying necklace in the wild. In: Proceedings of the 2020 ACM Designing Interactive Systems Conference, pp. 2177– 2188. DIS 2020, ACM, New York (2020). https://doi.org/10.1145/3357236.3395455
Hassenzahl, M.: The thing and i: understanding the relationship between user and product. In: Blythe, M.A., Monk, A.F., Overbeeke, K., Wright, P.C. (eds.) Funology: From Usability to Enjoyment. Kluwer Academic Publishers, Dordrecht, Netherlands (2003)
Inc., G.: Gartner forecasts worldwide social software and collaboration market to grow 17% in 2021 (3 2020), www.tinyurl.com/fj92t8na
Karkar, R., Fogarty, J., Kientz, J.A., Munson, S.A., Vilardaga, R., Zia, J.: Opportunities and challenges for self-experimentation in self-tracking. In: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 991–996. ACM, New York (2015). https://doi.org/10. 1145/2800835.2800949
Khakurel, J., Immonen, M., Porras, J., Knutas, A.: Understanding the adoption of quantified self-tracking wearable devices in the organization environment: an empirical case study. In: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments, pp. 119–128. PETRA 2019, ACM, New York (2019)
Kim, Y.H., Choe, E.K., Lee, B., Seo, J.: Understanding personal productivity: How knowledge workers define, evaluate, and reflect on their productivity. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–12. ACM, New York (2019). https://doi.org/10.1145/3290605.3300845
Lallemand, C., Gronier, G., Koenig, V.: User experience: a concept without consensus? exploring practitioners’ perspectives through an international survey. Comp. Hum. Behav. 43, 35–48 (2015). https://doi.org/10.1016/j.chb.2014.10.048
Lanzing, Marjolein: The transparent self. Ethics Inf. Technol. 18(1), 9–16 (2016). https://doi.org/10.1007/s10676-016-9396-y
Lee, K., Hong, H.: Designing for self-tracking of emotion and experience with tangible modality. In: Proceedings of the 2017 Conference on Designing Interactive Systems, pp. 465–475. DIS 2017, ACM, New York (2017). https://doi.org/10.1145/3064663.3064697
Li, I., Dey, A., Forlizzi, J.: A stage-based model of personal informatics systems. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, vol. 1, pp. 557–566. ACM, New York (2010). https://doi.org/10.1145/1753326. 1753409
Lu, Y., Roto, V.: Evoking meaningful experiences at work-a positive design framework for work tools. J. Eng. Design 26(4–6), 99–120 (2015). https://doi. org/10.1080/09544828.2015.1041461
Lushnikova, A.: Eliciting meaningful collaboration metrics. www.osf.io/z2qfg
Lutchyn, Y., Johns, P., Roseway, A., Czerwinski, M.: MoodTracker: monitoring collective emotions in the workplace. In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 295–301. IEEE (2015). https://doi.org/10.1109/ACII.2015.7344586
Mantau, M.J., Barreto Vavassori Benitti, F.: Awareness support in collaborative system: reviewing last 10 years of CSCW research. In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD), pp. 564–569 (2022). https://doi.org/10.1109/CSCWD54268.2022.9776091
Marek, L., Brock, D., Savla, J.: Evaluating collaboration for effectiveness. Amer. Journ. of Eval. 36 (2014). https://doi.org/10.1177/1098214014531068
Markopoulos, P.: A design framework for awareness systems. In: Markopoulos, P., De Ruyter, B., Mackay, W. (eds.) Awareness Systems. Hum.-Comp. Inter. Ser, Springer, London (2009)
McKillop, M., Mamykina, L., Elhadad, N.: Designing in the dark: Eliciting self-tracking dimensions for understanding enigmatic disease. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–15. CHI 2018, ACM, New York (2018). https://doi.org/10.1145/3173574.3174139
Murnane, E.L., Walker, T.G., Tench, B., Voida, S., Snyder, J.: Personal informatics in interpersonal contexts: towards the design of technology that supports the social ecologies of long-term mental health management. Proc. ACM Hum. Comput. Interact. 2(CSCW), 1–27 (2018)
Møller, N.H., Neff, G., Simonsen, J.G., Villumsen, J.C., Bjørn, P.: Can workplace tracking ever empower? collective sensemaking for the responsible use of sensor data at work. Proc. ACM Hum. Comp. Inter. 5, 1–21 (2021). https://doi.org/10. 1145/3463931
Ngoon, T.J., Patidar, P., Ogan, A., Harrison, C., Agarwal, Y.: Professional informatics: Personalized, data-driven professional development (2022)
Patel, H., Pettitt, M., Wilson, J.R.: Factors of collaborative working: a framework for a collaboration model. Appl. Ergon. 43(1), 1–26 (2012). https://doi.org/10. 1016/j.apergo.2011.04.009
Pina, L., Sien, S.W., Song, C., Ward, T.M., Fogarty, J., et al.: Dreamcatcher: exploring how parents and school-age children can track and review sleep information together. Proc. ACM Hum.-Comp. Inter. 4, 1–25 (2020). https://doi.org/10. 1145/3392882
Pina, L.R., et al.: From personal informatics to family informatics: Understanding family practices around health monitoring. In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, pp. 2300–2315. ACM, Portland (2017). https://doi.org/10.1145/2998181.2998362
Raj, S., Lee, J.M., Garrity, A., Newman, M.W.: Clinical data in context: towards sensemaking tools for interpreting personal health data. Proc. ACM on Inter. Mob. Wear. Ubiq. Technol. 3(1), 1–20 (2019)
Rivera-Pelayo, V., Fessl, A., Müller, L., Pammer, V.: Introducing mood self-tracking at work: empirical insights from call centers. ACM Trans. Comput. Hum. Interact. (TOCHI) 24(1), 1–28 (2017)
Rooksby, J., Rost, M., Morrison, A., Chalmers, M.: Personal tracking as lived informatics. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1163–1172. CHI 2014, ACM, New York (2014). https://doi.org/10. 1145/2556288.2557039
Stamhuis, S., Brombacher, H., Vos, S., Lallemand, C.: Office agents: Personal office vitality sensors with intent. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–5. ACM, New York (2021). https://doi.org/10.1145/3411763.3451559
Tenenberg, J., Roth, W.M., Socha, D.: From i-awareness to we-awareness in CSCW 25,(4–5) (2016)
Toebosch, R.: Improving collaboration experiences and skills: An open-ended, user-driven self-tracking approach for education. In: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction, pp. 1–4. ACM, New York (2023). https://doi.org/10.1145/3569009.3576220
Wannamaker, K.A., Kollannur, S.Z.G., Dörk, M., Willett, W.: I/o bits: User-driven, situated, and dedicated self-tracking. In: Proc. 2021 ACM Design. Inter. Sys. Conf.: Nowhere and Everywhere, pp. 523–537. ACM, New York (2021). https://doi.org/10.1145/3461778.3462138
Xue, M., Liang, R.H., Hu, J., Yu, B., Feijs, L.: Understanding how group workers reflect on organizational stress with a shared, anonymous heart rate variability data visualization. In: 2022 CHI Conf. on Hum. Fact. in Comp. Sys. ACM, New York (2022). https://doi.org/10.1145/3491101.3503576