Measuring the Contextual Dimension of User Experience: Development of the User Experience Context Scale (UXCS)

Lallemand, Carine; Koenig, Vincent

doi:10.1145/3419249.3420156

Download

Paper published in a journal (Scientific congresses, symposiums and conference proceedings)

Measuring the Contextual Dimension of User Experience: Development of the User Experience Context Scale (UXCS)

Lallemand, Carine; Koenig, Vincent

2020 • In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, p. 1-13

Peer reviewed

Permalink
https://hdl.handle.net/10993/45712

DOI
10.1145/3419249.3420156

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

3419249.3420156.pdf

Publisher postprint (637.32 kB)

Download

All documents in ORBilu are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

User experience; context of use; scale development; UX evaluation; UX Context Scale

Abstract :

[en] The context of use has been highlighted for a long time as being a key factor impacting User Experience (UX). Yet current UX evaluation tools, especially questionnaires, rarely encompass an explicit investigation of the context. With the ever-growing trend for mobile products and ubiquitous computing, the absence of a dedicated measurement tool becomes critical. Based on a review of relevant literature and a fine-grained categorization of contextual factors, we developed the UX Context Scale (UXCS), a 30-items instrument allowing for a measure of context properties, as perceived by the user. We report on the development of the scale and present a first validation study (N = 137). A principal component analysis on the subjective items reveals a 6-components structure: Physical Context, Social Context, Internal Context, Perceived Resources, Task Context, and Temporal Context. Reliability of each subscale is high and further analyses confirm the relevance of this tool for UX evaluation.

Research center :

University of Luxembourg: Institute of Cognitive Science and Assessment

Disciplines :

Social & behavioral sciences, psychology: Multidisciplinary, general & others

Author, co-author :

Lallemand, Carine ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

Koenig, Vincent ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

External co-authors :

Language :

English

Title :

Measuring the Contextual Dimension of User Experience: Development of the User Experience Context Scale (UXCS)

Publication date :

October 2020

Event name :

NordiCHI '20: Shaping Experiences, Shaping Society

Event place :

Tallinn, Estonia

Event date :

October, 2020

Journal title :

Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society

Publisher :

ACM

Pages :

1-13

Peer reviewed :

Peer reviewed

Focus Area :

Computational Sciences

Name of the research project :

Towards consolidated methods for the design and evaluation of user experience

Funders :

FNR - Fonds National de la Recherche [LU]

Available on ORBilu :

since 20 January 2021

Statistics

Number of views

150 (6 by Unilu)

Number of downloads

68 (3 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

Bibliography

David Alonso-Riós, Ana Vaquez-Garciá, Eduardo Mosqueira-Rey and Vincente Moret-Bonillo. 2010. A Context-of-Use Taxonomy for Usability Studies. International Journal of Human-Computer Interaction 26, 10, 941-970. http: //dx.doi.org/10.1080/10447318.2010.502099
Leon Barnard, Ji Soo Yi, Julie A. Jacko, and Andrew Sears. 2007. Capturing the effects of context on human performance in mobile computing systems. Personal and Ubiquitous Computing 11, 2 (2007), 81-96. DOI:http://dx.doi.org/10.1007/ s00779-006-0063-x
Christine Bauer and Alexander Novotny. 2017. A consolidated view of context for intelligent systems. Journal of Ambiant Intelligence and Smart Environments, 377-393. DOI:10.3233/AIS-170445
Nigel Bevan and Miles Macleod. 1994. Usability measurement in context. Behaviour & Information Technology 13, 1-2 (1994), 132-145. DOI:http://dx.doi.org/ 10.1080/01449299408914592
Nicholas A. Bradley and Mark D. Dunlop. 2005. Toward a Multidisciplinary Model of Context to Support Context-Aware Computing. Hum-Comput Interaction 20, 4, 403-446. http://dx.doi.org/10.1207/s15327051hci2004-2
Margaret M. Bradley and Peter J. Lang. 1994. Measuring emotion: The selfassessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25, 1 (1994), 49-59. DOI:http://dx.doi.org/10.1016/ 0005-7916(94)90063-9
Nathan Crilly, James Moultrie, and P. John Clarkson. 2004. Seeing things: consumer response to the visual domain in product design. Design Studies 25, 6 (2004), 547-577. DOI:http://dx.doi.org/10.1016/j.destud.2004.03.001
Lee J. Cronbach. 1951. Coefficient alpha and the internal structure of tests. Psychometrika 16, 297-334.
Anind K. Dey and Gregory D. Abowd. 2000. Towards a Better Understanding of Context and Context-Awareness. In Proceedings of Workshop on The What, Who, Where, When, and How of Context-Awareness, part of the 2000 Conference on Human Factors in Computing Systems (CHI 2000). ACM, New York, NY.
Anind K. Dey. 2001. Understanding and Using Context. Pers Ubiquit Comput 5, 1, 4-7. http://dx.doi.org/10.1007/s007790170019
Paul Dourish. 2004. What We Talk About When We Talk About Context. Pers Ubiquit Comput 8, 1, 19-30. http://dx.doi.org/10.1007/s00779-003-0253-8
Jodi Forlizzi and Shannon Ford. 2000. The building blocks of experience. Proceedings of the conference on Designing interactive systems processes, practices, methods, and techniques-DIS 00(2000). DOI:http://dx.doi.org/10.1145/347642. 347800
Laurence G. Grimm and Paul R. Yarnold. 1995. Reading and understanding multivariate statistics, Washington, DC: American Psychological Association.
Marc Hassenzahl (2010). Experience Design: Technology for all the right reasons. San Rafael, CA: Morgan & Claypool.
Marc Hassenzahl, Sarah Diefenbach, and Anja Göritz. 2010. Needs, affect, and interactive products-Facets of user experience. Interacting with Computers 22, 5 (2010), 353-362. DOI:http://dx.doi.org/10.1016/j.intcom.2010.04.002
Marc Hassenzahl, Markus Schöbel, and Tibor Trautmann. 2008. How motivational orientation influences the evaluation and choice of hedonic and pragmatic interactive products: The role of regulatory focus. Interacting with Computers 20, 4-5 (2008), 473-479. DOI:http://dx.doi.org/10.1016/j.intcom.2008.05.001
Marc Hassenzahl and Daniel Ullrich. 2007. To do or not to do: Differences in user experience and retrospective judgments depending on the presence or absence of instrumental goals. Interacting with Computers 19, 4 (2007), 429-437. DOI:http://dx.doi.org/10.1016/j.intcom.2007.05.001
Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & Information Technology 25, 2 (2006), 91-97. DOI:http://dx.doi.org/ 10.1080/01449290500330331
Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. Berichte des German Chapter of the ACM Mensch & Computer 2003(2003), 187-196. DOI:http://dx.doi.org/10.1007/978-3-322-80058-9-19
Marc Hassenzahl, Kekez, R., & Burmester, M. 2002. The importance of a software's pragmatic quality depends on usage modes. In H.Luczak, A. E. Cakir, & G. Cakir (Eds.). In Proceedings of the 6th international conference on Work With Display Units (WWDU 2002) (pp. 275-276). Berlin: ERGONOMIC Institut für Arbeits-und Sozialforschung.
Marc Hassenzahl. 2002. The Effect of Perceived Hedonic Quality on Product Appealingness. International Journal of Human-Computer Interaction 13, 4 (2002), 481-499. DOI:http://dx.doi.org/10.1207/s15327590ijhc1304-07
Marc Hassenzahl, Axel Platz, Michael Burmester, and Katrin Lehner. 2000. Hedonic and ergonomic quality aspects determine a software's appeal. Proceedings of the SIGCHI conference on Human factors in computing systems-CHI 00(2000). DOI:http://dx.doi.org/10.1145/332040.332432
ISO 9241-210:2010 12 15, Ergonomics of human-system interaction-Part 210: Human-centred design for interactive systems, 2010.
ISO 13407:1999, Human-centered design processes for interactive systems, 1999.
ISO 9241-11:1998(E), Ergonomic requirements for office work with visual display terminals (VDTs)-Part 11: Guidance on usability, 1998.
Carroll E. Izard. 1977. Human Emotions. (1977). DOI:http://dx.doi.org/10.1007/ 978-1-4899-2209-0
Satu Jumisko-Pyykkoänd Teija Vainio. 2010. Framing the Context of Use for Mobile Hci. International Journal of Mobile Human Computer Interaction 2, 4, 1-28. http://dx.doi.org/10.4018/jmhci.2010100101
Satu Jumisko-Pyykkö and Miska M. Hannuksela. 2008. Does context matter in quality evaluation of mobile television Proceedings of the 10th international conference on Human computer interaction with mobile devices and services-MobileHCI 08(2008). DOI:http://dx.doi.org/10.1145/1409240.1409248
Henry F. Kaiser. 1974. An index of factorial simplicity. Psychometrika 39, 1 (1974), 31-36. DOI:http://dx.doi.org/10.1007/bf02291575
Wolfgang Kaltz, Jürgen Ziegler, and Steffen Lohmann. 2005. Context-aware Web Engineering: Modeling and Applications. Revue d'intelligence artificielle 19, 3 (January 2005), 439-458. DOI:http://dx.doi.org/10.3166/ria.19.439-458
Hoyoung Kim, Jinwoo Kim, Yeonsoo Lee, Minhee Chae, and Youngwan Choi. 2002. An empirical study of the use contexts and usability problems in mobile Internet. Proceedings of the 35th Annual Hawaii International Conference on System Sciences. DOI:http://dx.doi.org/10.1109/hicss.2002.994090
Hannu Korhonen, Juha Arrasvuori, and Kaisa Väänänen-Vainio-Mattila. 2010. Analysing user experience of personal mobile products through contextual factors. Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia-MUM 10(2010). DOI:http://dx.doi.org/10.1145/1899475.1899486
Carine Lallemand, Guillaume Gronier, and Vincent Koenig. 2015. User experience: A concept without consensus Exploring practitioners' perspectives through an international survey. Computers in Human Behavior 43 (2015), 35-48. DOI:http: //dx.doi.org/10.1016/j.chb.2014.10.048
Carine Lallemand, Vincent Koenig. 2017. How could an intranet be like a friend to me: why standardised UX scales don't always fit. Proceedings of the European Conference on Cognitive Ergonomics ECCE 2017, 9-16.
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. Lecture Notes in Computer Science HCI and Usability for Education and Work(2008), 63-76. DOI:http: //dx.doi.org/10.1007/978-3-540-89350-9-6
Effie L. Law, Virpi Roto, Marc Hassenzahl, Arnold P.o.s. Vermeeren, and Joke Kort. 2009. Understanding, scoping and defining user experience. Proceedings of the 27th international conference on Human factors in computing systems-CHI 09(2009). DOI:http://dx.doi.org/10.1145/1518701.1518813
John Mccarthy and Peter Wright. 2004. Technology as experience. Interactions 11, 5 (January 2004), 42. DOI:http://dx.doi.org/10.1145/1015530.1015549
Martin Maguire. 2001. Context of Use within usability activities. International Journal of Human-Computer Studies 55, 4 (2001), 453-483. DOI:http://dx.doi.org/ 10.1006/ijhc.2001.0486
Sascha Mahlke and Manfred Thüring. 2007. Studying antecedents of emotional experiences in interactive contexts. Proceedings of the SIGCHI conference on Human factors in computing systems-CHI 07(2007). DOI:http://dx.doi.org/10. 1145/1240624.1240762
Jonathan Maissel, Andrew Dillon, Martin Maguire, Ralph Rengger and Marian Sweeney. 1991. Context Guidelines Handbook. Teddington, UK: National Physical Laboratory. MUSiC Project Deliverable IF2.2.2. Teddington, UK: National Physical Laboratory.
Michael Minge and Laura Riedel. 2013. meCUE-Ein modularer Fragebogen zur Erfassung des Nutzungserlebens. In: S. Boll, S. Maaß& R. Malaka (Hrsg.): Mensch und Computer 2013: Interaktive Vielfalt (S. 89-98). Munchen, Oldenbourg Verlag.
Terhi Mustonen, Maria Olkkonen, and Jukka Hakkinen. 2004. Examining mobile phone text legibility while walking. Extended abstracts of the 2004 conference on Human factors and computing systems-CHI 04(2004). DOI:http://dx.doi.org/ 10.1145/985921.986034
Lennart E. Nacke, Anders Drachen, Kai Kuikkaniemi, Joerg Niesenhaus, Hannu J. Korhonen, Wouter M. van den Hoogen, Karolien Poels, Wijnand A. IJsselsteijn, and Yvonne de Kort. 2009. Playability and Player Experience Research. DiGRA 2009, Breaking New Ground: Innovation in Games, Play, Practice and Theory, Brunel University, United Kingdom.
Alexander Novotny and Christine Bauer. 2017. What Do We Really Talk About WhenWe Talk About Context in Pervasive Computing: A Reviewand Exploratory Analysis. In Proceedings of 19th International Conference on Information Integration and Web-based Applications & Services, Salz-burg, Austria, December 4-6, 2017 (iiWAS '17), 10 pages. https://doi.org/10.1145/3151759.3151760
Charles E. Osgood, George J. Suci, and Percy H. Tannenbaum. 1957. The Measurement of Meaning. Chicago: University of Illinois Press(1957).
Antti Oulasvirta, Sakari Tamminen, Virpi Roto, and Jaana Kuorelahti. 2005. Interaction in 4-second bursts. Proceedings of the SIGCHI conference on Human factors in computing systems-CHI 05(2005). DOI:http://dx.doi.org/10.1145/ 1054972.1055101
Antti Oulasvirta. 2008. Field Experiments in HCI: Promises and Challenges. Future Interaction Design II (2008), 87-116. DOI:http://dx.doi.org/10.1007/978-1-84800-385-9-5
Timo Partala and Aleksi Kallinen. 2012. Understanding the most satisfying and unsatisfying user experiences: Emotions, psychological needs, and context. Interacting with Computers 24, 1 (2012), 25-34. DOI:http://dx.doi.org/10.1016/j. intcom.2011.10.001
Eeva Raita and Antti Oulasvirta. 2011. Too good to be bad: Favorable product expectations boost subjective usability ratings. Interacting with Computers 23, 4 (2011), 363-371. DOI:http://dx.doi.org/10.1016/j.intcom.2011.04.002
Virpi Roto, Effie Law, Arnold Vermeeren, and Jettie Hoonhout. 2011. User Experience White Paper: Bringing clarity to the concept of user experience. Result from Dagstuhl Seminar on Demarcating User Experience, Finland.
Virpi Roto, Web browsing on mobile phones: Characteristics of user experience, Helsinki University of Technology, 2006.
James A. Russell, Anna Weiss, and Gerald A. Mendelsohn. 1989. Affect Grid: A single-item scale of pleasure and arousal. Journal of Personality and Social Psychology 57, 3 (1989), 493-502. DOI:http://dx.doi.org/10.1037/0022-3514.57.3. 493
Richard M. Ryan. 1982. Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. Journal of Personality and Social Psychology 43, 3 (1982), 450-461. DOI:http://dx.doi.org/10.1037//0022-3514.43.3. 450
Andrew Sears, Min Lin, Julie Jacko and Yan Xiao. 2003. When computers fade. pervasive computing and situationally-induced impairments and disabilities, in: Human-Computer Interaction: Theory and Practice, Vol. 2, C. Stephanidis and J.A. Jacko, eds, 2003, pp. 1298-1302.
Andrew Sears, Mark Young, and Jinjuan Feng. 2007. Physical Disabilities and Computing Technologies. The Human-Computer Interaction Handbook Human Factors and Ergonomics (2007), 829-852. DOI:http://dx.doi.org/10.1201/ 9781410615862.ch42
Nora C. Schaeffer and Stanley Presser. 2003. The Science of Asking Questions. Annual Review of Sociology 29, 1 (2003), 65-88. DOI:http://dx.doi.org/10.1146/ annurev.soc.29.110702.110112
Klaus R. Scherer. 2001. Appraisal considered as a process of multi-level sequential checking. In K. R. Scherer, A. Schorr, & T. Johnstone (Eds.), Appraisal processes in emotion: Theory, methods, research (pp. 92-120). New York: Oxford University Press.
Bill N. Schilit, Norman Adams and Roy Want. 1994. Context-aware computing applications, in: Proc. 1stWorkshop on Mobile Computing Systems and Applications (WMCSA 1994), IEEE, 1994, pp. 85-90.
Kennon M. Sheldon, Andrew J. Elliot, Youngmee Kim, and Tim Kasser. 2001. What is satisfying about satisfying events Testing 10 candidate psychological needs. Journal of Personality and Social Psychology 80, 2 (2001), 325-339. DOI:http: //dx.doi.org/10.1037/0022-3514.80.2.325
Paul E. Spector. 1992. Summated rating scale construction: an introduction. Newbury Park, CA: Sage Publisher.
Jared M. Spool. 2005. Putting Context Into Context [Web blog post]. Retrieved from https://articles.uie.com/putting-context-into-context/
Lucy Suchman. 1987. Plans and Situated Actions: the Problem of Human-Machine Communication. New York: Cambridge University Press.
Barbara G. Tabachnick and Linda S. Fidell. 2001. Using multivariate statistics, Boston: Allyn and Bacon.
Alexandre N. Tuch, Rune Trusell, and Kasper Hornbaek. 2013. Analyzing users narratives to understand experience with interactive products. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems-CHI 13(2013). DOI:http://dx.doi.org/10.1145/2470654.2481285
Katarzyna Wac, Selim Ickin, Jin-Hyuk Hong, Lucjan Janowski, Markus Fiedler, and Anind K. Dey. 2011. Studying the experience of mobile applications used in different contexts of daily life. Proceedings of the first ACM SIGCOMM workshop on Measurements up the stack-W-MUST 11(2011). DOI:http://dx.doi.org/10.1145/ 2018602.2018605
DavidWatson, Lee A. Clark, andAuke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology 54, 6 (1988), 1063-1070. DOI:http://dx.doi.org/ 10.1037//0022-3514.54.6.1063
Heli Wigelius and Heli Vaätaja. 2009. Dimensions of context affecting user experience in mobile work, in: Proc. INTERACT 2009, Springer, 2009, pp. 604-617.