Article (Scientific journals)
Lab Testing Beyond Usability: Challenges and Recommendations for Assessing User Experiences
Lallemand, Carine; Koenig, Vincent
2017In Journal of Usability Studies, 12 (3), p. 133-154
Peer reviewed
 

Files


Full Text
JUS_Lallemand_May2017.pdf
Publisher postprint (632.72 kB)
Download

All documents in ORBilu are protected by a user license.

Send to



Details



Keywords :
user experience; user testing; evaluation; laboratory evaluation; psychological needs
Abstract :
[en] In the “third wave” of human-computer interaction (HCI), the advent of the conceptual approach of UX broadens and changes the HCI landscape. Methods approved before, mainly within the conceptual approach of usability, are still widely used, and yet their adequacy for UX evaluation remains uncertain in many applications. Laboratory testing is undoubtedly the most prominent example of such a method. Hence, in this study, we investigated how the more comprehensive and emotional scope of UX can be assessed by laboratory testing. In this paper, we report on a use case study involving 70 participants. They first took part in user/laboratory tests and then were asked to evaluate their experience with the two systems (perceived UX) by filling out an AttrakDiff scale and a UX needs fulfillment questionnaire. We conducted post-test interviews to better understand participants’ experiences. We analyzed how the participants’ perceived UX depends on quantitative (e.g., task completion time, task sequence, level of familiarity with the system) and qualitative aspects (think aloud, debriefing interviews) within the laboratory context. Results indicate that the laboratory setting has a strong impact on the participants’ perceived UX, and support a discussion of the quality and limitations of laboratory evaluations regarding UX assessment. In this paper, we have identified concrete challenges and have provided solutions and tips useful for both practitioners and researchers who seek to account for the subjective, situated, and temporal nature of the UX in their assessments.
Disciplines :
Social & behavioral sciences, psychology: Multidisciplinary, general & others
Engineering, computing & technology: Multidisciplinary, general & others
Author, co-author :
Lallemand, Carine  ;  University of Luxembourg > Faculty of Language and Literature, Humanities, Arts and Education (FLSHASE) > Education, Culture, Cognition and Society (ECCS)
Koenig, Vincent ;  University of Luxembourg > Faculty of Language and Literature, Humanities, Arts and Education (FLSHASE) > Education, Culture, Cognition and Society (ECCS)
External co-authors :
no
Language :
English
Title :
Lab Testing Beyond Usability: Challenges and Recommendations for Assessing User Experiences
Publication date :
May 2017
Journal title :
Journal of Usability Studies
Publisher :
User Experience Professionals Association
Volume :
12
Issue :
3
Pages :
133-154
Peer reviewed :
Peer reviewed
Available on ORBilu :
since 13 June 2017

Statistics


Number of views
993 (24 by Unilu)
Number of downloads
796 (14 by Unilu)

Bibliography


Similar publications



Contact ORBilu