References of "Lehnert, Florence Kristin 50033306"
     in
Bookmark and Share    
Full Text
Peer Reviewed
See detailExperimenter Effects in Children Using the Smileyometer Scale
Lehnert, Florence Kristin UL; Lallemand, Carine UL; Fischbach, Antoine UL et al

Scientific Conference (2020, November 19)

Researchers in the social sciences like human-computer interaction face novel challenges concerning the development of methods and tools for evaluating interactive technology with children. One of these ... [more ▼]

Researchers in the social sciences like human-computer interaction face novel challenges concerning the development of methods and tools for evaluating interactive technology with children. One of these challenges is related to the validity and reliability of user experience measurement tools. Scale designs, like the Smileyometer, have been proven to contain biases such as the tendency for children to rate almost every technology as great. This explorative paper discusses a possible effect of two experimenter styles on the distribution of 6-8 years old pupils' ratings (N= 73) to the Smileyometer. We administered the scale before and after a tablet-based assessment in two schools. Experimenter 1 employed a child-directed speech compared to a monotone speech of Experimenter 2. While brilliant (5 out of 5) was the most frequent answer option in all conditions, the mean scores were higher and associated with a lower variability across both conditions for Experimenter 2. We discuss a possible experimenter effect in the Smileyometer and implications for evaluating children’s user experiences. [less ▲]

Detailed reference viewed: 119 (5 UL)
See detailHow do pupils experience Technology-Based Assessments? Implications for methodological approaches to measuring the User Experience based on two case studies in France and Luxembourg
Lehnert, Florence Kristin UL; Lallemand, Carine UL; Fischbach, Antoine UL et al

Scientific Conference (2020, November 12)

Technology-based assessments (TBAs) are widely used in the education field to examine whether the learning goals were achieved. To design fair and child-friendly TBAs that enable pupils to perform at ... [more ▼]

Technology-based assessments (TBAs) are widely used in the education field to examine whether the learning goals were achieved. To design fair and child-friendly TBAs that enable pupils to perform at their best (i.a. independent of individual differences in computer literacy), we must ensure reliable and valid data collection. By reducing Human-Computer Interaction issues, we provide the best possible assessment conditions and user experience (UX) with the TBA and reduce educational inequalities. Good UX is thus a prerequisite for better data validity. Building on a recent case study, we investigated how pupils perform TBAs in real-life settings. We addressed the context-dependent factors resulting from the observations that ultimately influence the UX. The first case study was conducted with pupils age 6 to 7 in three elementary schools in France (n=61) in collaboration with la direction de l’évaluation, de la prospective et de la performance (DEPP). The second case study was done with pupils age 12 to 16 in four secondary schools in Luxembourg (n=104) in collaboration with the Luxembourg Centre for Educational Testing (LUCET). This exploratory study focused on the collection of various qualitative datasets to identify factors that influence the interaction with the TBA. We also discuss the importance of teachers’ moderation style and mere system-related characteristics, such as audio protocols of the assessment data. This study contribution comprises design recommendations and implications for methodological approaches to measuring pupils’ user experience during TBAs. [less ▲]

Detailed reference viewed: 70 (5 UL)
Full Text
See detailUser Experience challenges for designing and evaluating Computer-Based Assessments for children
Lehnert, Florence Kristin UL

in Proceedings of IDC '19, the 18th ACM International Conference on Interaction Design and Children (2019, June 12)

Computer-Based Assessment (CBA), i.e., the use of computers instead of paper & pencil for testing purposes is now increasingly used, both in education and in the workforce. Along with this trend, several ... [more ▼]

Computer-Based Assessment (CBA), i.e., the use of computers instead of paper & pencil for testing purposes is now increasingly used, both in education and in the workforce. Along with this trend, several issues regarding the usage of computers in assessment can be raised. With respect to CBA, test validity and acceptance appear at stake during interacting with a complex assessment system. For instance, individual differences in computer literacy (i.e. ability to handle technology) might cause different outcomes that are not related to the problem-solving task. Prior investigation has shown that there is a scarcity of research on the User Experience (UX) in the context of CBA, also due to a focus on adult users. This doctoral thesis aims to adapt and develop new evaluation methods from the Human-Computer Interaction (HCI) field, applied in the context of CBA. The contributions will result in the development of best practices guidelines for both research and practitioners by adopting design and evaluation methods drawn from the field of Child-computer Interaction (CCI). [less ▲]

Detailed reference viewed: 165 (8 UL)