Article (Scientific journals)
Understanding students' performance in a computer-based assessment of complex problem solving. An analysis of behavioral data from computer-generated log files.
Greiff, Samuel; Niepel, Christoph; Scherer, Ronny et al.
2016In Computers in Human Behavior, 61, p. 36-46
Peer reviewed
 

Files


Full Text
Greiff_NiepelSchererMartin_2016_CHB.pdf
Publisher postprint (1.21 MB)
Request a copy

All documents in ORBilu are protected by a user license.

Send to



Details



Keywords :
Complex problem solving; Computer-based assessment; Nonlinear relations; Logfile data; Time on task; VOTAT
Abstract :
[en] Computer-based assessments of complex problem solving (CPS) that have been used in international large-scale surveys require students to engage in an in-depth interaction with the problem environment. In this, they evoke manifest sequences of overt behavior that are stored in computer-generated logfiles. In the present study, we explored the relation between several overt behaviors, which N=1476 Finnish ninth-grade students (mean age=15.23,SD=.47 years) exhibited when exploring a CPS environment, and their CPS performance. We used the MicroDYN approach to measure CPS and inspected students' behaviors through log-file analyses. Results indicated that students who occasionally observed the problem environment in a noninterfering way in addition to actively exploring it (noninterfering observation) showed better CPS performance, whereas students who showed a high frequency of (potentially unplanned) interventions (intervention frequency) exhibited worse CPS performance. Additionally, both too much and too little time spent on a CPS task (time on task) was associated with poor CPS performance. The observed effects held after controlling for students' use of an exploration strategy that required a sequence of multiple interventions (VOTAT strategy) indicating that these behaviors exhibited incremental effects on CPS performance beyond the use of VOTAT.
Disciplines :
Theoretical & cognitive psychology
Author, co-author :
Greiff, Samuel ;  University of Luxembourg > Faculty of Language and Literature, Humanities, Arts and Education (FLSHASE) > Education, Culture, Cognition and Society (ECCS)
Niepel, Christoph  ;  University of Luxembourg > Faculty of Language and Literature, Humanities, Arts and Education (FLSHASE) > Education, Culture, Cognition and Society (ECCS)
Scherer, Ronny
Martin, Romain ;  University of Luxembourg > Faculty of Language and Literature, Humanities, Arts and Education (FLSHASE) > Education, Culture, Cognition and Society (ECCS)
External co-authors :
yes
Language :
English
Title :
Understanding students' performance in a computer-based assessment of complex problem solving. An analysis of behavioral data from computer-generated log files.
Publication date :
2016
Journal title :
Computers in Human Behavior
ISSN :
0747-5632
Publisher :
Pergamon Press - An Imprint of Elsevier Science
Volume :
61
Pages :
36-46
Peer reviewed :
Peer reviewed
Available on ORBilu :
since 09 April 2016

Statistics


Number of views
255 (25 by Unilu)
Number of downloads
7 (0 by Unilu)

Scopus citations®
 
94
Scopus citations®
without self-citations
73
OpenCitations
 
77
WoS citations
 
84

Bibliography


Similar publications



Contact ORBilu