Complex Problem Solving in educational settings – something beyond g: Concept, assessment, measurement invariance, and construct validity

in Journal of Educational Psychology (2013), 105

Innovative assessments of cross-curricular competencies such as complex problem solving (CPS) have currently received considerable attention in large-scale educational studies. This study investigated the ... [more ▼]

Innovative assessments of cross-curricular competencies such as complex problem solving (CPS) have currently received considerable attention in large-scale educational studies. This study investigated the nature of CPS by applying a state-of-the-art approach to assess CPS in high school. We analyzed whether two processes derived from cognitive psychology, knowledge acquisition and knowledge application, could be measured equally well across grades and how these processes differed between grades. Further, relations between CPS, general mental ability (g), academic achievement, and parental education were explored. Hungarian high school students in Grades 5 to 11 (N 855) completed MicroDYN, which is a computer-based CPS test, and the Culture Fair Test 20-R as a measure of g. Results based on structural equation models showed that empirical modeling of CPS was in line with theories from cognitive psychology such that the two dimensions identified above were found in all grades, and that there was some development of CPS in school, although the Grade 9 students deviated from the general pattern of development. Finally, path analysis showed that CPS was a relevant predictor of academic achievement over and above g. Overall, results of the current study provide support for an understanding of CPS as a cross-curricular skill that is accessible through computer-based assessment and that yields substantial relations to school performance. Thus, the increasing attention CPS has currently received on an international level seems warranted given its high relevance for educational psychologists. [less ▲]

Prediction of students’ performance on test taking processes in Complex Problem Solving

Scientific Conference (2012, July)

A modern understanding of Complex Problem Solving.

Scientific Conference (2012, July)

Measurement invariance of Complex Problem Solving ability measured by MicroDYN

Scientific Conference (2012, April 24)

Complex Problem Solving. More than reasoning?

in Intelligence (2012), 40

This study investigates the internal structure and construct validity of Complex Problem Solving (CPS), which is measured by a Multiple-Item-Approach. It is tested, if (a) three facets of CPS – rule ... [more ▼]

This study investigates the internal structure and construct validity of Complex Problem Solving (CPS), which is measured by a Multiple-Item-Approach. It is tested, if (a) three facets of CPS – rule identification (adequateness of strategies), rule knowledge (generated knowledge) and rule application (ability to control a system) – can be empirically distinguished, how (b) reasoning is related to these CPS-facets and if (c) CPS shows incremental validity in predicting school grade point average (GPA) beyond reasoning. N=222 university students completed Micro-DYN, a computer-based CPS test and Ravens Advanced Progressive Matrices. Analysis including structural equation models showed that a 2-dimensionsal model of CPS including rule knowledge and rule application fitted the data best. Furthermore, reasoning predicted performance in rule application only indirectly through its influence on rule knowledge indicating that learning during system exploration is a prerequisite for controlling a system successfully. Finally, CPS explained variance in GPA even beyond reasoning, showing incremental validity of CPS. Thus, CPS measures important aspects of academic performance not assessed by reasoning and should be considered when predicting real life criteria such as GPA. [less ▲]

Die Bedeutung übergreifender kognitiver Determinanten für die Bewältigung beruflicher Anforderungen. Untersuchung am Beispiel dynamischen und technischen Problemlösens

in Zeitschrift für Erziehungswissenschaft (2012), 15

Im Zentrum des Beitrags steht die Bedeutung und Prognosekraft dynamischer Problemlösekompetenz (DPK) für das Kriterium der technischen Problemlöseleistung. Als weitere Prädiktoren wurden in der ... [more ▼]

Im Zentrum des Beitrags steht die Bedeutung und Prognosekraft dynamischer Problemlösekompetenz (DPK) für das Kriterium der technischen Problemlöseleistung. Als weitere Prädiktoren wurden in der Untersuchung fluide Intelligenz und technisches Fachwissen berücksichtigt. Die Integration fluider Intelligenz ermöglichte auch eine Untersuchung der Frage, ob sich DKP von fluider Intelligenz unterscheiden lässt. Die auf einer Kfz-Mechatroniker- und Elektronikerstichprobe (n = 129, n = 88) basierenden Analysen belegten die empirische Eigenständigkeit der DKP gegenüber fluider Intelligenz. In der Elektronikerstichprobe erklärte DKP die technische Problemlöseleistung am besten, wobei fluide Intelligenz darüber hinaus inkrementelle Validität zeigte. Bei den Kfz-Mechatronikern korrelierte nur fluide Intelligenz mit dem Kriterium, allerdings schwach. Wurde Fachwissen einbezogen, verschwand sowohl die Bedeutung der DKP als auch fluider Intelligenz. Allerdings übte bei den Elektronikern fluide Intelligenz einen über Wissen vermittelten indirekten Einfluss auf das Kriterium aus. Die nicht ganz eindeutige Befundlage, stichprobenspezifische Unterschiede sowie theoretische Ansätze zur Erklärung der beobachteten Effekte werden diskutiert. [less ▲]

Measuring adults' dynamic problem solving competency

Scientific Conference (2011, September)

Dynamic systems and their importance in competence assessment of problem solving

Scientific Conference (2011, September)

Dynamic problem solving competency: More than intelligence?

Scientific Conference (2011, July 05)

Measuring a cross-curricular skill: competence models and construct validity of dynamic problem solving

Scientific Conference (2011, April 07)