DESIGMA-Standard. Ein distraktorfreier Matrizen-Screening-Test zur Erfassung der allgemeinen Intelligenz

Report (2022)

Lost in transition – Learning analytics on the transfer from knowledge acquisition to knowledge application in complex problem solving

in Computers in Human Behavior (2021), 115

Since Complex Problem Solving (CPS) skills represent a key competence for educational success, they are of great relevance for learning analytics. More specifically, CPS serves as a pertinent showcase for ... [more ▼]

Since Complex Problem Solving (CPS) skills represent a key competence for educational success, they are of great relevance for learning analytics. More specifically, CPS serves as a pertinent showcase for addressing a crucial existing gap contemporary education is facing, the gap between students' ability to acquire and subsequently apply knowledge in uncertain situations, which are increasingly important in the 21st century. While the CPS process incorporates both the acquisition and application of knowledge, many earlier studies have focused on identifying the factors relevant for success in knowledge acquisition. Given the dearth of existing research on factors influencing a successful transition between both CPS phases, we investigated the rates of successful and unsuccessful knowledge transition over the course of nine CPS items in a sample of N = 1151 students in 9th grade. Results showed that many participants were unable to transition their knowledge from the acquisition to the application phase, which was presumably due to an inefficient mental model transfer. Furthermore, the likelihood of students being ‘lost in transition’ was higher in more complex items. Implications are discussed in light of learning analytics, and particularly with regard to the factors to be taken into account by future CPS training programs. [less ▲]

La résolution collaborative de problèmes au Luxembourg : Résultats et implications de l’enquête PISA 2015

in LUCET; SCRIPT (Eds.) Rapport national sur l’éducation au Luxembourg 2021 (2021)

Teaching the underlying rules of figural matrices in a short video increases test scores

in Intelligence (2020), 82

Scores of commonly administered intelligence tests such as figural matrices are important correlates of external criteria. However, evidence of improving intelligence test scores through practice or ... [more ▼]

Scores of commonly administered intelligence tests such as figural matrices are important correlates of external criteria. However, evidence of improving intelligence test scores through practice or coaching has been reported. Moreover, information about intelligence tests is widely and easily accessible (e.g., online tutorial videos). An open research question is whether watching such a video increases figural matrices test scores and affects the correlation with other intelligence tests. In two experiments (experiment 1: N = 112 psychology students; experiment 2: N = 229 teacher-education students), students were randomly assigned to either an experimental group that watched a short video (< 14 min) explaining a set of rules underlying figural matrices or a control group that watched a task irrelevant video of comparable duration. Afterwards, both groups worked on figural matrices. Prior to watching the video, all students completed an intelligence test. Results showed (1) substantially higher figural matrices mean test scores in the experimental groups compared to the control groups (d ≥ 1.19) and (2) substantial correlations between figural matrix test scores and intelligence test scores in both the experimental and the control groups. These correlations were of comparable magnitude and did not differ between the groups (experiment 1: r ≈ .55; experiment 2: r ≈ .40). Implications of these findings are discussed. [less ▲]

Why are difficult figural matrices hard to solve? The role of selective encoding and working memory capacity

in Intelligence (2019), 72

It is well documented that figural matrices tests are harder to solve when multiple rules need to be induced because multiple rules are traditionally associated with a greater demand for dynamically ... [more ▼]

It is well documented that figural matrices tests are harder to solve when multiple rules need to be induced because multiple rules are traditionally associated with a greater demand for dynamically managed sub-goals (goal management), which requires more working memory capacity (WMC). The current research addresses the necessity to apply selective encoding as a requirement that goes beyond the ability to manage goals when solving figural matrices. In the first study (N = 38), we found that selective encoding demands are present in items with multiple rules in addition to goal management demands. Furthermore, eye movement data indicated that rule induction was hampered when selective encoding demands were present. The second study (N = 127) de-monstrated that individuals' ability to filter relevant features in working memory was positively related to figural matrices items with selective encoding demands. Moreover, there was no evidence that other sources of WMC are related to goal management in figural matrices. Hence, this study provides preliminary evidence that fil-tering of relevant information in working memory is critical for solving figural matrices with multiple rules and challenges the view that goal management is the only driver of the relationship between WMC and performance in solving figural matrices with multiple rules. [less ▲]

Using Log-File Data to Uncover Strategy Use in Complex Problem Solving

Scientific Conference (2018, September 18)

The aim of the current project is to utilize log-file data to enhance the understanding of strategy use in Complex Problem Solving (CPS). CPS can be defined as the ability to manipulate the existing ... [more ▼]

The aim of the current project is to utilize log-file data to enhance the understanding of strategy use in Complex Problem Solving (CPS). CPS can be defined as the ability to manipulate the existing variables of a particular novel, complex, intransparent, and dynamic environment successfully in order to reach a predefined goal. In order to successfully solve a CPS task, the goal-directed application and variation of certain strategies is necessary. To uncover the systematic use of these strategies, log-files have been deemed a fruitful resource as they contain not only the final results of a computer-based CPS item, but also the individual steps undertaken while solving such a task. Recent studies using log-files have highlighted the importance of some strategies for CPS, like the varying one variable at a time (VOTAT) strategy, or of engaging in noninterfering observations (i.e., idle rounds). In addition, other strategies have also been shown to be relevant in neighboring fields of CPS. However, comprehensive studies investigating a broad repertoire of strategies applied in CPS are scarce. Hence, on the basis of existing large-scale assessment data sets, the present project set out to investigate which strategies hidden in log-files are relevant for solving a CPS task in order to gain a more thorough understanding of how CPS tasks are being approached. Preliminary findings indicate that, in addition to VOTAT and idle rounds, particularly the flexibility of switching between strategies should be taken into account. [less ▲]

Die Vorhersage von Selbstkontrolle durch Need for Cognition. Generalisierbarkeit und Erklärungsansätze

Scientific Conference (2018, September)

Introducing MaFIN. A dynamic matrices finite state automata test

Scientific Conference (2018, July)

The role of metacognition in low vs high road transfer of complex problem solving skills

Poster (2018)

Is the Correlation between Storage Capacity and Matrix Reasoning Driven by the Storage of Partial Solutions? A Pilot Study of an Experimental Approach

in Journal of Intelligence (2017), 5(2), 21

Working memory capacity (WMC) and reasoning abilities—as assessed by figural matrices tests—are substantially correlated. It is controversially discussed whether this correlation is only caused by ... [more ▼]

Working memory capacity (WMC) and reasoning abilities—as assessed by figural matrices tests—are substantially correlated. It is controversially discussed whether this correlation is only caused by controlled attention or also by storage capacity. This study aims at investigating storage of partial solutions as a possible mechanism by which storage capacity may contribute to solving figural matrices tests. For this purpose, we analyzed how an experimental manipulation of storage demands changes the pattern of correlations between WMC and performance in a matrix task. We manipulated the storage demands by applying two test formats: one providing the externalization of partial solutions and one without the possibility of externalization. Storage capacity was assessed by different types of change detection tasks. We found substantial correlations between storage capacity and matrices test performance, but they were of comparable size for both test formats. We take this as evidence that the necessity to store partial solutions is not the limiting factor which causes the association between storage capacity and matrices test. It is discussed how this approach can be used to investigate alternative mechanisms by that storage may influence performance in matrices tests. [less ▲]