Teaching the underlying rules of figural matrices in a short video increases test scores

in Intelligence (2020), 82

Scores of commonly administered intelligence tests such as figural matrices are important correlates of external criteria. However, evidence of improving intelligence test scores through practice or ... [more ▼]

Scores of commonly administered intelligence tests such as figural matrices are important correlates of external criteria. However, evidence of improving intelligence test scores through practice or coaching has been reported. Moreover, information about intelligence tests is widely and easily accessible (e.g., online tutorial videos). An open research question is whether watching such a video increases figural matrices test scores and affects the correlation with other intelligence tests. In two experiments (experiment 1: N = 112 psychology students; experiment 2: N = 229 teacher-education students), students were randomly assigned to either an experimental group that watched a short video (< 14 min) explaining a set of rules underlying figural matrices or a control group that watched a task irrelevant video of comparable duration. Afterwards, both groups worked on figural matrices. Prior to watching the video, all students completed an intelligence test. Results showed (1) substantially higher figural matrices mean test scores in the experimental groups compared to the control groups (d ≥ 1.19) and (2) substantial correlations between figural matrix test scores and intelligence test scores in both the experimental and the control groups. These correlations were of comparable magnitude and did not differ between the groups (experiment 1: r ≈ .55; experiment 2: r ≈ .40). Implications of these findings are discussed. [less ▲]

Why are difficult figural matrices hard to solve? The role of selective encoding and working memory capacity

in Intelligence (2019), 72

It is well documented that figural matrices tests are harder to solve when multiple rules need to be induced because multiple rules are traditionally associated with a greater demand for dynamically ... [more ▼]

It is well documented that figural matrices tests are harder to solve when multiple rules need to be induced because multiple rules are traditionally associated with a greater demand for dynamically managed sub-goals (goal management), which requires more working memory capacity (WMC). The current research addresses the necessity to apply selective encoding as a requirement that goes beyond the ability to manage goals when solving figural matrices. In the first study (N = 38), we found that selective encoding demands are present in items with multiple rules in addition to goal management demands. Furthermore, eye movement data indicated that rule induction was hampered when selective encoding demands were present. The second study (N = 127) de-monstrated that individuals' ability to filter relevant features in working memory was positively related to figural matrices items with selective encoding demands. Moreover, there was no evidence that other sources of WMC are related to goal management in figural matrices. Hence, this study provides preliminary evidence that fil-tering of relevant information in working memory is critical for solving figural matrices with multiple rules and challenges the view that goal management is the only driver of the relationship between WMC and performance in solving figural matrices with multiple rules. [less ▲]

Socioeconomic status amplifies genetic effects in middle childhood in a large German twin sample

in Intelligence (2019), 72

Metacognitive confidence judgments and their link to complex problem solving

in Intelligence (2017)

With the aim to better understand the nature of complex problem solving (CPS), we investigated the link between confidence judgments, which represent a major constituent of metacognitive self-monitoring ... [more ▼]

With the aim to better understand the nature of complex problem solving (CPS), we investigated the link between confidence judgments, which represent a major constituent of metacognitive self-monitoring, and CPS by regressing the two facets of CPS (i.e., knowledge acquisition and knowledge application) on confidence in CPS. To ensure that the link between confidence in CPS and CPS is distinct, we controlled for reasoning, which is the strongest known correlate of CPS. Using structural equation modeling in a sample of 471 German eventh- grade students, we found that confidence in CPS explained 67% of the variance in CPS knowledge acquisition and 55% of the variance in CPS knowledge application. These links were reduced but remained substantial when we controlled for reasoning. The results indicate that confidence judgments as indicators of metacognitive monitoring in CPS are substantially linked to successful CPS, thus bringing us one step closer to a full understanding of CPS. [less ▲]

Construct validity of complex problem solving: A comprehensive view on different facets of intelligence and school grades

in Intelligence (2016), 54

Although Complex Problem Solving (CPS) has attracted increasing amounts of attention in recent years (e.g., PISA study), the role of CPS in the nomological network of intelligence is controversial. The ... [more ▼]

Although Complex Problem Solving (CPS) has attracted increasing amounts of attention in recent years (e.g., PISA study), the role of CPS in the nomological network of intelligence is controversial. The question of whether CPS is a distinct construct is as old as CPS research itself, but previous studies have had specific shortcomings when addressing the question of whether CPS is a separable or independent construct. The aim of the present study was, therefore, to combine the advantages of previous studies to facilitate a less biased view of the relation between CPS and established intelligence constructs. A sample of 227 German university students worked on a comprehensive measure of intelligence (Berlin Intelligence Structure test) and two CPS assessment tools (MicroDYN and MicroFIN). Furthermore, final school grades (GPA) served as an external criterion. We applied confirmatory factor analyses and structural equation modeling to investigate the relation between CPS and established intelligence constructs on the basis of different psychometric approaches (i.e., first-order model, nested factor model). Moreover, we examined the incremental validity of CPS in explaining GPA beyond established intelligence constructs. Results indicate that CPS represents unique variance that is not accounted for by established intelligence constructs. The incremental validity of CPS was found only when a commonly used narrow operationalization of intelligence was applied (i.e., figural reasoning) but not when a broad operationalization was applied. [less ▲]

Intelligence and school grades: A meta-analysis

in Intelligence (2015), 53

Intelligence is considered as the strongest predictor of scholastic achievement. Research as well as educational policy and the society as a whole are deeply interested in its role as a prerequisite for ... [more ▼]

Intelligence is considered as the strongest predictor of scholastic achievement. Research as well as educational policy and the society as a whole are deeply interested in its role as a prerequisite for scholastic success. The present study investigated the population correlation between standardized intelligence tests and school grades employing psychometric meta-analysis (Hunter & Schmidt, 2004). The analyses involved 240 independent samples with 105,185 participants overall. After correcting for sampling error, error of measurement, and range restriction in the independent variable, we found a population correlation of ρ = .54. Moderator analyses pointed to a variation of the relationship between g and school grades depending on different school subject domains, grade levels, the type of intelligence test used in the primary study, as well as the year of publication, whereas gender had no effect on the magnitude of the relationship. [less ▲]

Exploring the relation between speed and ability in complex problem solving

in Intelligence (2015), 48

Gender Differences in the Mean Level, Variability, and Profile Shape of Student Achievement: Results From 41 Countries

in Intelligence (2013), 41(5), 378-395

A domain-specific hierarchical conceptualization of mathematics achievement can be represented by the standard psychometric model in which a single latent dimension accounts for observed individual ... [more ▼]

A domain-specific hierarchical conceptualization of mathematics achievement can be represented by the standard psychometric model in which a single latent dimension accounts for observed individual differences in scores on the respective subdomains (e.g., quantity). Alternatively, a fully hierarchical conceptualization of achievement can be represented by a nested-factor model in which individual differences in subdomain-specific scores are explained by both general student achievement and specific mathematics achievement. The authors applied both models to study the gender similarity hypothesis, the greater male variability hypothesis, and the masking hypothesis, which predicts that gender differences in general student achievement mask gender differences in both the means and the variability of specific mathematics achievement. Representative data were obtained from 275,369 15-year-old students in 41 countries. The results supported these hypotheses in most countries, demonstrating that a fully hierarchical conceptualization of achievement in terms of the nested-factor model significantly contributes to a better understanding of gender differences in the mean level, variability, and shape of students’ achievement profiles. [less ▲]

A multitrait-multimethod study of assessment instruments for Complex Problem Solving

in Intelligence (2013), 41

Complex Problem Solving. More than reasoning?

in Intelligence (2012), 40

This study investigates the internal structure and construct validity of Complex Problem Solving (CPS), which is measured by a Multiple-Item-Approach. It is tested, if (a) three facets of CPS – rule ... [more ▼]

This study investigates the internal structure and construct validity of Complex Problem Solving (CPS), which is measured by a Multiple-Item-Approach. It is tested, if (a) three facets of CPS – rule identification (adequateness of strategies), rule knowledge (generated knowledge) and rule application (ability to control a system) – can be empirically distinguished, how (b) reasoning is related to these CPS-facets and if (c) CPS shows incremental validity in predicting school grade point average (GPA) beyond reasoning. N=222 university students completed Micro-DYN, a computer-based CPS test and Ravens Advanced Progressive Matrices. Analysis including structural equation models showed that a 2-dimensionsal model of CPS including rule knowledge and rule application fitted the data best. Furthermore, reasoning predicted performance in rule application only indirectly through its influence on rule knowledge indicating that learning during system exploration is a prerequisite for controlling a system successfully. Finally, CPS explained variance in GPA even beyond reasoning, showing incremental validity of CPS. Thus, CPS measures important aspects of academic performance not assessed by reasoning and should be considered when predicting real life criteria such as GPA. [less ▲]