A need for cognition scale for children and adolescents: Structural analysis and measurement invariance

in European Journal of Psychological Assessment (2019), 35

Need for Cognition (NFC) signifies “the tendency for an individual to engage in and enjoy thinking” (Cacioppo & Petty, 1982, p. 116). Up to now, no scale of sufficient psychometric quality existed to ... [more ▼]

Need for Cognition (NFC) signifies “the tendency for an individual to engage in and enjoy thinking” (Cacioppo & Petty, 1982, p. 116). Up to now, no scale of sufficient psychometric quality existed to assess NFC in children. Using data from three independent, diverse cross-sectional samples from Germany, Luxembourg, and Finland, we examined the psychometric properties of a new NFC scale intended to fill in this gap. In all samples, across grades levels ranging from 1 to 9, confirmatory factor analysis confirmed the hypothesized nested factor structure based on Mussel’s (2013) Intellect model, with one general factor Think influencing all items and two specific factors Seek and Conquer each influencing a subset of items. At least partial scalar measurement invariance with regard to grade level and sex could be demonstrated. The scale exhibited good psychometric properties and showed convergent and discriminant validity with an established NFC scale and other non-cognitive traits such as academic self-concept and interests. It incrementally predicted mostly statistically significant but relatively small portions of academic achievement variance over and above academic self-concept and interest. Implications for research on the development of NFC and its role as an investment trait in intellectual development are discussed. [less ▲]

On the importance of educational tests

in European Journal of Psychological Assessment (2019), 35

Dimensional and Social Comparisons Effects on Domain-Specific Self-Concepts and Interests: A Study of Elementary School Children from Luxembourg Across Two Waves

Scientific Conference (2018, November 09)

Already at the beginning of elementary school, students start to develop self-beliefs and attitudes that reflect their motivation, thoughts, and feelings about a specific school domain. The internal ... [more ▼]

Already at the beginning of elementary school, students start to develop self-beliefs and attitudes that reflect their motivation, thoughts, and feelings about a specific school domain. The internal/external frame of reference (I/E) model (Marsh, 1986) encapsulates this phenomenon by explicating the formation of academic self-concept through a combination of social (i.e. comparing one’s achievement in one domain with the achievement of one’s peers in the same domain) and dimensional (i.e. comparing one’s achievement in one domain with one’s achievement in another domain) comparison processes. The recently established generalized internal/external frame of reference (GI/E) model (Möller, Müller-Kalthoff, Helm, Nagy, & Marsh, 2015) builds on the I/E model by extending it to the formation of other subject-specific academic self-beliefs and attitudes, such as interest and test anxiety. Despite the salience of the (G)I/E model in educational research, studies investigating the formation of self-beliefs and attitudes according to this model remains scarce among elementary school children. This study aims to contribute to the current literature by examining the associations between verbal and mathematics achievement, on the one hand, and corresponding domain-specific self-concepts and interests, on the other hand. A population of Luxembourgish elementary school students was assessed twice, two years apart (once in Grade 1 and once in Grade 3) as part of the Luxembourgish school monitoring system (EpStan, cohorts 2014 & 2016; epstan.lu). Using a domain-specific approach, students were assessed on math and verbal achievement as well as German- and math self-concept and interest. This culminated in a sample of N = 3606 elementary school children who participated in both waves. German- and math self-concepts and interests were self-reported whereas standardized achievement tests (see epstan.lu) were used as indicators of math and verbal (Luxembourgish for Grade 1 and German for Grade 3) achievement. Cross-lagged structural equation modelling was performed in Mplus 8 using WLSMV estimation for categorical variables. Overall, the results suggest strong support for the (G)I/E model for Grade 3, while only partial support was found for the (G)I/E model for Grade 1. More specifically, for both Grade 1 and Grade 3, achievement was positively related to self-concept and interest within the same domain. Negative relations between achievement and self-concept and interest across domains were found in Grade 3, but not in Grade 1. The findings are discussed within the context of theory and research on self-concept differentiation processes, dimensional comparison theory, and the multilingual Luxembourgish educational system. [less ▲]

Replicating and extending the GI/E model: Social and dimensional comparison effects of achievement on test anxiety in math, physics, German, and English

Scientific Conference (2018, November 09)

The internal/external frame of reference model (I/E model; Marsh, 1986) depicts the formation of academic self-concept by assuming an interplay of social and dimensional comparison processes within and ... [more ▼]

The internal/external frame of reference model (I/E model; Marsh, 1986) depicts the formation of academic self-concept by assuming an interplay of social and dimensional comparison processes within and across different domains. Associations between achievement and self-concept are expected to be positive within one given domain due to social comparisons (i.e., external frame of reference) and negative across different domains due to dimensional comparisons (i.e., internal frame of reference). The Generalized I/E model (GI/E model; Möller, Müller-Kalthoff, Helm, Nagy, & Marsh, 2015) allows for the inclusion of other outcome variables besides academic self-concept, for example, interest or motivation. The present research aimed at applying the GI/E model to the construct of test anxiety, thereby replicating and significantly extending some first supportive findings on the validity of the GI/E model with test anxiety (Arens, Becker, & Möller, 2017). To this end, we expanded the scope of the GI/E model with test anxiety for the first time to four domains; namely math, physics, German, and English. For this purpose, we drew on a sample of N = 305 9th and 10th graders attending the highest ability school track (i.e., Gymnasium) from six different secondary schools in four German federal states. Analyses were carried out using structural equation modelling in Mplus 8. We used school grades in the respective domains as achievement indicators. Test anxiety was assessed separately for each domain while simultaneously differentiating between two components of test anxiety; namely, worry and emotionality. Our results suggested negative within-domain relations between achievement and test anxiety in all four domains (i.e., higher grades were associated with less test anxiety). The pattern of results for the relations across domains was not as clear. Positive links between achievement and test anxiety across domains (i.e., higher grades in domain A were associated with higher test anxiety in domain B) were weak and could only be established for the association between German achievement and students’ worry in mathematics. These findings partially supported the assumptions made by the GI/E model. As such, we replicated preexisting findings and added novel insights to the GI/E model. Our results were discussed within the framework of self-concept theory and research as well as dimensional comparison theory. [less ▲]

Using Log-File Data to Uncover Strategy Use in Complex Problem Solving

Scientific Conference (2018, September 18)

The aim of the current project is to utilize log-file data to enhance the understanding of strategy use in Complex Problem Solving (CPS). CPS can be defined as the ability to manipulate the existing ... [more ▼]

The aim of the current project is to utilize log-file data to enhance the understanding of strategy use in Complex Problem Solving (CPS). CPS can be defined as the ability to manipulate the existing variables of a particular novel, complex, intransparent, and dynamic environment successfully in order to reach a predefined goal. In order to successfully solve a CPS task, the goal-directed application and variation of certain strategies is necessary. To uncover the systematic use of these strategies, log-files have been deemed a fruitful resource as they contain not only the final results of a computer-based CPS item, but also the individual steps undertaken while solving such a task. Recent studies using log-files have highlighted the importance of some strategies for CPS, like the varying one variable at a time (VOTAT) strategy, or of engaging in noninterfering observations (i.e., idle rounds). In addition, other strategies have also been shown to be relevant in neighboring fields of CPS. However, comprehensive studies investigating a broad repertoire of strategies applied in CPS are scarce. Hence, on the basis of existing large-scale assessment data sets, the present project set out to investigate which strategies hidden in log-files are relevant for solving a CPS task in order to gain a more thorough understanding of how CPS tasks are being approached. Preliminary findings indicate that, in addition to VOTAT and idle rounds, particularly the flexibility of switching between strategies should be taken into account. [less ▲]

Collaborative problem solving assessment in PISA 2015. Can computer agents replace humans? In F. Zehner & L. Khorramdel (Eds.), Collaborative problem solving. Standardized assessment at the large scale

Scientific Conference (2018, September)

Problem solving and its role in large-scale assessments. Transversal skills in educational research

Scientific Conference (2018, September)

Der Zusammenhang zwischen Facetten komplexer Problemlösefähigkeit, fluider Intelligenz und Arbeitsgedächtniskapazität. Eine umfassende Überprüfung der „different demands“-Hypothese

Scientific Conference (2018, September)

Introducing MaFIN. A dynamic matrices finite state automata test

Scientific Conference (2018, July)

Towards a multifaceted framework of complex problem solving

Scientific Conference (2018, July)