References of "Sonnleitner, Philipp 50003122"
     in
Bookmark and Share    
Peer Reviewed
See detailAssessing Mathematical Competencies within the Luxembourgish School Monitoring Program: Covering the range from 1st to 9th grade.
Sonnleitner, Philipp UL; Gamo, Sylvie UL; Hornung, Caroline UL et al

Scientific Conference (2014, April)

As a direct reaction to alarmingly poor student performance in PISA, like many other European countries Luxembourg started to establish a very ambitious school monitoring program: the Épreuves ... [more ▼]

As a direct reaction to alarmingly poor student performance in PISA, like many other European countries Luxembourg started to establish a very ambitious school monitoring program: the Épreuves Standardisées (ÉpStan). One of the core competencies that are measured is, of course, mathematical achievement. Beginning with grade 1 and continued in grade 3 and grade 9, students’ proficiency in several mathematical sub-competencies is assessed. Students have to demonstrate their mathematical problem solving skills in theoretical as well as applied contexts. This design not only allows for tracking individual students’ development of mathematical abilities but also allows for a better understanding of factors that influence this process ̶ a rich and valuable source for the determination of risk factors and the implementation of individual support programs. However, due to the early beginning of this comprehensive program and the heterogeneity of Luxembourg’s students in terms of cultural background and spoken language, several challenges arise, especially for test development. We will present and discuss the theoretical framework of mathematical competencies that is assessed within the ÉpStan and we will show how we are currently using possibilities of computer-based assessment and test design in order to respond to these challenges. [less ▲]

Detailed reference viewed: 118 (35 UL)
Peer Reviewed
See detailGender differences in mathematics achievement in 3rd and 9th grade students: A large-scale study in Luxembourg.
Gamo, Sylvie UL; Sonnleitner, Philipp UL; Hornung, Caroline UL et al

Poster (2014, March 30)

Since 2009, ÉpStan (Épreuves Standardisées) is an annual large-scale study in Luxembourg. It aims to evaluate Luxembourg's school system, in particular students’ achieved competency level in mathematics ... [more ▼]

Since 2009, ÉpStan (Épreuves Standardisées) is an annual large-scale study in Luxembourg. It aims to evaluate Luxembourg's school system, in particular students’ achieved competency level in mathematics implemented in 3rd and 9th grade. The present study aims to investigate whether the existing gender gap in mathematics among 15-year-olds revealed by PISA 2012 can be confirmed in ÉpStan 9th grade and if it already exists in younger students’ mathematics performance (ÉpStan 3rd grade) (Robinson, & Theule Lubienski, 2011). Further, we study wether a gender gap in students’ drive, motivation and self-beliefs concerning mathematics performance exists. [less ▲]

Detailed reference viewed: 105 (9 UL)
Full Text
See detailItem Development and Test Compilation
Sonnleitner, Philipp UL; Reichert, Monique UL; Ugen, Sonja UL

in Fischbach, Antoine; Ugen, Sonja; Martin, Romain (Eds.) ÉpStan Technical Report (2014)

Detailed reference viewed: 70 (10 UL)
Full Text
Peer Reviewed
See detailDifferential relations between facets of complex problem solving and students’ immigration background
Sonnleitner, Philipp UL; Brunner, Martin; Keller, Ulrich UL et al

in Journal of Educational Psychology (2014), Advance online publication

Whereas the assessment of complex problem solving (CPS) has received increasing attention in the context of international large-scale assessments, its fairness in regard to students’ cultural background ... [more ▼]

Whereas the assessment of complex problem solving (CPS) has received increasing attention in the context of international large-scale assessments, its fairness in regard to students’ cultural background has gone largely unexplored. On the basis of a student sample of ninth-graders (N = 299), including a representative number of immigrant students (N = 127), the present study evaluated (1) whether CPS can be assessed fairly among students with or without immigration background and (2) whether achievement differences between these groups exist. Results showed that fair assessment of CPS is possible using the Genetics Lab, a computer-based microworld that incorporates game-like characteristics and multilingual-friendly features. Immigrant students were generally outperformed by their non-immigrant peers, but performance differences can largely be explained by differential enrollment in lower academic tracks. Interestingly, CPS scales were less affected by students’ educational background than a traditional paper-pencil-based reasoning scale. Moreover, a fine-grained analysis of different facets of CPS showed that irrespective of the academic track, immigrant students demonstrated a more efficient task exploration behavior than their native peers (d = .26). In sum, this might point to the potential of computer-based assessment of CPS to identify otherwise hidden cognitive potential in immigrant students. [less ▲]

Detailed reference viewed: 178 (33 UL)
Full Text
See detailUnterschiede zwischen Schulformen und das Pilotprojekt PROCI
Keller, Ulrich UL; Sonnleitner, Philipp UL; Villanyi, Denise UL et al

in SCRIPT; EMACS (Eds.) PISA 2012. Nationaler Bericht Luxemburg (2013)

Detailed reference viewed: 77 (10 UL)
Full Text
Peer Reviewed
See detailStudents’ Complex Problem-Solving Abilities: Their Structure and Relations to Reasoning Ability and Educational Success
Sonnleitner, Philipp UL; Keller, Ulrich UL; Martin, Romain UL et al

in Intelligence (2013), 41(5), 289-305

Complex Problem Solving (CPS) is considered to be a promising candidate for capturing higher order thinking skills that are emphasized in new educational curricula but are not adequately measured by ... [more ▼]

Complex Problem Solving (CPS) is considered to be a promising candidate for capturing higher order thinking skills that are emphasized in new educational curricula but are not adequately measured by traditional intelligence tests. However, little is known about its psychometric structure and its exact relation to intelligence and educational success—especially in student populations. This study is among the first to use a large and representative sample of secondary school students (N = 563) to examine different measurement models of CPS—that conceptualize the construct as either faceted or hierarchical—and their implications for the construct’s validity. Results showed that no matter which way it was conceptualized, CPS was substantially related to reasoning and to different indicators of educational success. Controlling for reasoning within a joint hierarchical measurement model, however, revealed that the impressive external validity was largely attributable to the variance that CPS shares with reasoning, suggesting that CPS has only negligible incremental validity over and above traditional intelligence scales. On the basis of these results, the value of assessing CPS within the educational context is discussed. [less ▲]

Detailed reference viewed: 179 (23 UL)
Full Text
Peer Reviewed
See detailGender Differences in the Mean Level, Variability, and Profile Shape of Student Achievement: Results From 41 Countries
Brunner, Martin; Gogol, Katarzyna UL; Sonnleitner, Philipp UL et al

in Intelligence (2013), 41(5), 378-395

A domain-specific hierarchical conceptualization of mathematics achievement can be represented by the standard psychometric model in which a single latent dimension accounts for observed individual ... [more ▼]

A domain-specific hierarchical conceptualization of mathematics achievement can be represented by the standard psychometric model in which a single latent dimension accounts for observed individual differences in scores on the respective subdomains (e.g., quantity). Alternatively, a fully hierarchical conceptualization of achievement can be represented by a nested-factor model in which individual differences in subdomain-specific scores are explained by both general student achievement and specific mathematics achievement. The authors applied both models to study the gender similarity hypothesis, the greater male variability hypothesis, and the masking hypothesis, which predicts that gender differences in general student achievement mask gender differences in both the means and the variability of specific mathematics achievement. Representative data were obtained from 275,369 15-year-old students in 41 countries. The results supported these hypotheses in most countries, demonstrating that a fully hierarchical conceptualization of achievement in terms of the nested-factor model significantly contributes to a better understanding of gender differences in the mean level, variability, and shape of students’ achievement profiles. [less ▲]

Detailed reference viewed: 113 (9 UL)
Full Text
Peer Reviewed
See detailUsing Complex Problem Solving Simulations for General Cognitive Ability Assessment: the Genetics Lab Framework
Mayer, Hélène; Hazotte, Cyril; Djaghloul, Younes et al

in International Journal of Information Science and Intelligent System (2013), 2(4), 71-88

This paper presents the conception and operation of “the Genetics Lab,” a research platform designed for general intelligence measurement. This tool has been developed and refined to measure cognitive ... [more ▼]

This paper presents the conception and operation of “the Genetics Lab,” a research platform designed for general intelligence measurement. This tool has been developed and refined to measure cognitive skills of students in Luxembourg, Thanks to its generic and clear architecture, “the Genetics Lab” makes a major contribution by addressing technical weaknesses and flaws met with tools previously used to assess intelligence. This new platform can be used as groundwork for other evaluation solutions. In this paper, we explore in depth the main fields of e-assessment such as instructions, localized and multilingual content production and display, traces, and scoring. We also describe how the platform was put into action to create complex simulations and to make data collection resulting from the user’s test a flawless process. This paper is a continuation and extension of earlier work. [less ▲]

Detailed reference viewed: 120 (11 UL)
Peer Reviewed
See detailThe Genetics Lab: A case study on computer-based assessment within a multilingual sample of „digital natives“
Sonnleitner, Philipp UL; Brunner, Martin; Keller, Ulrich UL et al

Scientific Conference (2013)

Computer-based assessment forms a key aspect of educational curricula and international student assessment studies like PISA. Today’s students, however, place special demands on assessment instruments ... [more ▼]

Computer-based assessment forms a key aspect of educational curricula and international student assessment studies like PISA. Today’s students, however, place special demands on assessment instruments used within this context. Multilingual samples with often considerably varying experience in technology use tend to become more and more common in most European countries. Taking the Genetics Lab—a computer-based problem solving scenario—as example, the presented case study evaluates how these challenges can be met by the adaptation of the test construction process, the development of interactive and multimedia instructions, and the integration of game-like characteristics. Psychometric properties, especially measurement invariance of the Genetics Lab’s performance scales are discussed on base of a multilingual and heterogeneous sample of 563 Luxembourgish students. As the Genetics Lab is freely available on the internet, an outlook is given on possible future applications to gather further experience with computer-based assessment within multilingual samples. [less ▲]

Detailed reference viewed: 78 (2 UL)
Full Text
See detailLuxemburger Schülerinnen und Schüler im internationalen Vergleich
Böhm, Bettina; Fischbach, Antoine UL; Ugen, Sonja UL et al

in SCRIPT; EMACS (Eds.) PISA 2012. Nationaler Bericht Luxemburg (2013)

Detailed reference viewed: 119 (12 UL)
Full Text
Peer Reviewed
See detailA multitrait-multimethod study of assessment instruments for Complex Problem Solving
Greiff, Samuel UL; Fischer, Andreas; Wüstenberg, Sascha UL et al

in Intelligence (2013), 41

Detailed reference viewed: 223 (50 UL)
See detailGenetics Lab scoring algorithm
Keller, Ulrich UL; Sonnleitner, Philipp UL

Software (2012)

Detailed reference viewed: 113 (8 UL)
Full Text
Peer Reviewed
See detailThe Genetics Lab. Acceptance and psychometric characteristics of a computer-based microworld to assess Complex Problem Solving
Sonnleitner, Philipp UL; Brunner, Martin; Greiff, Samuel UL et al

in Psychological Test and Assessment Modeling (2012), 54

Computer-based problem solving scenarios or “microworlds” are contemporary assessment instruments frequently used to assess students’ complex problem solving behavior – a key aspect of today’s educational ... [more ▼]

Computer-based problem solving scenarios or “microworlds” are contemporary assessment instruments frequently used to assess students’ complex problem solving behavior – a key aspect of today’s educational curricula and assessment frameworks. Surprisingly, almost nothing is known about their (1) acceptance or (2) psychometric characteristics in student populations. This article introduces the Genetics Lab (GL), a newly developed microworld, and addresses this lack of empirical data in two studies. Findings from Study 1, with a sample of 61 ninth graders, show that acceptance of the GL was high and that the internal consistencies of the scores obtained were satisfactory. In addition, meaningful intercorrelations between the scores supported the instrument’s construct validity. Study 2 drew on data from 79 ninth graders in differing school types. Large to medium correlations with figural and numerical reasoning scores provided evidence for the instrument’s construct validity. In terms of external validity, substantial correlations were found between academic performance and scores on the GL, most of which were higher than those observed between academic performance and the reasoning scales administered. In sum, this research closes an important empirical gap by (1) proving acceptance of the GL and (2) demonstrating satisfactory psychometric properties of its scores in student populations. [less ▲]

Detailed reference viewed: 337 (36 UL)
Full Text
See detailThe Genetics Lab_Theoretical background & psychometric evaluation
Sonnleitner, Philipp UL; Brunner, Martin; Keller, Ulrich UL et al

Report (2012)

Detailed reference viewed: 203 (4 UL)
Full Text
See detailUser’s guide to apply, configure and adapt the Genetics Lab
Sonnleitner, Philipp UL; Mayer, Hélène; Keller, Ulrich UL et al

E-print/Working paper (2012)

Detailed reference viewed: 47 (2 UL)
Peer Reviewed
See detailIntelligence as assessed by modern computer-based problem solving scenarios
Sonnleitner, Philipp UL; Brunner, Martin; Keller, Ulrich UL et al

Scientific Conference (2012)

Computer-based problem solving scenarios—so-called microworlds—have often been suggested as promising alternative assessment instruments of intelligence. Potential benefits compared to traditional paper ... [more ▼]

Computer-based problem solving scenarios—so-called microworlds—have often been suggested as promising alternative assessment instruments of intelligence. Potential benefits compared to traditional paper-pencil tests involve tracking of students’ mental representations of the problems as well as their problem solving strategies by means of behavioral data. Though, it is still topic of ongoing debate whether the skills assessed by such microworlds are distinct from or identical to the construct of intelligence as measured by conventional reasoning tests. To address this issue, we thoroughly investigated construct and incremental validity of a recently developed microworld, the Genetics Lab (Sonnleitner et. al, 2011). We obtained data from a multilingual and representative Luxembourgish student sample (N = 563) who completed the Genetics Lab and 3 reasoning scales of an established intelligence test battery. Results of a Confirmatory Factor Analysis suggest that the construct assessed by the Genetics Lab is largely identical to the construct of intelligence as measured by traditional reasoning scales. Incremental validity was found with respect to the performance in a national assessment of students’ competencies and performance in the PISA study of 2009. Thus, the notion of microworlds to be a valuable measure of intelligence is supported. [less ▲]

Detailed reference viewed: 59 (1 UL)
Peer Reviewed
See detailNon‐cognitive vs. cognitive predictors for academic success –opportunities and limits of self‐assessments illustrated by the Viennese products
Kubinger, K. D.; Weitensfelder, Lisbeth; Frebort, Martina et al

Scientific Conference (2012)

Detailed reference viewed: 27 (0 UL)