![]() Hornung, Caroline ![]() ![]() ![]() Report (2023) Luxembourg’s student population is highly diverse in terms of language and family background and shows disparities in learning performances as early as first grade (Cycle 2.1). Achievement gaps might be ... [more ▼] Luxembourg’s student population is highly diverse in terms of language and family background and shows disparities in learning performances as early as first grade (Cycle 2.1). Achievement gaps might be increased by the high language demands in the traditional Luxembourgish school system. Early Childhood Education and Care (ECEC) including for instance crèche, précoce and Cycle 1, is one of the possible mechanisms to reduce these gaps that is currently discussed by researchers, policy makers, and the broad public. A lot of international literature points towards a positive association of ECEC and child development. However, findings vary widely with characteristics of ECEC, as well as characteristics of children and their families. For this report, we used data from the Luxembourg School Monitoring Programme “ÉpStan” from 2015 to 2021 including students’ learning performances in three domains in Cycle 2.1 – Luxembourgish listening comprehension, early literacy, mathematics – as well as student and parent questionnaire data. Additionally, data from ÉpStan 2022 on German and Luxembourgish listening comprehension and students’ language exposure at home are presented. Who attends which type of ECEC in Luxembourg? We find that the attendance in ECEC is generally high. On average, crèches were attended at a moderate level of intensity and duration. Family background (socioeconomic status, migration background and home language group) interacts in a complex way with attendance in ECEC. For example, children from families with a high socioeconomic status speaking Portuguese or French at home, attended crèche for more hours a week than children from families with a high socioeconomic status speaking Luxembourgish at home. In regard to language exposure in ECEC, Luxembourgish appears to play a dominant role for most children. How are ECEC attendance and family background associated with learning performance in Cycle 2.1? Most importantly, non-formal (crèche) and formal types of ECEC (précoce, Cycle 1) have positive but small to moderate associations with learning performance in the three learning domains. Looking at crèche attendance in more detail, effects of crèche intensities are different for Portuguese speaking and Luxembourgish speaking children – i.e., only Portuguese speaking children benefit from higher intensity attendance in crèche. As can be expected, all children benefit most in their Luxembourgish listening comprehension if they attended a crèche in which Luxembourgish was spoken. Well-known performance disparities in the three learning domains between children of different backgrounds have been confirmed – with advantages for native, Luxembourgish speaking children from higher socioeconomic backgrounds. Is the pattern of differences between children of different home language groups the same in Luxembourgish and German listening comprehension? Children’s performances in German listening comprehension show even larger disparities between home language groups than those in Luxembourgish listening comprehension. This argues against the assumption of a transfer from Luxembourgish to German language skills for all children. Conclusively, this report points towards ECEC as a key adjustable parameter to improve learning development and concludes with the call to collect data on ECEC quality. Structural (e.g., child-caregiver-ratio) and procedural (e.g., characteristics of interaction) aspects of quality should be regulated and systematically evaluated to ensure positive child development and equal opportunities for every child. With more monitoring data on diverse quality aspects and language practices in ECEC, important insights on the effects of new reforms in the educational system could be gained. Additionally, the present results reveal a significant negative relationship between children’s learning performance and a previous allongement de cycle in Cycle 1, calling for a thorough revision of this frequently used procedure. Finally, the continuity between languages in ECEC and the successive schooling is important. This alignment is currently not ensured due to more flexible language policies in ECEC and more rigid language practices in formal schooling. For example, the plurilingual education in ECEC promoting Luxembourgish and French, could build a solid basis for a French literacy acquisition, yet explicit promotion of the current instruction language of reading and writing acquisition, German, in Cycle 2 is still missing. A crucial demand therefore arises to revise the language demands in the curricula and policies – to continuously support ECEC’s plurilingual education in formal schooling (e.g., European and international schools or French literacy acquisition) and to explicitly promote German in ECEC to build a solid basis for literacy acquisition in German. [less ▲] Detailed reference viewed: 202 (44 UL)![]() ![]() Inostroza Fernandez, Pamela Isabel ![]() ![]() ![]() Scientific Conference (2023, April 14) Today’s educational field has a tremendous hunger for valid and psychometrically sound items to reliably track and model students’ learning processes. Educational large-scale assessments, formative ... [more ▼] Today’s educational field has a tremendous hunger for valid and psychometrically sound items to reliably track and model students’ learning processes. Educational large-scale assessments, formative classroom assessment, and lately, digital learning platforms require a constant stream of high-quality, and unbiased items. However, traditional development of test items ties up a significant amount of time from subject matter experts, pedagogues and psychometricians and might not be suited anymore to nowadays demands. Salvation is sought in automatic item generation (AIG) which provides the possibility of generating multiple items within a short period of time based on the development of cognitively sound item templates by using algorithms (Gierl, Lay & Tanygin, 2021). Using images or other pictorial elements in math assessment – e.g. TIMSS (Trends in International Mathematics and Science (TIMSS, Mullis et al 2009) and Programme for International Student Assessment (PISA, OECD 2013) – is a prominent way to present mathematical tasks. Research on using images in text items show ambiguous results depending on their function and perception (Hoogland et al., 2018; Lindner et al. 2018; Lindner 2020). Thus, despite the high importance, effects of image-based semantic embeddings and their potential interplay with cognitive characteristics of items are hardly studied. The use of image-based semantic embeddings instead of mainly text-based items will increase though, especially in contexts with highly heterogeneous student language backgrounds. The present study psychometrically analyses cognitive item models that were developed by a team of national subject matter experts and psychometricians and then used for algorithmically producing items for the mathematical domain of numbers & operations for Grades 1, 3, and 5 of the Luxembourgish school system. Each item model was administered in 6 experimentally varied versions to investigate the impact of a) the context the mathematical problem was presented in, and b) problem characteristics which cognitive psychology identified to influence the problem solving process. Based on samples from Grade 1 (n = 5963), Grade 3 (n = 5527), and Grade 5 (n = 5291) collected within the annual Épreuves standardisées, this design allows for evaluating whether psychometric characteristics of produced items per model are a) stable, b) can be predicted by problem characteristics, and c) are unbiased towards subgroups of students (known to be disadvantaged in the Luxembourgish school system). The developed cognitive models worked flawlessly as base for generating item instances. Out of 348 generated items, all passed ÉpStan quality criteria which correspond to standard IRT quality criteria (rit > .25; outfit >1.2). All 24 cognitive models could be fully identified either by cognitive aspects alone, or a mixture of cognitive aspects and semantic embeddings. One model could be fully described by different embeddings used. Approximately half of the cognitive models could fully explain all generated and administered items from these models, i.e. no outliers were identified. This remained constant over all grades. With the exemption of one cognitive model, we could identify those cognitive factors that determined item difficulty. These factors included well known aspects, such as, inverse ordering, tie or order effects in additions, number range, odd or even numbers, borrowing/ carry over effects or number of elements to be added. Especially in Grade 1, the chosen semantic embedding the problem was presented in impacted item difficulty in most models (80%). This clearly decreased in Grades 3, and 5 pointing to older students’ higher ability to focus on the content of mathematical problems. Each identified factor was analyzed in terms of subgroup differences and about half of the models were affected by such effects. Gender had the most impact, followed by self-concept and socioeconomic status. Interestingly those differences were mostly found for cognitive factors (23) and less for factors related to the embedding (6). In sum, results are truly promising and show that item development based on cognitive models not only provides the opportunity to apply automatic item generation but to also create item pools with at least approximately known item difficulty. Thus, the majority of developed cognitive models in this study could be used to generate a huge number of items (> 10.000.000) for the domain of numbers & operations without the need for expensive field-trials. A necessary precondition for this is the consideration of the semantic embedding the problems are presented in, especially in lower Grades. It also has to be stated that modeling in Grade 1 was more challenging due to unforeseen interactions and transfer effects between items. We will end our presentation by discussing lessons learned from models where prediction was less successful and highlighting differences between the Grades. [less ▲] Detailed reference viewed: 48 (9 UL)![]() ![]() Emslander, Valentin ![]() ![]() Scientific Conference (2023, March 01) THEORETISCHER HINTERGRUND Gute Beziehungen zur eigenen Lehrerin können sich positiv auf den Erfolg eines Schülers auswirken. Dieser Effekt kann mit Bowlby’s (1982) Bindungstheorie erklärt werden und wird ... [more ▼] THEORETISCHER HINTERGRUND Gute Beziehungen zur eigenen Lehrerin können sich positiv auf den Erfolg eines Schülers auswirken. Dieser Effekt kann mit Bowlby’s (1982) Bindungstheorie erklärt werden und wird empirisch immer wieder gestützt (z.B. Hamre & Pianta, 2001). Positive Lehrer-Schüler-Beziehungen zeichnen sich durch emotionale Wärme und Nähe aus; negative Aspekte durch Konflikt und Abhängigkeit. So stehen positive Lehrer-Schüler-Beziehungen nicht nur mit akademischen Leistungen in Verbindung, sondern auch mit einer Vielzahl anderer, wünschenswerter Schülerentwicklungen. Zahlreiche Meta-Analysen deuten auf signifikante Zusammenhänge zwischen Lehrer-Schüler-Beziehungen und schulischem Engagement, guten Beziehungen zu Gleichaltrigen, exekutiven Funktionen, allgemeinem Wohlbefinden und der Verringerung aggressiver oder störender Verhaltensweisen hin (Endedijk et al., 2021; Nurmi, 2012; Roorda et al., 2017; Vandenbroucke et al., 2018). Diese Befunde sind jedoch weit verstreut in der Literatur, sodass Forschungslücken unentdeckt bleiben. Auch unterscheiden sich bisherige Überblicksarbeiten in ihren Methoden und den gefundenen Zusammenhängen zwischen Lehrer-Schüler-Beziehungen und Ergebnisvariablen von Schüler*innen. Darüber hinaus ist die Literatur uneindeutig, welche Moderatoren (z.B. Alter oder Geschlecht) diese Beziehungen beeinflussen. Gleichzeitig variiert die Qualität der Meta-Analysen in diesem Feld merklich, was die Interpretation ihrer Ergebnisse erschweren kann. FRAGESTELLUNG Angesichts dieser Forschungslücken haben wir die meta-analytische Literatur systematisch durchsucht und zusammengefasst (Cooper & Koenka, 2012), um einen Überblick über Korrelate von Lehrer-Schüler-Beziehungen zu schaffen. Hierbei untersuchten wir drei Forschungsfragen 1. Inwieweit hängen akademische, verhaltensbezogene, sozio-emotionale, motivationale und kognitive Schülereigenschaften mit Lehrer-Schüler-Beziehungen in der meta-analytischen Literatur zusammen? 2. Welche Moderatoren beeinflussen diese Zusammenhänge? 3. Welche methodische Qualität haben die einbezogenen Meta-Analysen? METHODE Um diese Forschungsfragen zu beantworten, analysierten wir 24 Meta-Analysen, die rund 130 Effektstärken für über eine Million Schüler*innen umfassten. Nach der Präregistrierung erfolgte eine systematische Literatursuche. Während mehrerer Runden der Überprüfung mithilfe unserer Ein- und Ausschlusskriterien identifizierten wir 24 passende Meta-Analysen. Aus diesen Meta-Analysen extrahierten wir die Effektstärken zum Zusammenhang von Lehrer-Schüler-Beziehungen und akademische, verhaltensbezogene, sozio-emotionale, motivationale und allgemeine kognitive Schülereigenschaften. Für die Forschungsfragen 1 und 2 haben wir die Ergebnisse zusammengefasst und einen narrativen Überblick erarbeitet. Für Forschungsfrage 3 bewerteten wir die Qualität der Meta-Analysen mit Hilfe der AMSTAR-2 Skala (angepasst an korrelative Studien in der Psychologie und Bildungsforschung; Shea et al., 2017). ERGEBNISSE UND IHRE BEDEUTUNG Mit Blick auf die Lehrer-Schüler-Beziehungen werden unterschiedliche Ergebnisvariablen analysiert (Forschungsfrage 1). Die stärksten Zusammenhänge zeigten sich für Konflikt und Abhängigkeit in der Lehrer-Schüler-Beziehung mit Verhaltensproblemen der Schüler*innen (r = .35 bis .57; Nurmi, 2012). Positive Lehrer-Schüler-Beziehungen zeigte die stärkste Verbindung mit der Beteiligung in der Schule (r = .26 bis .34; Roorda et al., 2011), prosozialem, externalisierendem und internalisierendem Verhalten (r = .25; Endedijk et al., 2021) sowie mit Lernmotivation in Kombination mit Beteiligung der Schüler*innen (r = .23; Wang et al., 2020). Alter oder Klassenstufe waren die am häufigsten untersuchten Moderatoren mit teilweise gegenläufigen Befunden (Forschungsfrage 2). Geschlechterunterschiede wurden dagegen seltener festgestellt. Gleichzeitig wurde der Effekt der Informationsquelle häufig untersucht, d.h., ob und auf welche Weise Lehrkräfte, Gleichaltrige oder die Schüler*innen selbst die Lehrer-Schüler-Beziehung bewerteten. Für Forschunsgfrage 3 diskutieren wir die Qualitätsunterschiede der Meta-Analysen. Mit dem systematischen Review von Meta-Analysen fassen wir die Forschungslandschaft zu Korrelaten von Lehrer-Schüler-Beziehungen zusammen und zeigen, in welchem Zusammenhang diese mit Lehrer-Schüler-Beziehungen stehen. Unseren Ergebnissen folgend sollten Lehrkräfte für die Wirkung von Lehrer-Schüler-Beziehungen und deren Zusammenhängen sensibilisiert werden. Einige Interventionen zur Verbesserung von dieser wichtigen Beziehungen wurden bereits meta-analytisch mit vielversprechende Ergebnissen untersucht (Kincade et al., 2020). Ein nächster Schritt ist nun die experimentelle Überprüfung der gefundenen Korrelate, um positive Lehrer-Schüler-Beziehungen als wirksame Strategie zur Verbesserung von akademischen, verhaltensbezogenen, sozio-emotionalen, motivationalen und kognitiven Schülereigenschaften kausal zu bestätigen. LITERATUR Bowlby, J. (1982). Attachment and loss: Vol. 1. Attachment. (2nd ed., Vol. 1). Basic Books. Cooper, H., & Koenka, A. C. (2012). The overview of reviews: Unique challenges and opportunities when research syntheses are the principal elements of new integrative scholarship. American Psychologist, 67(6), 446–462. https://doi.org/10.1037/a0027119 Decristan, J., Kunter, M., & Fauth, B. (2022). Die Bedeutung individueller Merkmale und konstruktiver Unterstützung der Lehrkraft für die soziale Integration von Schülerinnen und Schülern im Mathematikunterricht der Sekundarstufe. Zeitschrift für Pädagogische Psychologie, 36(1–2), 85–100. https://doi.org/10.1024/1010-0652/a000329 Endedijk, H. M., Breeman, L. D., van Lissa, C. J., Hendrickx, M. M. H. G., den Boer, L., & Mainhard, T. (2021). The Teacher’s Invisible Hand: A Meta-Analysis of the Relevance of Teacher–Student Relationship Quality for Peer Relationships and the Contribution of Student Behavior. Review of Educational Research, 003465432110514. https://doi.org/10.3102/00346543211051428 Givens Rolland, R. (2012). Synthesizing the Evidence on Classroom Goal Structures in Middle and Secondary Schools: A Meta-Analysis and Narrative Review. Review of Educational Research, 82(4), 396–435. https://doi.org/10.3102/0034654312464909 Hamre, B. K., & Pianta, R. C. (2001). Early Teacher-Child Relationships and the Trajectory of Children’s School Outcomes through Eighth Grade. Child Development, 72(2), 625–638. https://doi.org/10.1111/1467-8624.00301 Kincade, L., Cook, C., & Goerdt, A. (2020). Meta-Analysis and Common Practice Elements of Universal Approaches to Improving Student-Teacher Relationships. Review of Educational Research, 90(5), 710–748. https://doi.org/10.3102/0034654320946836 Korpershoek, H., Harms, T., de Boer, H., van Kuijk, M., & Doolaard, S. (2016). A Meta-Analysis of the Effects of Classroom Management Strategies and Classroom Management Programs on Students’ Academic, Behavioral, Emotional, and Motivational Outcomes. Review of Educational Research, 86(3), 643–680. https://doi.org/10.3102/0034654315626799 Lei, H., Cui, Y., & Chiu, M. M. (2016). Affective Teacher—Student Relationships and Students’ Externalizing Behavior Problems: A Meta-Analysis. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.01311 Nurmi, J.-E. (2012). Students’ characteristics and teacher–child relationships in instruction: A meta-analysis. Educational Research Review, 7(3), 177–197. https://doi.org/10.1016/j.edurev.2012.03.001 Roorda, D. L., Jak, S., Zee, M., Oort, F. J., & Koomen, H. M. Y. (2017). Affective Teacher–Student Relationships and Students’ Engagement and Achievement: A Meta-Analytic Update and Test of the Mediating Role of Engagement. School Psychology Review, 46(3), 239–261. https://doi.org/10.17105/SPR-2017-0035.V46-3 Roorda, D. L., Koomen, H. M. Y., Spilt, J. L., & Oort, F. J. (2011). The Influence of Affective Teacher–Student Relationships on Students’ School Engagement and Achievement: A Meta-Analytic Approach. Review of Educational Research, 81(4), 493–529. https://doi.org/10.3102/0034654311421793 Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., & Henry, D. A. (2017). AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ, j4008. https://doi.org/10.1136/bmj.j4008 Vandenbroucke, L., Spilt, J., Verschueren, K., Piccinin, C., & Baeyens, D. (2018). The Classroom as a Developmental Context for Cognitive Development: A Meta-Analysis on the Importance of Teacher–Student Interactions for Children’s Executive Functions. Review of Educational Research, 88(1), 125–164. https://doi.org/10.3102/0034654317743200 Wang, M.-T., L. Degol, J., Amemiya, J., Parr, A., & Guo, J. (2020). Classroom climate and children’s academic and psychological wellbeing: A systematic review and meta-analysis. Developmental Review, 57, 100912. https://doi.org/10.1016/j.dr.2020.100912 [less ▲] Detailed reference viewed: 55 (2 UL)![]() ![]() Pit-Ten Cate, Ineke ![]() ![]() ![]() Scientific Conference (2023, February 28) Detailed reference viewed: 47 (1 UL)![]() van der Westhuizen, Lindie ![]() ![]() in Contemporary Educational Psychology (2023) Detailed reference viewed: 24 (1 UL)![]() Emslander, Valentin ![]() in PLoS ONE (2022), 17(12), 0279255 Value-added (VA) models are used for accountability purposes and quantify the value a teacher or a school adds to their students’ achievement. If VA scores lack stability over time and vary across outcome ... [more ▼] Value-added (VA) models are used for accountability purposes and quantify the value a teacher or a school adds to their students’ achievement. If VA scores lack stability over time and vary across outcome domains (e.g., mathematics and language learning), their use for high-stakes decision making is in question and could have detrimental real-life implications: teachers could lose their jobs, or a school might receive less funding. However, school-level stability over time and variation across domains have rarely been studied together. In the present study, we examined the stability of VA scores over time for mathematics and lan- guage learning, drawing on representative, large-scale, and longitudinal data from two cohorts of standardized achievement tests in Luxembourg (N = 7,016 students in 151 schools). We found that only 34–38% of the schools showed stable VA scores over time with moderate rank correlations of VA scores from 2017 to 2019 of r = .34 for mathematics and r = .37 for language learning. Although they showed insufficient stability over time for high-stakes decision making, school VA scores could be employed to identify teaching or school practices that are genuinely effective—especially in heterogeneous student populations. [less ▲] Detailed reference viewed: 47 (4 UL)![]() ![]() Pit-Ten Cate, Ineke ![]() ![]() Scientific Conference (2022, December 05) Research question: The current study aimed to investigate the influence of student and school level factors on school tracking in secondary education. We were especially interested in the association ... [more ▼] Research question: The current study aimed to investigate the influence of student and school level factors on school tracking in secondary education. We were especially interested in the association between student characteristics and school composition in Grade 3 and school track in Grade 9. Data source: Data were collected as part of the Luxembourg school monitoring programme “Épreuves Standardisées” (ÉpStan; Fischbach et al., 2014). The study cohort include all students enrolled in the Luxembourg public education system in Grade 3 in November 2013 combined with data from the same students in Grade 9 in November 2017-2019 for students following advanced or regular educational pathways, completed with data from November 2020 and 2021 for students that repeated once or twice (N≈3600). Theoretical approach: The study draws upon theoretical frameworks and empirical findings (e.g., Boudon, 1974; Bourdieu, 1984), that have demonstrated students´ socio-demographic characteristics are associated with (dis)advantages for specific groups of students in education systems as well as more recent work focusing on school composition (e.g., Baumert et al., 2006), especially as tracked school systems are known to be prone to social segregation (e.g., Hadjar & Gross, 2016). To date, most research on school segregation in tracked education systems such as Luxembourg has focused on individual student´s characteristics. However, with increasing heterogeneity of student cohorts and known differences in educational opportunities related to the social and ethnic composition of the school’s student body (e.g., Thrupp et al., 2002), the current research extents the existing literature by considering both individual (including prior academic achievement and socio-demographic characteristics) and school level factors (mean academic level and percentage of students from lower socio-economic and migration background) in predicting school track placement. Main findings: Results of a multilevel random effect logistic regression analysis in which we estimated marginal effects on the probability to be placed in the highest, middle or lowest track in Luxembourg show that even after controlling for student´s academic achievement, track placement is affected by the gender and socio-economic background of the student, whereby boys and students from low SES families have less chance to be placed in the highest track. The association with socio-economic background is not only visible on the student level but also on school level, whereby students attending primary schools with a higher percentage of low SES families have less chance to be orientated to the higher track compared to the middle track, regardless of the student´ individual academic performance. [less ▲] Detailed reference viewed: 131 (15 UL)![]() Kaufmann, Lena Maria ![]() ![]() ![]() Poster (2022, November 10) For decades, researchers have been raising awareness of the issue of educational inequalities in the multilingual Luxemburgish school system. Especially children from families with a migration background ... [more ▼] For decades, researchers have been raising awareness of the issue of educational inequalities in the multilingual Luxemburgish school system. Especially children from families with a migration background or a lower socio-economic status show large deficits in their language and mathematics competences in comparison to their peers. The same applies to children who do not speak Luxemburgish or German as their first language (Hornung et al., 2021; Sonnleitner et al., 2021). One way to reduce such educational inequalities might be an early and extensive participation in early childhood education and care (ECEC). Indeed, participation in ECEC was found to be positively connected to language and cognitive development in other countries, especially for children from disadvantaged families (Bennett, 2012). However, these children attend ECEC less often (Vandenbroeck & Lazzari, 2014). There are indications that lower parental costs might go hand in hand with a greater attendance of ECEC in general (for a Luxembourgish study, see Bousselin, 2019) and in particular by disadvantaged families (Busse & Gathmann, 2020). The aim of this study is to spotlight the attendance of ECEC in Luxembourg during the implementation of the ECEC reform after 2017 which increased free ECEC hours for all families from 3 to 20 hours a week. We draw on a large dataset of about 35.000 children from the Épreuves Standardisées (ÉpStan, the Luxemburg school monitoring programme) from 2015 to 2021 and investigate which children attend any kind of regulated ECEC service (public, private or family daycare) in which intensity, taking socio-economic and cultural family factors into account. The findings might help to understand in which contexts ECEC attendance should be further encouraged. Implications for future policy decisions are discussed with the goal of further promoting equal educational opportunities for all children. [less ▲] Detailed reference viewed: 60 (6 UL)![]() Emslander, Valentin ![]() ![]() ![]() Poster (2022, November 10) In such a diverse context as Luxembourg, educational inequalities can arise from diverse languages spoken at home, a migration background, or a family’s socioeconomic status. This diversity leads to ... [more ▼] In such a diverse context as Luxembourg, educational inequalities can arise from diverse languages spoken at home, a migration background, or a family’s socioeconomic status. This diversity leads to different preconditions for learning math and languages (e.g. the language of instruction) and thus shapes the school careers of students (Hadjar & Backes, 2021). The aim of the project Systematic Identification of High Value-Added in Educational Contexts (SIVA) was to answer the questions (1) what highly effective schools are doing “right” or differently and (2) what other schools can learn from them in alleviating inequalities. In collaboration with the Observatoire National de la Qualité Scolaire, we investigated the differences of schools with stable high value-added (VA) scores to those with stable medium or low VA scores from multiple perspectives. VA is a statistical regression method usually used to fairly estimate schools’ effectiveness considering diverse student backgrounds. First, we identified 16 schools which had a stable high, medium, or low VA scores over two years. Second, we collected data on their pedagogical strategies, student background, and school climate through questionnaires and classroom observations. Third, we matched our data to results from the Luxembourg School Monitoring Programme ÉpStan (LUCET, 2021). We selected the variables based on learning models focusing on aspects such as school organization or classroom management (e.g., Hattie, 2008; Helmke et al., 2008; Klieme et al., 2001). We further investigated specificities about the Luxembourgish school system, which are not represented in international school learning models (such as the division into two-year learning cycles, the multilingual school setting, or the diverse student population). We will discuss the SIVA-project, its goals, and its data collection leading to data from observations in 49 classroom and questionnaires with over 500 second graders, their parents, their teachers, as well as school presidents and regional directors. Literature Hadjar, A., & Backes, S. (2021). Bildungsungleichheiten am Übergang in die Sekundarschule in Luxemburg. https://doi.org/10.48746/BB2021LU-DE-21A Hattie, J. (2008). Visible Learning: A synthesis of over 800 meta-analyses relating to achievement (0 ed.). Routledge. https://doi.org/10.4324/9780203887332 Helmke, A., Rindermann, H., & Schrader, F.-W. (2008). Wirkfaktoren akademischer Leistungen in Schule und Hochschule [Determinants of academic achievement in school and university]. In M. Schneider & M. Hasselhorn (Eds.), Handbuch der pädagogischen Psychologie (Vol. 10, pp. 145–155). Hogrefe. Klieme, E., Schümer, G., & Knoll, S. (2001). Mathematikunterricht in der Sekundarstufe I: “Aufgabenkultur” und Unterrichtsgestaltung. TIMSS - Impulse für Schule und Unterricht, 43–57. LUCET. (2021). Épreuves Standardisées (ÉpStan). https://epstan.lu [less ▲] Detailed reference viewed: 36 (7 UL)![]() ![]() Emslander, Valentin ![]() ![]() Scientific Conference (2022, November 09) Especially in diverse educational settings, positive relationships between students and their teachers can foster students’ learning and help alleviate systematic inequalities. Characterized by emotional ... [more ▼] Especially in diverse educational settings, positive relationships between students and their teachers can foster students’ learning and help alleviate systematic inequalities. Characterized by emotional warmth or closeness, positive teacher-student relationships (TSR) can improve several student outcomes. For instance, existing meta-analyses suggest significant links between TSR and students’ peer relations, school engagement, academic achievement, emotions, executive functions, general well-being, and reductions in aggressive or disruptive behaviors. However, the evidence on these links is scattered, and a comprehensive overview of the associations with TSR integrating academic, behavioral, socio-emotional, motivational, and general cognitive outcomes is lacking. Furthermore, researchers have been unequivocal about possible moderators, such as how these relationships vary with student age or gender. In light of these research gaps, we systematically reviewed the meta-analytic literature and examined (a) the extent to which academic, behavioral, socio-emotional, motivational, and general cognitive student outcomes are related to TSR in the meta-analytic literature; (b) which moderators influence this association; and (c) the methodological quality of the included meta-analyses. We included meta-analyses with preschool or K-12 samples in our dataset which reported some measure of the relation between TSR and student outcomes. With this dataset, we systematically mapped the evidence on (a) the TSR-outcome relationship; (b) the moderators; and (c) the methodological quality of the meta-analyses. We will present our core findings and discuss future research with this second-order, meta-analytic dataset and the impact of positive TSR in diverse and heterogeneous settings. [less ▲] Detailed reference viewed: 72 (6 UL)![]() ![]() Pit-Ten Cate, Ineke ![]() ![]() Scientific Conference (2022, November 09) Known as a highly stratified education system with early tracking (similar to Dutch, German, Austrian, and German-speaking Swiss systems), Luxembourg features additional properties that add to its ... [more ▼] Known as a highly stratified education system with early tracking (similar to Dutch, German, Austrian, and German-speaking Swiss systems), Luxembourg features additional properties that add to its complexity in the educational realm (Backes & Hadjar, 2017). It is a simultaneously multilingual system that also has the largest share of students born outside of Luxembourg or parents born abroad. While most migrants come from within Europe, they frequently come from either a particularly high or low socio-economic background. It has been scientifically established that the educational inequalities in Luxembourg are driven mostly by social origin and immigration/language background. Gender is another critical dimension of disadvantage; for example, boys are less motivated to obtain higher education than girls (Hadjar, Scharf, & Hascher, 2021). In addition, gender often intersects with other factors such as immigrant background in shaping disadvantages. However, evidence shows that – beyond individual background characteristics – schools’ social composition also perpetuates inequalities in student achievement (Martins & Veiga, 2010). Therefore, we focus on the role of school-level segregation on student’s academic outcomes over time using data of a longitudinal cohort from the School Monitoring Programme (Éprueve Standardisée (ÉpStan)) with 5097 students in Grade 3 observed in 2013 and later in Grade 9 observed in 2019 (regular pathways) and 2020 and 2021 (irregular pathways, i.e., class repetitions). School segregation is an aggregate measure of the proportion of students who belong to low socio-economic background and the proportion of students born abroad and/or do not speak instruction language at home. Our contribution aims to provide insights into the following questions: 1. Does school-level segregation in primary education (G3) predict student’s track placement in secondary education? 2. Does school-level segregation in primary education (G3) predict student’s math and German achievement in secondary education (G9)? 3. How strongly are achievement outcomes in G9 correlated with within- and between-track segregation in G9? The findings will serve as a complementary base for tailored policy making with respect to the long-term impact of school composition for teaching and learning, especially within a tracked school system. References Becker, S., & Hadjar, A. (2017). Educational trajectories through secondary education in Luxembourg: How does permeability affect educational inequalities? Schweizerische Zeitschrift Für Bildungswissenschaften, 39(3), 437–460. https://doi.org/10.25656/01:16659 Hadjar, A., Scharf, J., & Hascher, T. (2021). Who aspires to higher education? Axes of inequality, values of education and higher education aspirations in secondary schools in Luxembourg and the Swiss Canton of Bern. European Journal of Education, 56(1), 9–26. https://doi.org/10.1111/ejed.12435 Martins, L., & Veiga, P. (2010). Do inequalities in parents’ education play an important role in PISA students’ mathematics achievement test score disparities? Economics of Education Review, 29(6), 1016–1033. https://doi.org/10.1016/j.econedurev.2010.05.001 [less ▲] Detailed reference viewed: 91 (10 UL)![]() ![]() Michels, Michael Andreas ![]() ![]() ![]() Scientific Conference (2022, November) Today’s educational field has a tremendous hunger for valid and psychometrically sound items to reliably track and model students’ learning processes. Educational large-scale assessments, formative ... [more ▼] Today’s educational field has a tremendous hunger for valid and psychometrically sound items to reliably track and model students’ learning processes. Educational large-scale assessments, formative classroom assessment, and lately, digital learning platforms require a constant stream of high-quality, and unbiased items. However, traditional development of test items ties up a significant amount of time from subject matter experts, pedagogues and psychometricians and might not be suited anymore to nowadays demands. Salvation is sought in automatic item generation (AIG) which provides the possibility of generating multiple items within a short period of time based on the development of cognitively sound item templates by using algorithms (Gierl & Haladyna, 2013; Gierl et al., 2015). The present study psychometrically analyses 35 cognitive item models that were developed by a team of national subject matter experts and psychometricians and then used for algorithmically producing items for the mathematical domain of numbers & shapes for Grades 1, 3, 5, and 7 of the Luxembourgish school system. Each item model was administered in 6 experimentally varied versions to investigate the impact of a) the context the mathematical problem was presented in, and b) problem characteristics which cognitive psychology identified to influence the problem solving process. Based on samples from Grade 1 (n = 5963), Grade 3 (n = 5527), Grade 5 (n = 5291), and Grade 7 (n = 3018) collected within the annual Épreuves standardisées, this design allows for evaluating whether psychometric characteristics of produced items per model are a) stable, b) can be predicted by problem characteristics, and c) are unbiased towards subgroups of students (known to be disadvantaged in the Luxembourgish school system). After item calibration using the 1-PL model, each cognitive model was analyzed in-depth by descriptive comparisons of resulting IRT parameters, and the estimation of manipulated problem characteristics’ impact on item difficulty by using the linear logistic test model (LLTM, Fischer, 1972). Results are truly promising and show negligible effects of different problem contexts on item difficulty and reasonably stable effects of altered problem characteristics. Thus, the majority of developed cognitive models could be used to generate a huge number of items (> 10.000.000) for the domain of numbers & operations with known psychometric properties without the need for expensive field-trials. We end with discussing lessons learned from item difficulty prediction per model and highlighting differences between the Grades. References: Fischer, G. H. (1973). The linear logistic test model as an instrument in educational research. Acta Psychologica, 36, 359-374. Gierl, M. J., & Haladyna, T. M. (Eds.). (2013). Automatic item generation: Theory and practice. New York, NY: Routledge. Gierl, M. J., Lai, H., Hogan, J., & Matovinovic, D. (2015). A Method for Generating Educational Test Items That Are Aligned to the Common Core State Standards. Journal of Applied Testing Technology, 16(1), 1–18. [less ▲] Detailed reference viewed: 176 (7 UL)![]() Levy, Jessica ![]() ![]() in Educational Assessment, Evaluation and Accountability (2022) There is no final consensus regarding which covariates should be used (in addition to prior achievement) when estimating value-added (VA) scores to evaluate a school’s effectiveness. Therefore, we ... [more ▼] There is no final consensus regarding which covariates should be used (in addition to prior achievement) when estimating value-added (VA) scores to evaluate a school’s effectiveness. Therefore, we examined the sensitivity of evaluations of schools’ effectiveness in math and language achievement to covariate selection in the applied VA model. Four covariate sets were systematically combined, including prior achievement from the same or different domain, sociodemographic and sociocultural background characteristics, and domain-specific achievement motivation. School VA scores were estimated using longitudinal data from the Luxembourg School Monitoring Programme with some 3600 students attending 153 primary schools in Grades 1 and 3. VA scores varied considerably, despite high correlations between VA scores based on the different sets of covariates (.66 < r < 1.00). The explained variance and consistency of school VA scores substantially improved when including prior math and prior language achievement in VA models for math and prior language achievement with sociodemographic and sociocultural background characteristics in VA models for language. These findings suggest that prior achievement in the same subject, the most commonly used covariate to date, may be insufficient to control for between-school differences in student intake when estimating school VA scores. We thus recommend using VA models with caution and applying VA scores for informative purposes rather than as a mean to base accountability decisions upon. [less ▲] Detailed reference viewed: 28 (6 UL)![]() Fischbach, Antoine ![]() ![]() ![]() E-print/Working paper (2022) Detailed reference viewed: 58 (12 UL)![]() ![]() ; ; Fischbach, Antoine ![]() Scientific Conference (2022, April 21) Academic achievement profiles affect students’ further development, i.e., by informing educational and professional choices. However, there is a lack of knowledge on the mechanisms behind the development ... [more ▼] Academic achievement profiles affect students’ further development, i.e., by informing educational and professional choices. However, there is a lack of knowledge on the mechanisms behind the development of academic profiles. For research on cognitive ability profiles, specifically differentiation processes, statistical tools have been developed. In the present article, we transfer these methods for differentiation research to academic achievement data. We examine differentiation depending on students’ general level of achievement and grade level in a large Luxembourgish student sample. Students’ achievements in German, French, and Math were assessed within the Luxembourg school monitoring program. We found more balanced academic profiles with increasing achievement level. We further found more balanced profiles with increasing grade level and a positive interaction effect. [less ▲] Detailed reference viewed: 86 (0 UL)![]() Rohles, Björn ![]() ![]() ![]() in Heliyon (2022), 8(4), Learning and assessment are increasingly mediated by digital technologies. Thus, learners’ experiences with these digital technologies are growing in importance, as they might affect learning and ... [more ▼] Learning and assessment are increasingly mediated by digital technologies. Thus, learners’ experiences with these digital technologies are growing in importance, as they might affect learning and assessment. The present paper explores the impact of user experience on digital concept mapping. It builds on user experience theory to explain variance in the intention to use digital concept mapping tools and in concept map-based assessment scores. Furthermore, it identifies fulfillment of psychological needs as an important driver of positive experiences. In a field study in three schools and a university (N = 71), we tested two concept mapping prototypes on computers and tablets. We found that user experience is a significant factor explaining variance in intention to use. User experience also explained variance in three out of four concept mapping scores on tablets, potentially related to the lower pragmatic quality of the tablet prototypes. Fulfillment of psychological needs strongly affected perceptions of different qualities of user experience with digital concept mapping. These results indicate that user experience needs to be considered in digital concept mapping to provide a positive and successful environment for learning and assessment. Finally, we discuss implications for designers of digital learning and assessment tools. [less ▲] Detailed reference viewed: 58 (7 UL)![]() Emslander, Valentin ![]() ![]() Report (2022) The relationships between students and their teachers can impact students’ learning and development. Characterized by emotional warmth or closeness, positive teacher-student-relationships (TSR) can ... [more ▼] The relationships between students and their teachers can impact students’ learning and development. Characterized by emotional warmth or closeness, positive teacher-student-relationships (TSR) can improve a variety of student outcomes. Existing meta-analyses suggest strong links between TSR and students’ peer relations, school engagement, academic achievement, emotions, executive functions, general well-being, and reductions in aggressive or disruptive behaviors. However, this evidence base is scattered, and a comprehensive overview of the TSR-outcome associations integrating academic, behavioral, socio-emotional, and general cognitive outcomes is lacking. Further, researchers have been unequivocal about possible moderators, such as how these relationships change with student age as their relationship to family, peers, and teachers change. Considering these research gaps, we aim to systematically review the meta-analytic literature and examine the following two research questions: Research Question 1: To what extent do existing meta-analyses provide evidence supporting significant relations between TSR and children’s academic, behavioral, socioemotional, motivational, and general cognitive outcomes? (Overall relationship) Research Question 2: To what extent do these relationships vary by the characteristics of the meta-analyses, such as student samples, measurement characteristics, and the quality of the meta-analyses? To address these research questions, we conduct a systematic review of existing meta-analyses, integrating the findings of eligible studies. We will include quantitative meta-analyses with preschool or K-12 samples who have no diagnosed disorder or disability. [less ▲] Detailed reference viewed: 65 (13 UL)![]() Emslander, Valentin ![]() ![]() Report (2022) The aim of the SIVA project is to investigate differences between schools with stable high value-added (VA) scores to those with low or medium VA scores to learn about their effective pedagogical ... [more ▼] The aim of the SIVA project is to investigate differences between schools with stable high value-added (VA) scores to those with low or medium VA scores to learn about their effective pedagogical strategies. We attempt to achieve this goal through classroom observations and questionnaires for students in grade 2, their parents, their teachers, as well as school presidents. More specifically, with the present study we want to learn from target schools with stable positive VA scores – a statistical method usually used to estimate schools' effectiveness. We will use VA modelling constructively to compare those schools identified as highly effective (i.e., with high VA scores) to schools with medium or low VA scores on variables such as pedagogical strategies, student background, and school climate. To this end, a mixed-methods design based on questionnaires, observations, and results from the Luxembourg School Monitoring Programme ÉpStan (LUCET, 2021) will be applied. The content of the investigation is based on a synthesis of models of school learning and quality, focusing on aspects such as school organization or classroom management (e.g., Hattie, 2008; Helmke et al., 2008; Klieme et al., 2001) and is extended by specificities about the Luxembourgish school system, which are not represented in international school learning models (such as the division into two-year learning cycles, the multilingual school setting, and the diverse student population). With the aim to obtain a preferably broad picture, students, parents, teachers, school presidents and regional directors will be investigated. While parents, teachers, school presidents and regional directors can—as adults—fill out questionnaires individually, obtaining the opinion from children at such a young age can be challenging. The SIVA project tackles this issue by choosing item formats that are appealing and understandable for young children (see, e.g.,Lehnert, 2019), as well as by including classroom observations conducted by neutral educational experts (please, find both the questionnaires and observation sheets in the attachments). [less ▲] Detailed reference viewed: 29 (10 UL)![]() ![]() Pit-Ten Cate, Ineke ![]() ![]() ![]() Scientific Conference (2022, March 09) Der Bildungsauftrag unserer heutigen Wissensgesellschaft vereint ein vielseitiges Spektrum an Kompetenzen, die den Schüler*innen vermittelt werden sollen. Die Lernziele beinhalten nicht nur akademischen ... [more ▼] Der Bildungsauftrag unserer heutigen Wissensgesellschaft vereint ein vielseitiges Spektrum an Kompetenzen, die den Schüler*innen vermittelt werden sollen. Die Lernziele beinhalten nicht nur akademischen Erfolg, sondern auch schulisches Wohlbefinden. In der Bildungsforschung haben affektive und sozio-emotionale Faktoren sowie deren Einfluss auf das Erreichen von Lernzielen über die letzten Jahrzehnte an Interesse gewonnen (s.a. Hascher et al., 2018). Subjektives Wohlbefinden (SWB) ist ein komplexes, multidimensionales Phänomen, welches emotionale, soziale und kognitive Facetten umfasst (Hascher & Edlinger, 2009). Das SWB wird als Grundlage für erfolgreiches Lernen betrachtet (Hascher & Hagenauer, 2011), wobei der Zusammenhang je nach Entwicklungsstadium der Schüler*innen variieren kann. Ergebnisse einer Metaanalyse (Bücker et al., 2018) zeigten eine statistisch signifikante mittlere Effektstärke für den Zusammenhang zwischen SWB und Leistung, wobei diese Ergebnisse über verschiedene Ebenen soziodemografischer Merkmale, SWB-Domäne und Indikatoren der Leistung hinweg stabil waren. Außerdem zeigten Gutman und Voraus (2012) in einer längsschnittlichen Studie mit einer Kohorte von Schüler*innen zwischen 7 und 13 Jahren, schwache bis mittlere Korrelationen zwischen unterschiedlichen Dimensionen des Wohlbefindens und aktueller sowie späterer akademischer Leistung. In dieser Studie haben wir den Zusammenhang zwischen verschiedenen Dimensionen des SWB und standardisierten Kompetenztestergebnissen zu verschiedenen Zeitpunkten (5. und 9. Schulkasse) untersucht. Ein erstes Ziel bestand darin, die Unterschiede des Wohlbefindens in Bezug auf das Entwicklungsstadium zu untersuchen, wobei wir auch den Einfluss von Klassenwiederholung und Schulzweig betrachteten. Ein weiteres Ziel der Studie bestand darin, den Zusammenhang zwischen SWB und Leistung unter Berücksichtigung sozio-demografischer Variablen zu ermitteln. Die Ergebnisse basieren auf den Daten der gesamte Kohorte von Fünft- und Neuntklässler*innen (N=5159 bzw. N=6279), die im Rahmen des nationalen Schulmonitoring (Luxembourg School Monitoring Programm „Épreuves Standardisées“; Martin et al., 2015) im November 2018 in Luxemburg erhoben wurden. Im Rahmen dieser Erhebung wurden sowohl standardisierte Schulleistungstests als auch ein Fragebogen zu soziodemographischen und sozio-emotionalen Aspekten durchgeführt. Vier Domäne des SWB wurden erfasst: Selbstkonzept, Schulangst, soziale- sowie emotionale Inklusion. Die standardisierten Leistungstests umfassten Leseverstehen in Deutsch und Französisch sowie Mathematik. Zusätzlich wurden über einen Schüler- oder Elternfragebogen weitere sozio-demographische Merkmale erfasst. Der Zusammenhang zwischen SWB und Entwicklungsstadium (Schulklasse) unter Einbeziehung von Klassenwiederholung und Schulzweig wurde mittels zwei mixed model Analysen überprüft. Die Ergebnisse zeigten, dass Schüler*innen in der 5. Klasse höhere Werte von SWB angaben als Schüler*innen in der 9. Klasse, F(8,121164)=180.61, p<.001. Zusätzlich wurde das SWB negativ beeinflusst durch Klassenwiederholung, F(8, 63989)=17.75, p<.001. Neuntklässler*innen in anspruchsvolleren Schulzweigen gaben höhere Werte von SWB an als Schüler*innen in niedrigeren Schulzweigen, F(2,40219)=15.71, p<001. Die Schulleistung wurde über eine schrittweise Regression vorhergesagt: zunächst wurden sozio-demographische Hintergrundvariable (Geschlecht, Migrationshintergrund, HISEI der Eltern) dem Model hinzugefügt und, in einem zweiten Schritt, Indikatoren des SWB. Die Ergebnisse zeigten, dass in der 5. Klasse 13% und in der 9. Klasse 19% der Varianz in der Schulleistung durch soziodemografische Variablen vorausgesagt werden kann. Sowohl für Fünft- als auch für Neuntklässler*innen, erklärten die Dimensionen des SWB zusätzliche 6% bzw. 4% der Varianz. Die Ergebnisse dieser Studie zeigten, dass Entwicklungsstadium, Klassenwiederholung und Schulzweig einen Einfluß auf das SWB der Schüler*innen haben. Darüber hinaus zeigten die Ergebnisse, dass das SWB über soziodemografische Merkmale hinaus zur Erklärung der schulischen Leistung beiträgt. In Anbetracht ihrer Ergebnisse, kann diese Studie auch die Diskussion um Klassenwiederholung als pädagogische Intervention und um die Praxis der Aufgliederung von Schüler*innen nach Leistungsniveau innerhalb und zwischen Schulformen bereichern. Während sich die meisten Studien zu den Effekten dieser Interventionen auf die schulische Leistung konzentrierten, zeigt die vorliegende Studie, dass diese Maßnahmen auch das SWB betreffen. Weitere (längsschnittliche) Studien könnten darauf eingehen, inwieweit es letztendlich zu einem kumulativen Effekt auf die schulische Leistung kommen kann oder ob und inwiefern das SWB den Zusammenhang zwischen diesen Faktoren und der schulischen Leistung beeinflussen kann. [less ▲] Detailed reference viewed: 153 (3 UL)![]() ![]() Michels, Michael Andreas ![]() ![]() ![]() Scientific Conference (2022, March 09) Detailed reference viewed: 74 (10 UL) |
||