References of "Keller, Ulrich 50002080"
     in
Bookmark and Share    
Peer Reviewed
See detailReading comprehension strategies of biliterate students in German and French
Ugen, Sonja UL; Brunner, Martin UL; Fischbach, Antoine UL et al

Scientific Conference (2011, July)

Detailed reference viewed: 76 (13 UL)
See detailChallenges of modern Computer Based Assessment: Usability, Scoring, and “Digital Natives”
Sonnleitner, Philipp UL; Brunner, Martin; Keller, Ulrich UL et al

Scientific Conference (2011)

In recent years, computer based assessment has undergone substantive change. Test developers as well as test users have become aware of the fact that computers can do more than administrate traditional ... [more ▼]

In recent years, computer based assessment has undergone substantive change. Test developers as well as test users have become aware of the fact that computers can do more than administrate traditional (paper-pencil) item formats like multiple-choice. More complex computer based item types allow tracking test takers’ mental representations of the problem or even their problem solving strategies by means of behavioral data. An example for such a modern item type are microworlds – dynamically changing problem solving scenarios with which the test taker has to interact. However, with the advent of complex item types, new challenges arise. First, usability is at stake - test takers do not intuitively know what to do or how to interact with complex tasks. Second, a massive load of data is produced and it gets difficult for the test developer to decide on relevant scores. Third, today’s students - so-called “digital natives”- grew up with computers and therefore set high quality standards for software applications. They may quickly loose trust and interest in tests with old fashioned design, cumbersome handling or even malfunctioning software. On basis of the Genetics Lab – a microworld developed to assess general mental ability – these challenges of modern computer based assessment are discussed. Three consecutive small scale studies were carried out to investigate usability issues, validate scoring algorithms and to ensure acceptance among students. The results demonstrate the importance of considering usability during the test development process, particularly with regard to scoring. The modification of conventional test development procedures for modern computer based assessment is suggested. Moreover, possibilities to satisfy even a critical target population are presented. [less ▲]

Detailed reference viewed: 45 (3 UL)
Peer Reviewed
See detailThe Genetics Lab - A new Computer-Based Problem Solving Scenario to assess Intelligence
Sonnleitner, Philipp UL; Brunner, Martin; Keller, Ulrich UL et al

Scientific Conference (2011)

Assessments of intelligence by means of paper-pencil tests faced several critiques that point to their lack of face validity, insufficient coverage of the definition of intelligence, their sensitivity to ... [more ▼]

Assessments of intelligence by means of paper-pencil tests faced several critiques that point to their lack of face validity, insufficient coverage of the definition of intelligence, their sensitivity to the emotional state of the test taker, and the danger of getting outdated. The present paper discusses to what extent these limitations can be overcome by computer-based problem solving scenarios–so-called microworlds. Generally speaking, microworlds are supposed to be highly accepted by test takers, to provide process measures by directly tracing problem solving behavior, and to realize game-like characteristics that may increase test motivation and reduce test anxiety. To capitalize on these potential advantages, we developed the microworld Genetics Lab that was completed by a large, heterogeneous sample of more than 600 Luxembourgish students. Performance scores were derived for students’ problem solving strategies as well as their mental problem representations–important cognitive data which are not accessible with typical paper-pencil tests. Analyses of the psychometric characteristics of the Genetics Lab empirically underscored the construct validity for the derived performance scores. For example, process oriented measures of strategy use were found to possess discriminant validity with respect to grades. Further, acceptance and induced test anxiety of the Genetics lab was explored relative to a paper-pencil measure of intelligence. Our results show that the Genetics Lab is a reliable and valid assessment instrument and emphasize the benefits of using microworlds for assessing intelligence. [less ▲]

Detailed reference viewed: 80 (1 UL)
Peer Reviewed
See detailGeschlechtsunterschiede in Lesen und Mathematik: Ergebnisse aus 69 Ländern.
Brunner, Martin; Keller, Ulrich UL; Sonnleitner, Philipp UL et al

Scientific Conference (2011)

Detailed reference viewed: 73 (0 UL)
Peer Reviewed
See detailAssessing Intelligence for Education in the 21st Century: The Benefits of Microworlds
Sonnleitner, Philipp UL; Brunner, Martin; Keller, Ulrich UL et al

Scientific Conference (2011)

Computer-based problem solving scenarios—so-called microworlds—are contemporary educational assessment instruments of intelligence that offer several benefits compared to traditional paper-pencil tests ... [more ▼]

Computer-based problem solving scenarios—so-called microworlds—are contemporary educational assessment instruments of intelligence that offer several benefits compared to traditional paper-pencil tests. This involves tracking of students’ mental representations of the problems as well as their problem solving strategies by means of behavioral data which provides key information for educational interventions. Moreover, microworlds realize game-like characteristics that may increase test motivation and reduce test anxiety. In the present study, the Genetics Lab, a newly developed microworld, was completed by a representative sample of more than 800 Luxembourgish students. Students chose among three different languages (German, French and English) in which the problem content of the Genetics Lab was presented. The present paper analyzes the psychometric properties of the various performance scores derived for the Genetics Lab with respect to their relations to school grades, and measurement invariance across gender, chosen test language, and migration background. Moreover, a direct comparison with traditional measures of intelligence demonstrated construct validity of the performance scores of the Genetics Lab. In sum, the results obtained for the Genetics Lab show the benefits of behavioral data obtained for computer-based problem-solving scenarios and support the notion of microworlds to be a valuable measure of intelligence. [less ▲]

Detailed reference viewed: 133 (0 UL)
See detailThe C-test, the TCF and the CEFR: a validation study.
Reichert, Monique UL; Keller, Ulrich UL; Martin, Romain UL

in Grotjahn, Rüdiger (Ed.) Der C-Test: Beiträge aus der aktuellen Forschung. The C-Test: Contributions from Current Research (2010)

Detailed reference viewed: 120 (1 UL)
Full Text
See detailUnterschiede zwischen Schulformen und Schulen
Keller, Ulrich UL; Reichert, Monique UL; Brunner, Martin UL et al

in SCRIPT; EMACS (Eds.) PISA 2009. Nationaler Bericht Luxemburg (2010)

Detailed reference viewed: 99 (11 UL)
Full Text
See detailKompetenzerwerb in Bezug auf das kulturelle und sozio‐ökonomische Umfeld
Ugen, Sonja UL; Brunner, Martin UL; Dierendonck, Christophe UL et al

in SCRIPT; EMACS (Eds.) PISA 2009. Nationaler Bericht Luxemburg (2010)

Detailed reference viewed: 61 (8 UL)
Full Text
Peer Reviewed
See detailThe structure of academic self-concepts revisited: The nested Marsh/Shavelson model
Brunner, Martin UL; Keller, Ulrich UL; Dierendonck, Christophe UL et al

in Journal of Educational Psychology (2010), 102(4), 964-981

Detailed reference viewed: 370 (28 UL)
Full Text
See detailLuxemburger Schülerinnen und Schüler im internationalen Vergleich
Boehm, Bettina; Brunner, Martin UL; Dierendonck, Christophe UL et al

in SCRIPT; EMACS (Eds.) PISA 2009. Nationaler Bericht Luxemburg (2010)

Detailed reference viewed: 53 (5 UL)
Peer Reviewed
See detailWandel im Bildungswesen, zunehmende Komplexität und Web 2.0: Sind traditionelle Intelligenztests noch "up to date"?
Sonnleitner, Philipp UL; Brunner, Martin; Keller, Ulrich UL et al

Poster (2010)

Grundlegender Wandel im schulischen Bereich führt zur berechtigten Frage, inwiefern nicht Innovationen in der Intelligenzdiagnostik nötig wären, um die hohe prädiktive Validität und dadurch wesentliche ... [more ▼]

Grundlegender Wandel im schulischen Bereich führt zur berechtigten Frage, inwiefern nicht Innovationen in der Intelligenzdiagnostik nötig wären, um die hohe prädiktive Validität und dadurch wesentliche Bedeutung bei Schulplatzierungsentscheidungen weiterhin zu sichern. Die stärkere Betonung fächerübergreifender Kompetenzen, eine vermehrte Einbindung des Computers in Unterricht und Alltag sowie zunehmende Komplexität in der Arbeitswelt führen zu neuen Herausforderungen und beleben alte Kritik wieder. In diesem Kontext wurden immer wieder computerbasierte Problemlöseszenarien als vielversprechender Ansatz genannt, Schwächen traditioneller Intelligenztests zu überwinden. Vorteile werden, neben dem dynamischen Testformat und einer vollständigeren Abdeckung des Intelligenzbegriffes, unter anderem auch in erhöhter face-validity gesehen. Während bisherige Studien den Schwerpunkt auf das empirische Verhältnis zwischen Leistungsmaßen der Szenarien und traditionellen Intelligenzmaßen setzten, versucht dieser Beitrag, bewusst die Diskussion um theoretische Aspekte zu ergänzen. Einer Analyse der Anforderungen die an eine aktuelle Intelligenzdiagnostik zu stellen sind, folgt ein systematischer Vergleich traditioneller Intelligenztestformate mit computerbasierten Problemlöseszenarien. Konkrete Beispiele sowie aktuelle Daten zur Pilotierung eines derartigen Szenarios zur Intelligenzdiagnostik ergänzen die Diskussion. [less ▲]

Detailed reference viewed: 126 (2 UL)
Full Text
See detailJungen und Mädchen
Brunner, Martin UL; Ugen, Sonja UL; Dierendonck, Christophe UL et al

in SCRIPT; EMACS (Eds.) PISA 2009. Nationaler Bericht Luxemburg (2010)

Detailed reference viewed: 41 (8 UL)
Full Text
See detailZusammenfassung der Ergebnisse von PISA 2009
Boehm, Bettina; Brunner, Martin UL; Dierendonck, Christophe UL et al

in SCRIPT; EMACS (Eds.) PISA 2009. Nationaler Bericht Luxemburg (2010)

Detailed reference viewed: 64 (9 UL)
Full Text
Peer Reviewed
See detailThe cross-cultural generalizability of a new structural model of academic self-concepts.
Brunner, Martin UL; Keller, Ulrich UL; Hornung, Caroline UL et al

in Learning & Individual Differences (2009), 19

Detailed reference viewed: 83 (6 UL)
Peer Reviewed
See detailA Nation-Wide Computer-based School Monitoring Program
Keller, Ulrich UL; Martin, Romain UL; Reichert, Monique UL et al

in International Journal of Psychology (2008), 43

Detailed reference viewed: 51 (6 UL)