[en] This chapter presents and discusses various steps to ensure empirical reliability and theoretical validity in the construction of competence scales in graduate surveys. The development of a scale to assess demands of the teacher profession and related abilities in graduates for a German tracer study project serves as an example. Confirmatory factor analysis (CFA), principal component analysis (PCA) and Cronbach’s coefficient alpha are employed to test the reliability of the scale. Differing results illustrate how the method applied influences decisions in the process of developing a scale. Our findings show that multidimensionality can only be tested appropriately by CFA; PCA renders no feasible or similar results to CFA depending on the predetermination of the number of factors; Cronbach’s alpha produces misleading results as the prerequisite assumption of unidimensionality is violated by the data.
Disciplines :
Sociology & social sciences
Author, co-author :
Landmann, Mareike
Kmiotek-Meier, Emilia Alicja ; University of Luxembourg > Faculty of Language and Literature, Humanities, Arts and Education (FLSHASE) > Integrative Research Unit: Social and Individual Development (INSIDE)
Lachmann, Daniel
Lorenz, Jennifer
External co-authors :
yes
Language :
English
Title :
Three methods, four outcomes! How to test the reliability and validity of a graduate survey competence scale
Publication date :
2015
Main work title :
Theory and Method in Higher Education Research. Volume 1