Reference : Three methods, four outcomes! How to test the reliability and validity of a graduate ...
Parts of books : Contribution to collective works
Social & behavioral sciences, psychology : Sociology & social sciences
Three methods, four outcomes! How to test the reliability and validity of a graduate survey competence scale
Landmann, Mareike []
Kmiotek-Meier, Emilia Alicja mailto [University of Luxembourg > Faculty of Language and Literature, Humanities, Arts and Education (FLSHASE) > Integrative Research Unit: Social and Individual Development (INSIDE) >]
Lachmann, Daniel []
Lorenz, Jennifer []
Theory and Method in Higher Education Research. Volume 1
Huisman, Jeroen
Tight, Malcolm
[en] scale construction ; statistical & theoretical reliability ; self-assessed competences
[en] This chapter presents and discusses various steps to ensure empirical reliability and theoretical validity in the construction of competence scales in graduate surveys. The development of a scale to assess demands of the teacher profession and related abilities in graduates for a German tracer study project serves as an example. Confirmatory factor analysis (CFA), principal component analysis (PCA) and Cronbach’s coefficient alpha are employed to test the reliability of the scale. Differing results illustrate how the method applied influences decisions in the process of developing a scale. Our findings show that multidimensionality can only be tested appropriately by CFA; PCA renders no feasible or similar results to CFA depending on the predetermination of the number of factors; Cronbach’s alpha produces misleading results as the prerequisite assumption of unidimensionality is violated by the data.

There is no file associated with this reference.

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.