The validity of lower-order dimensions: A psychometrical Investigation of complex problem solving competence

Psychological constructs are often multidimensionally and hierarchically conceptualized. For example, the complex problem solving (CPS) competence is based on the relatively independent subdimensions of knowledge acquisition and knowledge application. However, the validity of lower-order factors compared to a general factor (g) has been questioned in the research area of cognitive abilities. Therefore, the purpose of the present paper is to investigate the reliability and validity of the g-factor and the lowerorder factors of CPS. On the basis of bifactor models, we analyzed three data sets (N1 = 227; N2 = 339; N3 = 553) of two different CPS measurements. The findings indicate that the assumption of two relatively independent subdimensions of CPS is not justified in terms of unique variance and incremental explanation of external criteria. We conclude that an assumption on multidimensionality and an interpretation of lower-order constructs should be based on a more elaborated approach than usually applied.