Developing and Evaluating a Computerized Adaptive Mathematical Test

The theoretical basis underlying the construction of a CAT is summed up and the item response theory explained. In comparison with a classical paper-and-pencil test, the characteristics and the advantages of a CAT are exposed. After performing a thorough analysis of the data, we developed a CAT based on the responses of 3590 children to a standardized mathematical test. The software presents a great amount of flexibility and allows treating multiple-choice items, as well as items with free response options and graphical items.
Some results of an empirical evaluating study are presented. We showed that qualities of power, flexibility and economy of time of the CAT do not imply the loss of the classical psychometric properties of a paper-and-pencil test; we analyze the carry-over effect between the computerized and the paper-and-pencil test situation and as well as the relations between mathematical skills and general cognitive abilities.