How does research evaluation impact educational research? Exploring intended and unintended consequences of research assessment in the United Kingdom, 1986–2014

Research evaluation systems in many countries aim to improve the quality of higher education. Among the first such systems, the UK's Research Assessment Exercise (RAE) from 1986 is now the Research Excellence Framework (REF). Highly-institutionalized, it holds research(ers) accountable. While studies describe the effects at different levels, this longitudinal analysis examines the gradual institutionalization and (un)intended consequences from 1986 to 2014. First, we analyze historically RAE/REF's rational, formalization, standardization, and transparency, framing it as a strong research evaluation system. Second, we locate the multidisciplinary field of education, analyzing submission behavior (staff, outputs, funding) of Departments of Education over time. We find: decreases in submitted staff; the research article as preferred publication format; the rise of quantitative analysis; and high and stable concentration of funding among few Departments. Policy instruments invoke varied responses, wit such reactivity shown by the increasing selectivity of submitted staff as a form of reverse engineering and the research article as the preferred output as a self-fulfilling prophecy. The funding concentration manifests an intended consequence, facilitating greater disparities between Departments of Education. These findings emphasize how research assessment impacts the structural organization and cognitive development of educational research in the UK.