Article (Scientific journals)
The application of factorial surveys to study recruiters’ hiring intentions: comparing designs based on hypothetical and real vacancies
Gutfleisch, Tamara; Samuel, Robin; Sacchi, Stefan
2021In Quality and Quantity, 55, p. 775–804
Peer Reviewed verified by ORBi


Full Text
Publisher postprint (798.23 kB)

All documents in ORBilu are protected by a user license.

Send to


Keywords :
Factorial survey experiments; Hiring intentions; Real vacancies; Hypotheticalvacancies
Abstract :
[en] Factorial survey experiments have been widely used to study recruiters’ hiring intentions. Respondents are asked to evaluate hypothetical applicant descriptions, which are experimentally manipulated, for hypothetical job descriptions. However, this methodology has been criticized for putting respondents in hypothetical situations that often only partially correspond to real-life hiring situations. It has been proposed that this criticism can be overcome by sampling real-world vacancies and the recruiters responsible for filling them. In such an approach, only the applicants’ descriptions are hypothetical; respondents are asked about a real hiring problem, which might increase internal and external validity. In this study, we test whether using real vacancies triggers more valid judgments compared to designs based on hypothetical vacancies. The growing number of factorial survey experiments conducted in employer studies makes addressing this question relevant, both for methodological and practical reasons. However, despite the potential implications for the validity of data, it has been neglected so far. We conducted a factorial survey experiment in Luxembourg, in which respondents evaluated hypothetical applicants referring either to a currently vacant position in their company or to a hypothetical job. Overall, we found little evidence for differences in responses by the design of the survey experiment. However, the use of real vacancies might prove beneficial depending on the research interest. We hope that our comparison of designs using real and hypothetical vacancies contributes to the emerging methodological inquiry on the possibilities and limits of using factorial survey experiments in research on hiring.
Disciplines :
Sociology & social sciences
Author, co-author :
Gutfleisch, Tamara
Samuel, Robin  ;  University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Social Sciences (DSOC)
Sacchi, Stefan
External co-authors :
Language :
Title :
The application of factorial surveys to study recruiters’ hiring intentions: comparing designs based on hypothetical and real vacancies
Publication date :
Journal title :
Quality and Quantity
Publisher :
Springer Nature
Volume :
Pages :
Peer reviewed :
Peer Reviewed verified by ORBi
Name of the research project :
Funders :
UL - Université de Lorraine [FR]
Available on ORBilu :
since 12 May 2021


Number of views
529 (305 by Unilu)
Number of downloads
120 (10 by Unilu)


Similar publications

Contact ORBilu