Setting up Probability-Based Online Panels of Migrants with a Push-to-Web Approach: Lessons Learned from the German Emigration and Remigration Panel Study (GERPS)
Genoni, Andreas; Decieux, Jean Philippe Pierre; Ette, Andreaset al.
2021 • In Erlinghagen, Marcel; Ette, Andreas; Schneider, Norbertet al. (Eds.) The Global Lives of German Migrants
[en] We address two major challenges in setting up probability-based online panels of migrants, using the German Emigration and Remigration Panel Study (GERPS) as an example. The first challenge is potential spatial and social selectivity in unit response when using push-to-web recruitment. To address the first challenge, we draw on a split ballot experiment with return migrants in wave 1 of GERPS. The related analysis uses population register data and geo data. We use logistic regressions to compare unit nonresponse between a push-to-web-only control group ( n = 5999) and two sub-samples (each n = 1000) with optional paper and pencil interviews (PAPI). The second challenge is panel attrition. To address the second challenge, we investigate the role of individual-level and survey-related factors for panel consent. The regression analysis uses GERPS data of first-wave respondents, estimating panel consent rates for responding remigrants in general ( n = 6395) and in the experiment sample ( n = 2130). We find that the provision of an optional paper questionnaire marginally increases the likelihood of response. The positive correlation of PAPI and response rate, however, is counterbalanced by a negative correlation with the likelihood of panel consent. This suggests a trade-off scenario to the detriment of either response rates or panel participation rates.
Disciplines :
Sociology & social sciences
Author, co-author :
Genoni, Andreas
Decieux, Jean Philippe Pierre ; University of Luxembourg > Faculty of Language and Literature, Humanities, Arts and Education (FLSHASE) > Integrative Research Unit: Social and Individual Development (INSIDE)
Ette, Andreas
Witte, Nils
External co-authors :
yes
Language :
English
Title :
Setting up Probability-Based Online Panels of Migrants with a Push-to-Web Approach: Lessons Learned from the German Emigration and Remigration Panel Study (GERPS)
AAPOR. (2016). Standard definitions. Final dispositions of case codes and outcome rates for surveys. (9th Edn). AAPOR.
Ajzen, I., & Fishbein, M. (1977). Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychological bulletin, 84(5), 888.
Andersen, H., & Mayerl, J. (2017). Social Desirability and undesirability effects on survey response latencies. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique, 135(1), 68–89.
BMVI. (2019). Aktuelle Breitbandverfügbarkeit in Deutschland (Stand Mitte 2019). Erhebung der atene KOM im Auftrag des BMVI. Hg. v. Bundesministerium für Verkehr und digitale Infrastruktur. Bundesministerium für Verkehr und digitale Infrastruktur.
Best, H., & Wolf, C. (2015). Logistic Regression. In H. Best & C. Wolf (Eds.), The SAGE handbook of regression analysis and causal inference. London: SAGE.
Blom, A. G., Gathmann, C., & Krieger, U. (2015). Setting up an online panel representative of the general population: The German internet panel. Field Methods, 27(2), 391–408.
Brower, C. K. (2018). Too long and too boring: The effects of survey length and interest on careless responding. Dissertation. Wright State University, Department of Psychology.
Couper, M. P. (2000). Web surveys: A review of issues and approaches. Public Opinion Quarterly, 64, 464–494.
Couper, M. P., & Peterson, G. J. (2017). Why do web surveys take longer on smartphones? Social Science Computer Review, 35(3), 357–377.
Cull, W. L., O’Connor, K. G., Sharp, S., & Tang, S.-f. S. (2005). Response rates and response bias for 50 surveys of pediatricians. Health Services Research, 40(1), 213–226.
Deol, R., Hibbing, M. V., Mondak, J. J., Cawvey, M., & Bloeser, A. J. (2017). The relationship between personality and response patterns on public opinion surveys: The big five, extreme response style, and acquiescence response style. International Journal of Public Opinion Research, 31(1), 161–177.
De Leeuw, E. D. (2018). Mixed-mode: Past, present, and future. Survey Research Methods, 12(2), 75–89.
De Leeuw, E., & Berzelak, N. (2016). Survey mode or survey modes? In C. Wolf, D. Joye, T. W. Smith, & Y.-c. Fu (Eds.), The sage handbook of survey methodology (pp. 142–156). London: SAGE Publications.
De Leeuw, E. D., & Hox, J. J. (2018). International nonresponse trends across countries and years: An analysis of 36 years of labour force survey data. Survey Insights: Methods from the Field.
Décieux, J. P. (2021). Is there more than the answer to the question? Device use and completion time as indicators for selectivity bias and response convenience in online surveys. In M. Erlinghagen, A. Ette, N. F. Schneider, & N. Witte (Eds.), The global lives of German migrants. Consequences of international migration across the life course. Cham: Springer.
Di Pietro, G. (2012). Does studying abroad cause international labor mobility? Evidence from Italy. Economics Letters, 17(3), 632–635.
Dillman, D. A. (2017). The promise and challenge of pushing respondents to the Web in mixed-mode surveys. Survey Methodology, 43(1), 3–30.
Durrant, G. B., & Steele, F. (2009). Multilevel modelling of refusal and noncontact in household surveys: Evidence from six UK government surveys. Journal of the Royal Statistical Society: Series A, 172(2), 361–381.
Ette, A., Décieux, J. P., Erlinghagen, M., Auditor, J. G., Sander, N., Schneider, N. F., & Witte, N. (2021). Surveying across borders: The experiences of the German emigration and remigration panel study. In M. Erlinghagen, A. Ette, N. F. Schneider, & N. Witte (Eds.), The global lives of German migrants. Consequences of international migration across the life course. Cham: Springer.
Ette, A., Décieux, J. P., Erlinghagen, M., Genoni, A., Auditor, J. G., Knirsch, F., Kühne, S., Mörchen, L., Sand, M., Schneider, N. F., & Witte, N. (2020). German emigration and Remigration Panel Study (GERPS): Methodology and data manual of the baseline survey (wave 1). Wiesbaden: Bundesinstitut für Bevölkerungsforschung.
Gigliotti, L., & Dietsch, A. (2014). Does age matter? The influence of age on response rates in a mixed-mode survey. Human Dimensions of Wildlife: An international Journal, 19(3), 280–287.
Goyder, J. (1987). The silent minority: Nonrespondents on sample surveys. Cambridge: Polity Press.
Göritz, A. S., & Neumann, B. P. (2016). The longitudinal effects of incentives on response quantity in online panels. Translational Issues in Psychological Science, 2(2), 163–73.
Groves, R. M., & Couper, M. P. (1998). Nonresponse in household interview surveys. New York: Wiley.
Groves, R. M., & Couper, M. P. (2012). Wiley series in survey methodology: Nonresponse in household interview surveys (1st ed.). Hoboken: John Wiley.
Groves, R. M., Singer, E., & Corning, A. (2000). Leverage-saliency theory of survey participation: Description and an illustration. Public Opinion Quarterly, 64(3), 299–308.
Gummer, T., & Daikeler, J. (2020). A note on how prior sSurvey experience with self-administered panel surveys affects attrition in different modes. Social Science Computer Review, 38(4), 490–498.
Gummer, T., & Roßmann, J. (2015). Explaining interview duration in web surveys: A multilevel approach. Social Science Computer Review, 33(2), 217–234.
Hardigan, P. C., Popovici, I., & Carvajal, M. J. (2016). Response rate, response time, and economic costs of survey research: A randomized trial of practicing harmacists. Research in Social and Administrative Pharmacy, 12(1), 141–148.
Haunberger, S. (2011). Teilnahmeverweigerung in Panelstudien. Wiesbaden: Springer.
Herzing, J. M. E., & Blom, A. G. (2018). The influence of a person’s digital affinity on unit nonresponse and attrition in an online panel. Social Science Computer Review, 37(3), 404–424.
Herzog, A. R., & Rodgers, W. L. (1988). Age and response rates to interview sample surveys. Journal of Gerontology, 43(6), 200–205.
Jacob, R., Heinz, A., & Décieux, J. P. (2019). Umfrage: Einführung in die Methoden der Umfrageforschung. München: Walter de Gruyter.
Kaldenberg, D. O., Koenig, H. F., & Becker, B. W. (1994). Mail survey response rate patterns in a population od the elderly. Public Opinion Quarterly, 58, 68–76.
Kodrzycki, Y. (2001). Migration of recent college graduates: Evidence from the National Longitudianl Survey of Youth. New England Economic Review, 1, 13–34.
Krieger, U. (2018). A Penny for your thoughts. The use of cash incentives in face-to-face surveys. Dissertation. University of Mannheim.
Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5(3), 213–236.
Lepkowski, J. M, & Couper M. P. (2002). Nonresponse in the second wave of longitudinal household surveys. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 259-272). Wiley.
Leeper, G. T. (2019). Where have the Respondents Gone? Perhaps we ate them all. Public Opinion Quarterly, 83(S1), 280–288.
Lipps, O., & Pollien, A. (2019). Effects of topic distribution and topic importance on interest and follow-up response. FORS Working Paper Series.
Lipps, O., Herzing, J. M. E., Pekari, N., Stähli E. M., Pollien, A., Riedo, G., & Reveilhac, M. (2019). Incentives in surveys. In Swiss Centre of Expertise in the Social Sciences FORS (Ed.), FORS Guide No. 08. Lausanne.
Lynn, P. (2003). PEDAKSI: Methodology for collecting data about survey non-respondents. Quality and Quantity, 37(3), 239–261.
Lynn, P. (2018). Tackling panel attrition. In D. L. Vannette, & J. A. Krosnick (Eds.), The Palgrave handbook of survey research (pp. 143–153). Springer International Publishing.
Lynn, P., Nandi, A., Parutis, V., & Platt, L. (2018). Design and implementation of a high-quality probability sample of immigrants and ethnic minorities: Lessons learnt. Demographic Research, 38, 513–548.
Millar, M., & Dillman, D. (2012). Do mail and internet surveys produce different item nonresponse rates? An experiment using random mode assignmentmode assignment. Survey Practice, 5, 2.
Mohorko, A., De Leeuw, E., & Hox, J. (2013). Internet coverage and coverage bias in Europe: Developments across countries and over time. Journal of Official Statistics, 29(4), 609–622.
OECD (2018). Bridging the rural digital divide: OECD Digital Economy Papers.
Oosterbeek, H., & Webbink, D. (2011). Does studying abroad induce a brain drain? Economica, 78(310), 347–366.
Plutzer, E. (2019). Privacy, sensitive questions, and informed consent: Their impacts on total survey error, and the future of survey research. Public Opinion Quarterly, 83(S1), 169–184.
Roberts, C., Gilbert, E., Allum, N., & Eisner, L. (2019). Research synthesis: Satisficing in surveys: A systematic review of the literature. Public Opinion Quarterly, 83(3), 598–626.
Roßmann, J. (2015). RSPEEDINDEX. Stata module to compute a response speed index and perform outlier identification. Boston College Department of Economics (Statistical Software Components, s458007).
Roßmann, J. (2017). Satisficing in Befragungen: Theorie, Messung und Erklärung. Wiesbaden: Springer.
Roßmann, J., & Gummer, T. (2015). Using Paradata to predict and correct for panel attrition. Social Science Computer Review, 34(3), 312–332.
Roßmann, J., & Gummer, T. (2016). PARSEUAS. Stata module to extract detailed information from user agent strings. Boston College Department of Economics (Statistical Software Components, S457937).
Sakshaug, J. (2013). Using paradata to study response to within-survey requests. In F. Kreuter (Ed.), Improving surveys with paradata. Analytic uses of process information (pp. 171–190). Hoboken, New Jersey: John Wiley & Sons.
Sakshaug, J., Cernat, A., & Raghunathan, T. E. (2019). Do sequential mixed-mode surveys decrease nonresponse bias, measurement error bias, and total bias? An experimental study. Journal of Survey Statistics and Methodology, 7 4), 545–571.
Schlosser, S., & Mays, A. (2018). Mobile and dirty: Does using mobile devices affect the data quality and the response process of online surveys? Social Science Computer Review, 36(2), 212–230.
Spreen, T. L., House, L. A., & Gao, Z. (2020). The impact of varying financial incentives on data quality in web panel surveys. Journal of Survey Statistics and Methodology, 8(5), 832–850.
Saßenroth, D. (2012). The impact of personality traits on the willingness to cooperate in surveys: evidence from the German General Social Surveys in 2004, 2006, and 2008. Methoden— Daten—Analysen, 6(1), 21–44.
Schmidt-Hertha, B. (2014). Technologiebasierte Problemlösekompetenz. In J. Friebe, B. Schmidt-Hertha, & R. Tippelt (Eds.), Kompetenzen im höheren Lebensalter. Ergebnisse der Studie "Competencies in Later Life" (CiLL) (pp. 99–111). Bielefeld: Bertelsmann Verlag.
Schnell, R., Hill, P. B., & Esser, E. (2013). Methoden der empirischen Sozialforschung. München: Oldenbourg.
Sischka, P. E., Décieux, J. P., Mergener, A., Neufang, K. M., & Schmidt, A. F. (2020). The impact of forced answering and reactance on answering behavior in online surveys. Social Science Computer Review, 26, 1–21.
Tai, X., Smith, A. M., McGeerm, A. M., Dubé, E., Holness, D. L., Katz, K., Hall, L. M. G., McNeil, S. A., Powis, J., & Coleman, B. L. (2018). Comparison of response rates on invitation mode of a web-based survey on influenza vaccine adverse events among healthcare workers: a pilot study. BMC Medical Research Methodology, 18, 59.
Weigold, A., Weigold, I. K., & Natera, S. N. (2018). Response rates for surveys completed with paper-and-pencil and computers: Using meta-analysis to assess equivalence. Social Science Computer Review, 37(5), 649–668.
