Assessment and Measurement in Health Psychology

[en] Sound assessment and measurement is at the heart of every discipline, including health psychology. Within the current chapter, we address several key issues of assessment and measurement in health psychology. We discuss the strengths and weaknesses of commonly used methodologies in health psychology research and clinic, including questionnaire assessment and ecological momentary assessment, as well as potential pitfalls in using these assessment methods. Next, we discuss three pivotal features of assessment (i.e. reliability, validity, and responsiveness) and their importance for assessment of health psychological constructs. Last, we discuss some examples of tools to assess health outcomes in research and evidence-based practice as well as future directions in the field of health psychology assessment.

Disciplines :

Theoretical & cognitive psychology

Author, co-author :

van Ryckeghem, Dimitri ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)

Crombez, Geert

External co-authors :

yes

Language :

English

Title :

Assessment and Measurement in Health Psychology

Publication date :

2021

Main work title :

Reference Module in Neuroscience and Biobehavioral Psychology

Publisher :

Maastricht University

Peer reviewed :

Peer reviewed

Available on ORBilu :

since 31 December 2021

Statistics

Number of views

159 (0 by Unilu)

Number of downloads

1 (1 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

Bibliography

Batterham, P. J., Sunderland, M., Carragher, N., & Calear, A. L. (2017a). Psychometric properties of 7- and 30-day versions of the PROMIS emotional distress item banks in an Australian adult sample. Assessment, 26(2), 249-259. https://doi.org/10.1177/1073191116685809
Batterham, P. J., Sunderland, M., Slade, T., Calear, A. L., & Carragher, N. (2017b). Assessing distress in the community: psychometric properties and crosswalk comparison of eight measures of psychological distress. Psychol. Med., 48(8), 1316-1324. https://doi.org/10.1017/s0033291717002835
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186-3191. https://doi.org/10.1097/00007632-200012150-00014
Beatty, P. C., & Willis, G. B. (2007). Research synthesis: the practice of cognitive interviewing. Publ. Opin. Q., 71(2), 287-311. https://doi.org/10.1093/poq/nfm006
Beck, A.T., Steer, R.A., & Brown, G.K. (1996). Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation.
Benyamini, Y., Karademas, E., & Johnston, M. (2016). Assessment in Health Psychology (vol. 2). Hogrefe Publishing
Bolger, N., Davis, A., and Rafaeli, E., Diary methods: capturing life as it is lived, Annu. Rev. Psychol. 54, 2003, 579-616. https://doi.org/10.1146/annurev.psych.54.101601.145030.
Bolger, N., & Laurenceau, J. (2013). Intensive Longitudinal Methods (first ed.). Guilford Publications.
Broderick, J. E., Schwartz, J. E., Vikingstad, G., Pribbernow, M., Grossman, S., & Stone, A. A. (2008). The accuracy of pain and fatigue items across different reporting periods. Pain, 139(1), 146-157. https://doi.org/10.1016/j.pain.2008.03.024
Broderick, J. E., Schneider, S., Schwartz, J. E., & Stone, A. A. (2010). Interference with activities due to pain and fatigue: accuracy of ratings across different reporting periods. Qual. Life Res., 19(8), 1163-1170. https://doi.org/10.1007/s11136-010-9681-x
Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A. M., & Kaemmer, B. (1989). Minnesota Multiphasic Personality Inventory-2 (MMPI-2): Manual for Administration and Scoring. Minneapolis: University of Minnesota Press.
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol. Bull., 56(2), 81-105. https://doi.org/10.1037/h0046016
Chen, I. Y., Szolovits, P., & Ghassemi, M. (2019). Can AI help reduce disparities in general medical and mental health care? AMA J. Ethics, 21(2), E167-E179. https://doi.org/10.1001/amajethics.2019.167
Cloud, J. & Vaughan, G.M. (1970). Using balanced scales to control acquiescence. Sociometry, 33 (2) (1970), pp. 192-202, https://doi.org/10.2307/2786329
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. J. Appl. Psychol., 78(1), 98-104. https://doi.org/10.1037/0021-9010.78.1.98
Crombez, G., De Paepe, A. L., Veirman, E., Eccleston, C., Verleysen, G., & Van Ryckeghem, D. M. (2020). Let's talk about pain catastrophizing measures: an item content analysis. PeerJ, 8, e8643. https://doi.org/10.7717/peerj.8643
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. https://doi.org/10.1007/bf02310555
Degroote, L., DeSmet, A., De Bourdeaudhuij, I., Van Dyck, D., & Crombez, G. (2020). Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behavior: a systematic review. Int. J. Behav. Nutr. Phys. Activ., 17(1). https://doi.org/10.1186/s12966-020-00932-9
DeVries M, ed. 1992. The Experience of Psychopathology: Investigating Mental Disorders in Their Natural Settings. Cambridge, UK: Cambridge University Press. 429 pp
Diener, E., & Tay, L. (2013). Review of the day reconstruction method (DRM). Soc. Indicat. Res., 116(1), 255-267. https://doi.org/10.1007/s11205-013-0279-x
Dixon, D., & Johnston, M. (2019). Content validity of measures of theoretical constructs in health psychology: discriminant content validity is needed. Br. J. Health Psychol., 24, 447-484. https://doi.org/10.1111/bjhp.12373
Doherty, S.T., Lemieux, J.L., Canally, C. (2014). Tracking human activity and well-being in natural environments using wearable sensors and experience sampling. Soc. Sci. Med., 106, 83-92. https://doi.org/10.1016/j.socscimed.2014.01.048.
Dunton, G. F. (2017). Ecological momentary assessment in physical activity research. Exerc. Sport Sci. Rev., 45(1), 48-54. https://doi.org/10.1249/jes.0000000000000092
Ehrenbrusthoff, K., Ryan, C. G., Gruneberg, C., and Martin, D. J.(2018). A systematic review and meta-analysis of the reliability and validity of sensorimotor measurement instruments in people with chronic low back pain. Musculoskelet Sci. Pract., 35:73-83. https://doi: 10.1016/j.msksp.2018.02.007
Eremenco, S. L., Cella, D., & Arnold, B. J. (2005). A comprehensive method for the translation and cross-cultural validation of health status questionnaires. Eval. Health Prof., 28(2), 212-232. https://doi.org/10.1177/0163278705275342
Fishbein, M., & Ajzen, I. (1975). Belief, Attitude, Intention and Behavior: An Introduction to Theory and Research. Reading, MA: Addison-Wesley.
Forkmann, T., Vehren, T., Boecker, M., Norra, C., Wirtz, M., Gauggel, S. (2009) Sensitivity and specificity of the Beck Depression Inventory in cardiologic inpatients: how useful is the conventional cut-off score? J. Psychosom. Res., 67(4), 347-352. https://doi: 10.1016/j.jpsychores.2009.04.003
French, D. P., & Sutton, S. (2010). Reactivity of measurement in health psychology: how much of a problem is it? What can be done about it? Br. J. Health Psychol., 15(3), 453-468. https://doi.org/10.1348/135910710x492341
Fried, E. I. (2017). The 52 symptoms of major depression: lack of content overlap among seven common depression scales. J. Affect. Disord., 208, 191-197. https://doi.org/10.1016/j.jad.2016.10.019
Fries, J. F., Cella, D., & Bruce, B. (2005). The promise of PROMIS: using item response theory to improve assessment of patient-reported outcomes. Clin. Exp. Rheumatol., 23(5).
Froman, R. D. (2001). Elements to consider in planning the use of factor analysis. Southern Online J. Nurs. Res., 5, 1-22.
Gawronski, B., & De Houwer, J. (2014). Implicit measures in social and personality psychology. In H. T. Reis & C. M. Judd (Eds.), Handbook of Research Methods in Social and Personality Psychology (pp. 283-310). Cambridge University Press.
Gibbons, D., Welch-Phillips, A., Ahern, D. P., & Butler, J. S. (2020). Advantages and design of PROMIS questionnaires. Clin. Spine Surg., 33(10), 408-410. https://doi.org/10.1097/bsd.0000000000001056
Gorst, S. L., Prinsen, C. A., Salcher-Konrad, M., Matvienko-Sikar, K., Williamson, P. R., & Terwee, C. B. (2020). Methods used in the selection of instruments for outcomes included in core outcome sets have improved since the publication of the COSMIN/COMET guideline. J. Clin. Epidemiol., 125, 64-75. https://doi.org/10.1016/j.jclinepi.2020.05.021
Grossman, P. (2011). Defining mindfulness by how poorly I think I pay attention during everyday awareness and other intractable problems for psychology's (re)invention of mindfulness: comment on Brown et al. (2011). Psychol. Assess., 23(4), 1034-1040. https://doi.org/10.1037/a0022713
Hadzibajramovic, E., Schaufeli, W., & De Witte, H. (2020). A rasch analysis of the Burnout Assessment Tool (BAT). PLoS One, 15(11), e0242241. https://doi.org/10.1371/journal.pone.0242241
Hays, R. D., Sherbourne, C. D., Mazel, R. M. (1993). The RAND 36-item health survey 1.0. Health Econ., 2(3), 217-227. https://doi: 10.1002/hec.4730020305
Hohne, J. K., Revilla, M., & Lenzner, T. (2018). Comparing the performance of agree/disagree and item-specific questions across PCs and smartphones. Methodology. 14(3), 109-118. https://doi.org/10.1027/1614-2241/a000151
Hudson, N. W., Anusic, I., Lucas, R. E., & Donnellan, M. B. (2020). Comparing the reliability and validity of global self-report measures of subjective well-being with experiential day reconstruction measures. Assessment, 27(1), 102-116. https://doi.org/10.1177/1073191117744660
Husted, J. A., Cook, R. J., Farewell, V. T., & Gladman, D. D. (2000). Methods for assessing responsiveness. J. Clin. Epidemiol., 53(5), 459-468. https://doi.org/10.1016/s0895-4356(99)00206-1
Johnston, M., Dixon, D., Hart, J., Glidewell, L., Schroder, C., & Pollard, B. (2014). Discriminant content validity: a quantitative methodology for assessing content of theory-based measures, with illustrative applications. Br. J. Health Psychol., 19(2), 240-257. https://doi.org/10.1111/bjhp.12095
Johnston, M., Weinman, J., Ozakinci, G. (2021) Measurement in health psychology research and practice. Oxf. Bibliograph.. https://doi.org/10.1093/OBO/9780199828340-0270.
Kahneman, D., Fredrickson, B. L., Schreiber, C. A., & Redelmeier, D. A. (1993). When more pain is preferred to less: adding a better end. Psychol. Sci., 4(6), 401-405. https://doi.org/10.1111/j.1467-9280.1993.tb00589.x
Kahneman, D., Krueger, A.B., Schkade, D.A., Schwarz, N., and Stone, A.A., A survey method for characterizing daily life experience: the day reconstruction method, Science, 306 (5702), 2004, 1776-1780. https://doi.org/10.1126/science.1103572.
Kalokerinos, E. K., Murphy, S. C., Koval, P., Bailen, N. H., Crombez, G., Hollenstein, T., et al. (2020). Neuroticism may not reflect emotional variability. Proc. Natl. Acad. Sci. U. S. A., 117(17), 9270-9276. https://doi.org/10.1073/pnas.1919934117
Karademas, E. C., Benyamini, Y., & Johnston, M. (2016). Introduction. In Y. Benyamini, M. Johnston, & E. C. Karademas (Eds.), Assessment in Health Psychology (pp. 3-16). Hogrefe Publishing.
Karran, E. L., McAuley, J. H., Traeger, A. C., Hillier, S. L., Grabherr, L., Russek, L. N., & Moseley, G. L. (2017). Can screening instruments accurately determine poor outcome risk in adults with recent onset low back pain? A systematic review and meta-analysis. BMC Med., 15(1). https://doi.org/10.1186/s12916-016-0774-4
Kirshner, B., & Guyatt, G. (1985). A methodological framework for assessing health indices. J. Chron. Dis., 38(1), 27-36. https://doi.org/10.1016/0021-9681(85)90005-0
Kuru, O., & Pasek, J. (2016). Improving social media measurement in surveys: avoiding acquiescence bias in Facebook research. Comput. Hum. Behav., 57, 82-92. https://doi.org/10.1016/j.chb.2015.12.008
Lauwerier, E., Caes, L., Van Damme, S., Goubert, L., Rosseel, Y., & Crombez, G. (2015). Acceptance: what's in a name? A content analysis of acceptance instruments in individuals with chronic pain. J. Pain, 16(4), 306-317. https://doi.org/10.1016/j.jpain.2015.01.001
Legenbauer, T., Radix, A. K., Augustat, N., Schutt-Stromel S.(2018). Power of cognition: how dysfunctional cognitions and schemas influence eating behavior in daily life among individuals with eating disorders. Front. Psychol., 9:2138. https://doi.org/10.3389/fpsyg.2018.02138
Leventhal, H. (1970). Findings and theory in the study of fear communications. In L. Berkowitz (Ed.), Advances in Experimental Social Psychology (vol. 5, pp. 120-186). New York: Academic.
Lilienfeld, S. O., Pydych, A. L., Lynn, S. J., Latzman, R. D., & Waldman, I. D. (2017). 50 differences that make a difference: a compendium of frequently confused term pairs in psychology. Front. Educ., 2(37). https://doi.org/10.3389/feduc.2017.00037
Main, C.J., & Spanswick, C.C. (1995). Personality assessment and the Minnesota multiphasic personality inventory: 50 years on: do we still need our security blanket? Pain Forum, 4, 90-96. https://doi.org/10.1016/S1082-3174(11)80005-X
McClimans, L. (2013). The role of measurement in establishing evidence. J. Med. Philos., 38(5), 520-538. https://doi.org/10.1093/jmp/jht041
Meissner, F., Grigutsch, L. A., Koranyi, N., Muller, F., & Rothermund, K. (2019). Predicting behavior with implicit measures: disillusioning findings, reasonable explanations, and sophisticated solutions. Front. Psychol., 10. https://doi.org/10.3389/fpsyg.2019.02483
Messick SJ. The psychology of acquiescence: an interpretation of research evidence. In: Berg IA, editor. Response Set in Personality Assessment. Chicago: Aldine; 1967. pp. 115-145.
Meterko, M., Marfeo, E. E., McDonough, C. M., Jette, A. M., Ni, P., Bogusz, K., Rasch, E. K., Brandt, D. E., & Chan, L. (2015). Work disability functional assessment battery: feasibility and psychometric properties. Arch. Phys. Med. Rehabil., 96(6), 1028-1035.
Mokkink, L. B., Terwee, C. B., Stratford, P. W., Alonso, J., Patrick, D. L., Riphagen, I., Knol, D. L., Bouter, L. M., & De Vet, H. C. W. (2009). Evaluation of the methodological quality of systematic reviews of health status measurement instruments. Qual. Life Res., 18(3), 313-333.
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & De Vet, H. C. W. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J. Clin. Epidemiol., 63(7),737-745. https://doi.org/10.1016/j.jclinepi.2010.02.006.
Moskowitz, D. S., Russell, J. J., Sadikaj, G., & Sutton, R. (2009). Measuring people intensively. Can. Psychol., 50(3), 131-140. https://doi.org/10.1037/a0016625
Moss-Morris, R., Weinman, J., Petrie, K. J., Horne, R., Cameron, L.D., & Buick, D. (2002). The revised illness perception questionnaire (IPQ-R). Psychol. Health, 17, 1-16. https://doi.org/10.1080/08870440290001494
Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2017). Just-in-Time Adaptive Interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann. Behav. Med., 52(6), 446-462. https://doi.org/10.1007/s12160-016-9830-8
Norquist, J. M., Girman, C., Fehnel, S., DeMuro-Mercon, C., & Santanello, N. (2011). Choice of recall period for patient-reported outcome (PRO) measures: criteria for consideration. Qual. Life Res., 21(6), 1013-1020. https://doi.org/10.1007/s11136-011-0003-8
Peters, G. J. Y., & Crutzen, R. (2017). Pragmatic nihilism: how a theory of nothing can help health psychology progress. Health Psychol. Rev., 11(2), 103-121. https://doi.org/10.1080/17437199.2017.1284015
Poppe, L., De Bourdeaudhuij, I., Verloigne, M., Degroote, L., Shadid, S., & Crombez, G. (2019). A self-regulation-based eHealth and mHealth intervention for an active lifestyle in adults with type 2 diabetes: protocol for a randomized controlled trial. JMIR Res. Protocols, 8(3), e12413. https://doi.org/10.2196/12413
Presseau, J., McCleary, N., Lorencatto, F., Patey, A. M., Grimshaw, J. M., & Francis, J. J. (2019). Action, actor, context, target, time (AACTT): a framework for specifying behavior. Implement. Sci., 14(102). https://doi.org/10.1186/s13012-019-0951-x
Rammstedt, B., Danner, D., & Bosnjak, M. (2017). Acquiescence response styles: a multilevel model explaining individual-level and country-level differences. Pers. Indiv. Differ., 107, 190-194. https://doi.org/10.1016/j.paid.2016.11.038
Revelle, W., Zinbarg, R.E. Coefficients alpha, beta, omega, and the glb: comments on Sijtsma. Psychometrika 74, 145 (2009). https://doi.org/10.1007/s11336-008-9102-z
Riley, W. T., Rothrock, N., Bruce, B., Christodolou, C., Cook, K., Hahn, E. A., & Cella, D. (2010). Patient-reported outcomes measurement information system (PROMIS) domain names and definitions revisions: further evaluation of content validity in IRT-derived item banks. Qual. Life Res., 19(9), 1311-1321. https://doi.org/10.1007/s11136-010-9694-5
Rosenstock, I. M. (1974). Historical origins of the health belief model. Health Educ. Monogr., 2(4), 328-335. https://doi.org/10.1177/109019817400200403
Rost, S., Crombez, G., Sutterlin, S., Vogele, C., Veirman, E., & Van Ryckeghem, D. M. L. (2020). Altered regulation of negative affect in patients with fibromyalgia: a diary study. Eur. J. Pain, 25(3), 714-724. https://doi.org/10.1002/ejp.1706
Schwarz, N. (2012). Why researchers should think “real-time”: a cognitive rationale. In M. R. Mehl & T. S. Conner (Eds.), Handbook of Research Methods for Studying Daily Life (pp. 22-42). The Guilford Press.
Schwarzer, R., & Luszczynska, A. (2008). How to overcome health-compromising behaviors: the health action process approach. Eur. Psychol., 13,141-151. https://doi.org/10.1027/1016-9040.13.2.141
Shalhoub, H., & Reaney, M. (2016). PROMIS® tools as endpoints in clinical trials: what should you know? A review of PROMIS® capabilities and the current regulatory space. Int. J. Clin. Trials, 3(4), 174-179. https://doi.org/10.18203/2349-3259.ijct20163953
Sheeran, P., Bosch, J. A., Crombez, G., Hall, P. A., Harris, J. L., Papies, E. K., & Wiers, R. W. (2016). Implicit processes in health psychology: diversity and promise. Health Psychol., 35(8), 761-766. https://doi.org/10.1037/hea0000409
Shevchenko, Y., Kuhlmann, T., & Reips, U. D. (2021). Samply: a user-friendly smartphone app and web-based means of scheduling and sending mobile notifications for experience-sampling research. Behav. Res. Methods. Published. https://doi.org/10.3758/s13428-020-01527-9
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008). Ecological momentary assessment. Annu. Rev. Clin. Psychol., 4(1), 1-32. https://doi.org/10.1146/annurev.clinpsy.3.022806.091415
Sijtsma, K. (2008). On the use, the misuse, and the very limited usefulness of Cronbach's alpha. Psychometrika, 74(1), 107-120. https://doi.org/10.1007/s11336-008-9101-0
Soyster, P. D., Bosley, H. G., Reeves, J. W., Altman, A. D., & Fisher, A. J. (2019). Evidence for the feasibility of person-specific ecological momentary assessment across diverse populations and study designs. J. Pers. Oriented Res., 5(2), 53-64. https://doi.org/10.17505/jpor.2019.06
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010). Assessing the performance of prediction models. Epidemiology, 21(1), 128-138. https://doi.org/10.1097/ede.0b013e3181c30fb2
Stone, A. A., Schwartz, J. E., Broderick, J. E., & Shiffman, S. S. (2005). Variability of momentary pain predicts recall of weekly pain: a consequence of the peak (or salience) memory heuristic. Pers. Soc. Psychol. Bull., 31(10), 1340-1346. https://doi.org/10.1177/0146167205275615
Streiner, D. L., & Norman, G. R. (2008). Health Measurement Scales: A Practical Guide to Their Development and Use (fourth ed.). Oxford University Press.
Stull, D. E., Leidy, N. K., Parasuraman, B., & Chassany, O. (2009). Optimal recall periods for patient-reported outcomes: challenges and potential solutions. Curr. Med. Res. Opin., 25(4), 929-942. https://doi.org/10.1185/03007990902774765.
Sutton, S., French, D. P., Hennings, S. J., Mitchell, J., Wareham, N. J., Griffin, S., Hardeman, W., & Kinmonth, A. L. (2003). Eliciting salient beliefs in research on the theory of planned behavior: the effect of question wording. Curr. Psychol., 22(3), 234-251. https://doi.org/10.1007/s12144-003-1019-1
Terwee, C., Dekker, F. W., Wiersinga, W. M., Prummel, M. F., & Bossuyt, P. M. M. (2003). On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual. Life Res., 12(4), 349-362. https://doi.org/10.1023/a:1023499322593
Topp, J., Andrees, V., Heesen, C., Augustin, M., & Blome, C. (2019). Recall of health-related quality of life: how does memory affect the SF-6D in patients with psoriasis or multiple sclerosis? A prospective observational study in Germany. BMJ Open, 9(11), e032859. https://doi.org/10.1136/bmjopen-2019-032859
Van Ryckeghem, D., Crombez, G., Goubert, L., De Houwer, J., Onraedt, T., & Van Damme, S. (2013). The predictive value of attentional bias towards pain-related information in chronic pain patients: a diary study. Pain, 154(3), 468-475.
Van Ryckeghem, D. M. L. (2020). Acceptance is not acceptance, but acceptance! Eur. J. Pain, 25(1), 3-4. https://doi.org/10.1002/ejp.1672
Veirman, E., Van Ryckeghem, D. M. L., Verleysen, G., De Paepe, A. L., & Crombez, G. (2021). What do alexithymia items measure? A discriminant content validity study of the Toronto-alexithymia-scale-20. PeerJ, 9, e11639. https://doi.org/10.7717/peerj.11639
Vlaeyen, JWS and Linton, SJ., Fear-avoidance and its consequences in chronic musculoskeletal pain: a state of the art, Pain. 85 (3), 2000, 317-332. https://doi.org/10.1016/S0304-3959(99)00242-0.
Wiering, B., De Boer, D., & Delnoij, D. (2016). Patient involvement in the development of patient-reported outcome measures: a scoping review. Health Expect., 20(1), 11-23. https://doi.org/10.1111/hex.12442
Wilhelm, P., Perrez, M., Pawlik, K.(2012). Conducting research in daily life: a historical review. In M. R. Mehl & T. S. Conner (Eds.), Handbook of Research Methods for Studying Daily Life (pp. 22-42). The Guilford Press.
Willis GB. 2015. Analysis of the Cognitive Interview in Questionnaire Design. Oxford: Oxford University Press
Zigmond, A.S., & Snaith, R.P. (1983). The hospital anxiety and depression scale. Acta Psychiatr. Scand., 67(6), 361-370. https://doi: 10.1111/j.1600-0447.1983.tb09716.x.