Hostname: page-component-8448b6f56d-mp689 Total loading time: 0 Render date: 2024-04-16T06:35:55.781Z Has data issue: false hasContentIssue false
  • English
  • Français

Comparative study of the pencil-and-paper and digital formats of the Spanish DARS scale

Published online by Cambridge University Press:  23 December 2021

Elsa Arrua-Duarte ,
Marta Migoya-Borja ,
Igor Barahona ,
Lena C. Quilty ,
Sakina J. Rizvi ,
Sidney H. Kennedy ,
Enrique Baca-García  and
Maria L. Barrigon Open the ORCID record for Maria L. Barrigon [Opens in a new window]
Elsa Arrua-Duarte
Affiliation:
Department of Psychiatry, Fundación Jiménez Díaz University Hospital, Madrid, Spain Department of Psychiatry, Autónoma University, Madrid, Spain
Marta Migoya-Borja
Affiliation:
Department of Psychiatry, Fundación Jiménez Díaz University Hospital, Madrid, Spain
Igor Barahona
Affiliation:
Instituto de Matemáticas, Universidad Nacional Autónoma de México, México City, Mexico
Lena C. Quilty
Affiliation:
Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Canada Department of Psychiatry, University of Toronto, Toronto, ON, Canada
Sakina J. Rizvi
Affiliation:
Department of Psychiatry, University of Toronto, Toronto, ON, Canada Arthur Sommer Rotenberg Suicide and Depression Studies Program, St. Michael’s Hospital, Toronto, ON, Canada
Sidney H. Kennedy
Affiliation:
Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Canada Department of Psychiatry, University of Toronto, Toronto, ON, Canada
Enrique Baca-García
Affiliation:
Department of Psychiatry, Fundación Jiménez Díaz University Hospital, Madrid, Spain Department of Psychiatry, Autónoma University, Madrid, Spain Department of Psychiatry, Rey Juan Carlos University Hospital, Móstoles, Spain Department of Psychiatry, General Hospital of Villalba, Madrid, Spain Department of Psychiatry, Infanta Elena University Hospital, Valdemoro, Spain Universidad Católica del Maule, Talca, Chile Department of Adult Psychiatry, University Hospital Nimes, Nimes, France CIBERSAM (Centro de Investigación Biomédica en Red Salud Mental), Carlos III Institute of Health, Madrid, Spain
Maria L. Barrigon*
Affiliation:
Department of Psychiatry, Fundación Jiménez Díaz University Hospital, Madrid, Spain Department of Psychiatry, Virgen del Rocio University Hospital, Seville, Spain
*
Author for correspondence: Maria L. Barrigón, Email: marisabe@gmail.com
Get access Rights & Permissions [Opens in a new window]

Abstract

The Dimensional Anhedonia Rating Scale (DARS) is a novel questionnaire to assess anhedonia of recent validation. In this work, we aim to study the equivalence between the traditional paper-and-pencil and the digital format of DARS. Sixty-nine patients filled the DARS in a paper-based and digital versions. We assessed differences between formats (Wilcoxon test), validity of the scales [Kappa and intraclass correlation coefficients (ICCs)], and reliability (Cronbach’s alpha and Guttman’s coefficient). We calculated the comparative fit index and the root mean squared error (RMSE) associated with the proposed one-factor structure. Total scores were higher for paper-based format. Significant differences between both formats were found for three items. The weighted Kappa coefficient was approximately 0.40 for most of the items. Internal consistency was greater than 0.94, and the ICC for the digital version was 0.95 and 0.94 for the paper-and-pencil version (F = 16.7, p < 0.001). Comparative Adjustment Index was 0.97 for the digital DARS and 0.97 for the paper-and-pencil DARS, and RMSE was 0.11 for the digital DARS and 0.10 for the paper-and-pencil DARS. We concluded that the digital DARS is consistent in many respects with the paper-and-pencil questionnaire, but equivalence with this format cannot be assumed without caution.

Keywords

anhedoniadepressionDimensional Anhedonia Rating Scalepsychometricstelemedicine
Type
Original Article
Information
Acta Neuropsychiatrica , Volume 34 , Issue 5 , October 2022 , pp. 253 - 259
Check for updates
Copyright
© The Author(s), 2021. Published by Cambridge University Press on behalf of Scandinavian College of Neuropsychopharmacology

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Alfonsson, S, Maathz, P and Hursti, T (2014) Interformat reliability of digital psychiatric self-report questionnaires: a systematic review. Journal of Medical Internet Research 16(12), e268. doi: 10.2196/jmir.3395.CrossRefGoogle ScholarPubMed
American Psychiatric Association (2013) Diagnostic and Statistical Manual of Mental Disorders, 5th edn. Arlington, VA: American Psychiatric Pub.CrossRefGoogle Scholar
Arrua-Duarte, E, Migoya-Borja, M, Barrigón, ML, Barahona, I, Delgado-Gomez, D, Courtet, P, Aroca, F, Rizvi, SJ, Kennedy, SH, Quilty, LC, Baca-García, E (2019) Spanish adaptation of the Dimensional Anhedonia Rating Scale (DARS). Journal of Affective Disorders 245(3), 702–707. doi: 10.1016/j.jad.2018.11.040.CrossRefGoogle Scholar
Barak, A (2007) Emotional support and suicide prevention through the Internet: a field project report. Computers in Human Behavior 23(2), 971–984. doi: 10.1016/j.chb.2005.08.001.CrossRefGoogle Scholar
Barrig, ón, ML, Berrouiguet, S, Carballo, JJ, Bonal-Giménez, C, Fernández-Navarro, P, Pfang, B, Delgado-Gómez, D, Courtet, P, Aroca, F, Lopez-Castroman, J, Artés-Rodríguez, A, Baca-García, E and MEmind study group (2017) User profiles of an electronic mental health tool for ecological momentary assessment: MEmind. International Journal of Methods in Psychiatric Research 26(1), e1554. doi:10.1002/mpr.1554.CrossRefGoogle Scholar
Bentler, PM (1990) Comparative fit indexes in structural models. Psychological Bulletin 107(2), 238–246.CrossRefGoogle ScholarPubMed
Chapman, LJ, Chapman, JP and Raulin, ML (1976) Scales for physical and social anhedonia. Journal of Abnormal Psychology 85(4), 374–382. doi: 10.1037/0021-843X.85.4.374.CrossRefGoogle ScholarPubMed
Christensen, H and Hickie, IB (2010) Using e-health applications to deliver new mental health services. Medical Journal of Australia 192(11), S85.Google ScholarPubMed
Coons, SJ, Gwaltney, CJ, Hays, RD, Lundy, JJ, Sloan, JA, Revicki, DA, Lenderking, WR, Cella, D and Basch, E (2009) Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO Good Research Practices Task Force Report. Value in Health 12(4), 419–429. doi: 10.1111/j.1524-4733.2008.00470.x.CrossRefGoogle ScholarPubMed
Cronbach, LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16(3), 297–334. doi: 10.1007/BF02310555.CrossRefGoogle Scholar
Der-Avakian, A and Markou, A (2012) The neurobiology of anhedonia and other reward-related deficits. Trends in Neurosciences 35(1), 68–77. doi: 10.1016/j.tins.2011.11.005.CrossRefGoogle ScholarPubMed
Fleiss, JL (1971) Measuring nominal scale agreement among many raters. Psychological Bulletin 76(5), 378–382. doi: 10.1037/h0031619.CrossRefGoogle Scholar
Fleiss, JL, Levin, B and Paik, MC (2003) The measurement of interrater agreement. In: Statistical Methods for Rates and Proportions. 3rd Edn. Hobboken, NJ: John Wiley & Sons, Inc., pp. 598–626.CrossRefGoogle Scholar
Fonseca-Pedrero, E, Paino, M, Lemos-Giráldez, S, García-Cueto, E, Villazón-García, Ú., Bobes, J and Muñiz, J (2009) Psychometric properties of the Revised Physical and Social Anhedonia Scales in non-clinical young adults. The Spanish Journal of Psychology 12(2), 815–822. doi: 10.1017/s1138741600002183.CrossRefGoogle ScholarPubMed
Fresán, A and Berlanga, C (2013) Translation into Spanish and validation of the Snaith-Hamilton Pleasure Scale (SHAPS) for anhedonia. Actas Españolas De Psiquiatría 41(4), 227–231.Google ScholarPubMed
Gooding, DC, Fonseca-Pedrero, E, Pérez de Albéniz, A, Ortuño-Sierra, J and Paino, M (2016) Adaptación española de la versión para adultos de la Escala de Placer Interpersonal Anticipatorio y Consumatorio. Revista de Psiquiatría y Salud Mental 9(2), 70–77. doi: 10.1016/j.rpsm.2015.10.006.CrossRefGoogle Scholar
Guttman, L (1945) A basis for analyzing test-retest reliability. Psychometrika 10(4), 255–282. doi: 10.1007/BF02288892.CrossRefGoogle ScholarPubMed
Gwaltney, CJ, Shields, AL and Shiffman, S (2008) Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review. Value in Health 11(2), 322–333. doi: 10.1111/j.1524-4733.2007.00231.x.CrossRefGoogle ScholarPubMed
Hodson, R (2018) Digital revolution. Nature 563(7733), S131. doi: 10.1038/d41586-018-07500-z.CrossRefGoogle ScholarPubMed
Keesara, S, Jonas, A and Schulman, K (2020) Covid-19 and Health Care’s Digital Revolution. New England Journal of Medicine 382(23), e82. doi: 10.1056/NEJMp2005835.CrossRefGoogle ScholarPubMed
Koo, TK and Li, MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine 15(2), 155–163. doi: 10.1016/j.jcm.2016.02.012.CrossRefGoogle ScholarPubMed
Lehmann, EL and Casella, G (1998) Theory of Point Estimation, 2nd edn. New York: Springer-Verlag, 10.1007/b98854 Google Scholar
Lin, C-C, Bai, Y-M, Liu, C-Y, Hsiao, M-C, Chen, J-Y, Tsai, S-J, Ouyang, W-C, Wu, C-H and Li, Y-C (2007) Web-based tools can be used reliably to detect patients with major depressive disorder and subsyndromal depressive symptoms. BMC Psychiatry 7(1), 12. doi: 10.1186/1471-244X-7-12.CrossRefGoogle ScholarPubMed
Prensky, M (2001) Digital natives, digital immigrants part 1. On the Horizon 9(5), 1–6. doi: 10.1108/10748120110424816.Google Scholar
McCutcheon, RA, Abi-Dargham, A and Howes, OD (2019) Schizophrenia, dopamine and the striatum: from biology to symptoms. Trends in Neurosciences 42(3), 205–220. doi: 10.1016/j.tins.2018.12.004.CrossRefGoogle ScholarPubMed
Montoro, M, Arrua-Duarte, E, Peñalver-Argüeso, B, Migoya-Borja, M, Baca-Garcia, E and Barrigón, ML (2020) Comparative study of paper-and-pencil and electronic formats of the Snaith-Hamilton Pleasure Scale. Journal of Health Psychology 192(11), 135910532096355. doi: 10.1177/1359105320963552.Google Scholar
Ribot, T (1897) The Psychology of the Emotions. London; New York: W. Scott Pub. Co. ; C. Scribner’s, Available at=http://books.google.com/books?id=MBwFAQAAIAAJ, 13 June 2020,Google Scholar
Risko, EF, Quilty, LC and Oakman, JM (2006) Socially desirable responding on the web: investigating the candor hypothesis. Journal of Personality Assessment 87(3), 269–276. doi: 10.1207/s15327752jpa8703_08.CrossRefGoogle ScholarPubMed
Ritsner, MS (2014) Anhedonia: a Comprehensive Handbook Volume II: Neuropsychiatric and Physical Disorders. Springer Science & Business Media.Google Scholar
Rizvi, SJ, Quilty, LC, Sproule, BA, Cyriac, A, Bagby, RM and Kennedy, SH (2015) Development and validation of the Dimensional Anhedonia Rating Scale (DARS) in a community sample and individuals with major depression. Psychiatry Research 229(1-2), 109–119. doi: 10.1016/j.psychres.2015.07.062.CrossRefGoogle Scholar
Shrout, PE and Fleiss, JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychological Bulletin 86(2), 420–428. doi: 10.1037//0033-2909.86.2.420.CrossRefGoogle ScholarPubMed
Snaith, RP, Hamilton, M, Morley, S, Humayan, A, Hargreaves, D and Trigwell, P (1995) A scale for the assessment of hedonic tone the Snaith-Hamilton Pleasure Scale. The British Journal of Psychiatry: The Journal of Mental Science 167(1), 99–103.CrossRefGoogle ScholarPubMed
Thorndike, FP, Carlbring, P, Smyth, FL, Magee, JC, Gonder-Frederick, L, Ost, L-G and Ritterband, LM (2009) Web-based measurement: effect of completing single or multiple items per webpage. Computers in Human Behavior 25(2), 393–401. doi: 10.1016/j.chb.2008.05.006.CrossRefGoogle Scholar
Torous, J, Staples, P, Shanahan, M, Lin, C, Peck, P, Keshavan, M and Onnela, J-P (2015) Utilizing a personal smartphone custom app to assess the Patient Health Questionnaire-9 (PHQ-9) depressive symptoms in patients with major depressive disorder. JMIR Mental Health 2(1), e8. doi: 10.2196/mental.3889.CrossRefGoogle ScholarPubMed
Tourangeau, R, Couper, MP and Conrad, F (2004) Spacing, position, and order interpretive heuristics for visual features of survey questions. Public Opinion Quarterly 68(3), 368–393. doi: 10.1093/poq/nfh035.Google Scholar
Treadway, MT and Zald, DH (2011) Reconsidering anhedonia in depression: lessons from translational neuroscience. Neuroscience & Biobehavioral Reviews 35(3), 537–555. doi: 10.1016/j.neubiorev.2010.06.006.CrossRefGoogle ScholarPubMed
Trøstheim, M, Eikemo, M, Meir, R, Hansen, I, Paul, E, Kroll, SL, Garland, EL and Leknes, S (2020) Assessment of anhedonia in adults with and without mental illness: a systematic review and meta-analysis. JAMA Network Open 3(8), e2013233. doi: 10.1001/jamanetworkopen.2020.13233.CrossRefGoogle ScholarPubMed
van Ballegooijen, W, Riper, H, Cuijpers, P, van Oppen, P and Smit, JH (2016) Validation of online psychometric instruments for common mental health disorders: a systematic review. BMC Psychiatry 16, 45. doi: 10.1186/s12888-016-0735-7.CrossRefGoogle ScholarPubMed
Wellan, SA, Daniels, A and Walter, H (2021) State anhedonia in young healthy adults: psychometric properties of the German Dimensional Anhedonia Rating Scale (DARS) and effects of the COVID-19 pandemic. Frontiers in Psychology 12, 682824. doi: 10.3389/fpsyg.2021.682824.CrossRefGoogle ScholarPubMed
Wild, D, Eremenco, S, Mear, I, Martin, ML, Houchin, C, Gawlicki, MC, Hareendran, A, Wiklund, I, Chong, LY, von Maltzahn, R, Cohen, L, Molsen-David, E (2009) Multinational trials-recommendations on the translations required, approaches to using the same language in different countries, and the approaches to support pooling the data: the ISPOR Patient-Reported Outcomes Translation and Linguistic Validation Good Research Practices Task Force report. Value in Health: The Journal of the International Society for Pharmacoeconomics and Outcomes Research 12(4), 430–440. doi: 10.1111/j.1524-4733.2008.00471.x.CrossRefGoogle ScholarPubMed