Skip to main content Accessibility help
×
Home

Revising the self-report strengths and difficulties questionnaire for cross-country comparisons of adolescent mental health problems: the SDQ-R

  • E. L. Duinhof (a1), K. M. Lek (a2), M. E. de Looze (a1), A. Cosma (a1) (a3), J. Mazur (a4), I. Gobina (a5), A. Wüstner (a6), W. A. M. Vollebergh (a1) and G. W. J. M. Stevens (a1)...

Abstract

Aims

The Strengths and Difficulties Questionnaire (SDQ) has been used in many epidemiological studies to assess adolescent mental health problems, but cross-country comparisons of the self-report SDQ are scarce and so far failed to find a good-fitting, common, invariant measurement model across countries. The present study aims to evaluate and establish a version of the self-report SDQ that allows for a valid cross-country comparison of adolescent self-reported mental health problems.

Methods

Using the Health Behaviour in School-aged Children study, the measurement model and measurement invariance of the 20 items of the self-report SDQ measuring adolescent mental health problems were evaluated. Nationally representative samples of 11-, 13- and 15-year old adolescents (n = 33 233) from seven countries of different regions in Europe (Bulgaria, Germany, Greece, the Netherlands, Poland, Romania, Slovenia) were used.

Results

In order to establish a good-fitting and common measurement model, the five reverse worded items of the self-report SDQ had to be removed. Using this revised version of the self-report SDQ, the SDQ-R, partial measurement invariance was established, indicating that latent factor means assessing conduct problems, emotional symptoms, peer relationships problems and hyperactivity-inattention problems could be validly compared across the countries in this study. Results showed that adolescents in Greece scored relatively low on almost all problem subscales, whereas adolescents in Poland scored relatively high on almost all problem subscales. Adolescents in the Netherlands reported the most divergent profile of mental health problems with the lowest levels of conduct problems, low levels of emotional symptoms and peer relationship problems, but the highest levels of hyperactivity-inattention problems.

Conclusions

With six factor loadings being non-invariant, partial measurement invariance was established, indicating that the 15-item SDQ-R could be used in our cross-country comparison of adolescent mental health problems. To move the field of internationally comparative research on adolescent mental health forward, studies should test the applicability of the SDQ-R in other countries in- and outside Europe, continue to develop the SDQ-R as a cross-country invariant measure of adolescent mental health, and examine explanations for the found country differences in adolescent mental health problems.

Copyright

Corresponding author

Author for correspondence: Edith L. Duinhof, E-mail: e.l.duinhof@uu.nl

References

Hide All
Achenbach, TM, Rescorla, LA and Ivanova, MY (2012) International epidemiology of child and adolescent psychopathology I: diagnoses, dimensions, and conceptual issues. Journal of the American Academy of Child and Adolescent Psychiatry 51, 12611272.
American Psychiatric Association (2013) Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). Kernberg: American Psychiatric Association Publishing.
Asparouhov, T and Muthén, BO (2009) Exploratory structural equation modeling. Structural Equation Modeling 16, 397438.
Bowen, NK and Masa, RD (2015) Conducting measurement invariance tests with ordinal data: a guide for social work researchers. Journal of the Society for Social Work and Research 6, 229249.
Bradshaw, J and Richardson, D (2009) An index of child well-being in Europe. Child Indicators Research 2, 319351.
Browne, MW and Cudeck, R (1992) Alternative ways of assessing model fit. Sociological Methods and Research 21, 230258.
Byrne, BM (2012) Structural Equation Modeling with Mplus: Basic Concepts, Applications, and Programming. New York: Routledge.
Chen, FF (2007) Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling 14, 464504.
Cheung, GW and Rensvold, RB (1999) Testing factorial invariance across groups: a reconceptualization and proposed new method. Journal of Management 25, 127.
Cheung, GW and Rensvold, RB (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling 9, 233255.
Cohen, J (1988) Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. Hillsdale: Lawrence Erlbaum Associates.
Currie, C, Griebler, R, Inchley, J, Theunissen, A, Molcho, M, Samdal, O and Dür, W (2010) Health Behaviour in School-Aged Children (HBSC) Study Protocol: Background, Methodology and Mandatory Items for the 2009/2010 Survey. Edinburgh, Vienna: CAHRU, LBIHPR.
Currie, C, Inchley, J, Molcho, M, Lenzi, M, Veselska, Z and Wild, F (2014) Health Behaviour in School-Aged Children (HBSC) Study Protocol: Background, Methodology and Mandatory Items for the 2013/2014 Survey. St Andrews: CAHRU.
De Vries, PJ, Davids, EL, Mathews, C and Aarø, LE (2018) Measuring adolescent mental health around the globe: psychometric properties of the self-report strengths and difficulties questionnaire in South Africa, and comparison with UK, Australian and Chinese data. Epidemiology and Psychiatric Sciences 27, 369380.
Dimitrov, DM (2010) Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development 43, 121149.
Duinhof, EL, Stevens, GWJM, van Dorsselaer, S, Monshouwer, K and Vollebergh, WAM (2015) Ten-year trends in adolescents’ self-reported emotional and behavioral problems in the Netherlands. European Child and Adolescent Psychiatry 24, 11191128.
Erskine, HE, Baxter, AJ, Patton, G, Moffitt, TE, Patel, V, Whiteford, HA and Scott, JG (2017) The global coverage of prevalence data for mental disorders in children and adolescents. Epidemiology and Psychiatric Sciences 26, 395402.
Essau, CA, Olaya, B, Anastassiou-Hadjicharalambous, X, Pauli, G, Gilvarry, C, Bray, D, O'Callaghan, J and Ollendick, TH (2012) Psychometric properties of the strength and difficulties questionnaire from five European countries. International Journal of Methods in Psychiatric Research 21, 232245.
Ford, J, MacCallum, R and Tait, M (1986) The application of exploratory factor analysis in applied psychology: a critical review and analysis. Personnel Psychology 39, 291314.
Gadermann, AM, Guhn, M and Zumbo, BD (2012) Estimating ordinal reliability for Likert-type and ordinal item response data: a conceptual, empirical, and practical guide. Practical Assessment, Research and Evaluation 17, 113.
Garrido, LE, Barrada, JR, Aguasvivas, JA, Martínez-Molina, A, Arias, VB, Golino, HF, Legaz, E, Ferris, G and Rojo-Moreno, L (2018) Is small still beautiful for the Strengths and Difficulties Questionnaire? Novel findings using exploratory structural equation modeling. Assessment 119.
Goodman, R (1997) The strengths and difficulties questionnaire: a research note. Journal of Child Psychology and Psychiatry 38, 581586.
Goodman, R (2001) Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry 40, 13371345.
Hermida, R (2015) The problem of allowing correlated errors in structural equation modeling: concerns and considerations. Computational Methods in Social Sciences 3, 517.
Hu, L and Bentler, PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling 6, 155.
Inchley, J, Currie, D, Young, T, Samdal, O, Torsheim, T, Augustson, L, Mathison, F, Aleman-Diaz, A, Molcho, M, Weber, M and Barnekow, V (2016) Growing up Unequal: Gender and Socioeconomic Differences in Young People's Health and Well-Being: Health Behaviour in School-Aged Children (HBSC) Study: International Report from the 2013/2014 Survey. Copenhagen: WHO Regional Office for Europe.
Johnson, EC, Meade, AW and DuVernet, AM (2009) The role of referent indicators in tests of measurement invariance. Structural Equation Modeling 16, 642657.
Klocke, A, Clair, A and Bradshaw, J (2014) International variation in child subjective well-being. Child Indicators Research 7, 120.
Kyriazos, TA (2018) Applied psychometrics: the 3-faced construct validation method, a routine for evaluating a factor structure. Psychology 9, 20442072.
Muthén, LK and Muthén, BO (2017) User's Guide, 8th Edn. Los Angeles: Muthén & Muthén.
Nunnally, J and Bernstein, I (1967) Psychometric Theory. New York: McGraw-Hill.
Ortuño-Sierra, J, Fonseca-Pedrero, E, Aritio-Solana, R, Velasco, AM, de Luis, EC, Schumann, G, Cattrell, A, Flor, H, Nees, F, Banaschewski, T, Bokde, A, Whelan, R, Buechel, C, Bromberg, U, Conrod, P, Frouin, V, Papadopoulos, D, Gallinat, J, Garavan, H, Heinz, A, Walter, H, Struve, M, Gowland, P, Paus, T, Poustka, LM, Martinot, J-L, Paillère-Martinot, M-L, Vetter, NC, Smolka, MN and Lawrence, C (2015) New evidence of factor structure and measurement invariance of the SDQ across five European nations. European Child and Adolescent Psychiatry 24, 15231534.
Patel, V, Flisher, AJ, Hetrick, S and McGorry, P (2007) Mental health of young people: a global public-health challenge. Lancet 369, 13021313.
Polanczyk, GV, Salum, GA, Sugaya, LS, Caye, A and Rohde, LA (2015) Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. Journal of Child Psychology and Psychiatry 56, 345365.
Ravens-Sieberer, U, Erhart, M, Gosch, A and Wille, N (2008) Mental health of children and adolescents in 12 European countries - results from the European KIDSCREEN study. Clinical Psychology and Psychotherapy 15, 154163.
Rutter, M, Kim-Cohen, J and Maughan, B (2006) Continuities and discontinuities in psychopathology between childhood and adult life. Journal of Child Psychology and Psychiatry 47, 276295.
Steinmetz, H (2013) Analyzing observed composite differences across groups: is partial measurement invariance enough? Methodology 9, 112.
Stevanovic, D, Urbán, R, Atilola, O, Vostanis, P, Singh Balhara, YP, Avicenna, M, Kandemir, H, Knez, R, Franic, T and Petrov, P (2015) Does the strengths and difficulties questionnaire-self report yield invariant measurements across different nations? Data from the International Child Mental Health Study Group. Epidemiology and Psychiatric Sciences 24, 323334.
Stevanovic, D, Jafari, P, Knez, R, Franic, T, Atilola, O, Davidovic, N, Bagheri, Z and Lakic, A (2017) Can we really use available scales for child and adolescent psychopathology across cultures? A systematic review of cross-cultural measurement invariance data. Transcultural Psychiatry 54, 125152.
Van de Looij-Jansen, PM, Goedhart, AW, de Wilde, EJ and Treffers, PD (2011) Confirmatory factor analysis and factorial invariance analysis of the adolescent self-report Strengths and Difficulties Questionnaire: how important are method effects and minor factors? British Journal of Clinical Psychology 50, 127144.
Vollebergh, WA, Van Dorsselaer, S, Monshouwer, K, Verdurmen, J, van der Ende, J and ter Bogt, T (2006) Mental health problems in early adolescents in the Netherlands. Social Psychiatry and Psychiatric Epidemiology 41, 156163.
Weijters, B and Baumgartner, H (2012) Misresponse to reversed and negated items in surveys: a review. Journal of Marketing Research 49, 737747.
Willcutt, EG (2012) The prevalence of DSM-IV attention-deficit/hyperactivity disorder: a meta-analytic review. Neurotherapeutics 9, 490499.
Yu, C (2002) Evaluating Cutoff Criteria of Model Fit Indices for Latent Variable Models with Binary and Continuous Outcomes (Unpublished doctoral dissertation). University of California, Los Angeles.

Keywords

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed