Skip to main content Accessibility help
×
Home

Person-fit feedback on inconsistent symptom reports in clinical depression care

  • Rob B. K. Wanders (a1), Rob R. Meijer (a2), Henricus G. Ruhé (a3), Sjoerd Sytema (a1), Klaas J. Wardenaar (a1) and Peter de Jonge (a1) (a4)...

Abstract

Background

Depressive patients can present with complex and different symptom patterns in clinical care. Of these, some may report patterns that are inconsistent with typical patterns of depressive symptoms. This study aimed to evaluate the validity of person-fit statistics to identify inconsistent symptom reports and to assess the clinical usefulness of providing clinicians with person-fit score feedback during depression assessment.

Methods

Inconsistent symptom reports on the Inventory of Depressive Symptomatology Self-Report (IDS-SR) were investigated quantitatively with person-fit statistics for both intake and follow-up measurements in the Groningen University Center of Psychiatry (n = 2036). Subsequently, to investigate the causes and clinical usefulness of on-the-fly person-fit alerts, qualitative follow-up assessments were conducted with three psychiatrists about 20 of their patients that were randomly selected.

Results

Inconsistent symptom reports at intake (12.3%) were predominantly characterized by reporting of severe symptoms (e.g. psychomotor slowing) without mild symptoms (e.g. irritability). Person-fit scores at intake and follow-up were positively correlated (r = 0.45). Qualitative interviews with psychiatrists resulted in an explanation for the inconsistent response behavior (e.g. complex comorbidity, somatic complaints, and neurological abnormalities) for 19 of 20 patients. Psychiatrists indicated that if provided directly after the assessment, a person-fit alert would have led to new insights in 60%, and be reason for discussion with the patient in 75% of the cases.

Conclusions

Providing clinicians with automated feedback when inconsistent symptom reports occur is informative and can be used to support clinical decision-making.

Copyright

Corresponding author

Author for correspondence: Rob B. K. Wanders, E-mail: r.b.k.wanders@umcg.nl

References

Hide All
Conijn, JM, Emons, WH, De Jong, K and Sijtsma, K (2015). Detecting and explaining aberrant responding to the outcome questionnaire-45. Assessment 22, 513524.
Conijn, JM, Spinhoven, P, Meijer, RR and Lamers, F (2016). Person misfit on the inventory of depressive symptomatology: low quality self-report or true atypical symptom profile? International Journal of Methods in Psychiatric Research. doi: 10.1002/mpr.1548.
Conijn, JM, van der Ark, LA and Spinhoven, P (2017). Satisficing in mental health care patients: the effect of cognitive symptoms on self-report data quality. Assessment. doi: 1073191117714557.
Conrad, KJ, Bezruczko, N, Chan, YF, Riley, B, Diamond, G and Dennis, ML (2010). Screening for atypical suicide risk with person fit statistics among people presenting to alcohol and other drug treatment. Drug and Alcohol Dependence 106, 92100.
Drasgow, F, Levine, MV and Williams, EA (1985). Appropriateness measurement with polychotomous item response models and standardized indices. British Journal of Mathematical and Statistical Psychology 38, 6786.
Embretson, SE and Reise, SP (2000). Item Response Theory for Psychologists. Lawrence Erlbaum: Mahwah, NJ.
Embretson, SE and Reise, SP (in press). Item Response Theory. Routledge Taylor & Francis: New York, NY.
Ferrando, PJ (2015). Assessing person fit in typical-response measures. In Handbook of Item Response Theory Modeling: Applications to Typical Performance Assessment (ed. Reise, S.P. and Revicki, D. A.), pp. 128155. Routledge: New York, NY.
Ferrando, PJ and Lorenzo, U (2000). WPerfit: a program for computing parametric person-fit statistics and plotting person response curves. Educational and Psychological Measurement 60, 479487.
Groenewold, NA, Doornbos, B, Zuidersma, M, et al. (2013). Comparing cognitive and somatic symptoms of depression in myocardial infarction patients and depressed patients in primary and mental health care. Plos One 8, e53859.
Lambert, MJ and Shimokawa, K (2011). Collecting client feedback. Psychotherapy 48, 7279.
Liu, MT and Yu, PT (2011). Aberrant learning achievement detection based on person-fit statistics in personalized e-learning systems. Journal of Educational Technology and Society 14, 107120.
Marianti, S, Fox, JP, Avetisyan, M, Veldkamp, BP and Tijmstra, J (2014). Testing for aberrant behavior in response time modeling. Journal of Educational and Behavioral Statistics 39, 426451.
Meijer, RR (2003). Diagnostic item score patterns on a test using IRT based person-fit statistics. Psychological Methods 8, 7287.
Meijer, RR, Egberink, IJL, Emons, WHM and Sijtsma, K (2008). Detection and validation of unscalable item score patterns using item response theory: an illustration with Harter's Self-Perception Profile for Children. Journal of Personality Assessment 90, 227238.
Meijer, RR, Niessen, ASM and Tendeiro, JN (2016). A practical guide to check the consistency of item response patterns in clinical research through person-fit statistics examples and a computer program. Assessment 23, 5262.
Meijer, RR and Sijtsma, K (2001). Methodology review: evaluating person fit. Applied Psychological Measurement 25, 107135.
Pallant, JF and Tennant, A (2007). An introduction to the Rasch measurement model: an example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology 46, 118.
Penninx, BWJH, Beekman, ATF, Smit, JH, Zitman, FG, Nolen, WA, Spinhoven, P, Cuijpers, P, De Jong, PJ, Van Marwijk, HWJ, Assendelft, WJJ, Van Der Meer, K, Verhaak, P, Wensing, M, De Graaf, R, Hoogendijk, WJ, Ormel, J and Van Dyck, R (2008). The Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods. International Journal of Methods in Psychiatric Research 17, 121140.
Puschner, B, Steffen, S, Slade, M, Kaliniecka, H, Maj, M, Fiorillo, A, Munk-Jørgensen, P, Larsen, JI, Égerházi, A, Nemes, Z, Rössler, W, Kawohl, W and Becker, T (2010). Clinical decision making and outcome in routine care for people with severe mental illness (CEDAR): study protocol. BMC Psychiatry 10, 90.
Reise, SP and Waller, NG (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology 5, 2748.
Rizopoulos, D (2006). Ltm: an R package for latent variable modeling and item response theory analyses. Journal of Statistical Software 17, 125.
Rupp, AA (2013). A systematic review of the methodology for person fit research in item response theory: lessons about generalizability of inferences from the design of simulation studies. Psychological Test Assessment Modeling 55, 338.
Rush, AJ, Gullion, CM, Basco, MR, Jarrett, RB and Trivedi, MH (1996). The Inventory of Depressive Symptomatology (IDS): psychometric properties. Psychological Medicine 26, 477486.
Samejima, F (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement 34, 100.
Tendeiro, JN, Meijer, RR and Niessen, ASM (2016). Perfit: an R package for person-fit analysis in IRT. Journal of Statistical Software 74, 127.
Thomas, ML (2011). The value of item response theory in clinical assessment: a review. Assessment 18, 291307.
Van Herk, H, Poortinga, YH and Verhallen, TM (2004). Response styles in rating scales: evidence of method bias in data from six EU countries. Journal of Cross-Cultural Psychology 35, 346360.
Wanders, RBK, Wardenaar, KJ, Kessler, RC, Penninx, BWJH, Meijer, RR and De Jonge, P (2015 b). Differential reporting of depressive symptoms across distinct clinical subpopulations: what difference does it make? Journal of Psychosomatic Research 78, 130136.
Wanders, RBK, Wardenaar, KJ, Penninx, BWJH, Meijer, RR and De Jonge, P (2015 a). Data-driven atypical profiles of depressive symptoms: identification and validation in a large cohort. Journal of Affective Disorders 180, 3643.
Wardenaar, KJ, Wanders, RBK, Roest, AM, Meijer, RR and De Jonge, P (2015). What does the beck depression inventory measure in myocardial infarction patients? A psychometric approach using item response theory and person-fit. International Journal of Methods in Psychiatric Research 24, 130142.
Woods, CM, Oltmanns, TF and Turkheimer, E (2008). Detection of aberrant responding on a personality scale in a military sample: an application of evaluating person fit with two-level logistic regression. Psychological Assessment 20, 159168.

Keywords

Related content

Powered by UNSILO
Type Description Title
PDF
Supplementary materials

Wanders et al supplementary material 1
Wanders et al supplementary material

 PDF (1.3 MB)
1.3 MB

Person-fit feedback on inconsistent symptom reports in clinical depression care

  • Rob B. K. Wanders (a1), Rob R. Meijer (a2), Henricus G. Ruhé (a3), Sjoerd Sytema (a1), Klaas J. Wardenaar (a1) and Peter de Jonge (a1) (a4)...

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.