Hostname: page-component-7bb8b95d7b-lvwk9 Total loading time: 0 Render date: 2024-09-22T00:39:48.006Z Has data issue: false hasContentIssue false

Comparison of computational methods for the evaluation of learning potential in schizophrenia

Published online by Cambridge University Press:  07 April 2010

JOANNA M. FISZDON*
Affiliation:
Psychology Service, VA Connecticut Health Care System, West Haven, Connecticut Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut
JASON K. JOHANNESEN
Affiliation:
Psychology Service, VA Connecticut Health Care System, West Haven, Connecticut Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut
*
*Correspondence and reprint requests to: Joanna Fiszdon, Ph.D., Psychology Service (116B), VA Connecticut Healthcare System, 950 Campbell Ave., West Haven, CT 06516. E-mail: Joanna.fiszdon@yale.edu

Abstract

Learning potential (LP) refers to the ability to improve cognitive performance as a result of training. It is typically assessed by test-train-test administrations of a task, wherein changes in pre-post performance are an index of LP. In schizophrenia research, LP has been suggested as a mediator of the relationship between static neurocognition and functional outcome. While a number of studies do indicate that LP assessment improves prediction of functioning beyond standard administrations of the same task, multiple approaches of computing LP indices have been used in this work. Multiple psychometric issues have been raised with respect to computation of change scores, but have not been widely recognized in LP assessment. To address this issue, the current study aimed to evaluate the test-retest reliability, interrelatedness, construct, and criterion validity of several conventional indices of LP, obtained from a test-train-test version of a list-learning task administered to 43 individuals with chronic schizophrenia. Overall, test-retest and intercorrelation coefficients indicated variable reliability and convergence across methods. While LP indices generally correlated more highly with independent measures of neurocognition and community functioning than pretraining list learning scores, coefficients were comparably small. Recommendations and measurement issues inherent to the LP construct are discussed. (JINS, 2010, 16, 613–620.)

Type
Research Articles
Copyright
Copyright © The International Neuropsychological Society 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

American Psychiatric Association & Task Force on DSM-IV. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: American Psychiatric Association.Google Scholar
Bell, M., Bryson, G., Greig, T., Corcoran, C., & Wexler, B.E. (2001). Neurocognitive enhancement therapy with work therapy: Effects on neuropsychological test performance. Archives of General Psychiatry, 58, 763768.Google Scholar
Budoff, M., & Friedman, M. (1964). “Learning Potential” as an assessment approach to the adolescent mentally retarded. Journal of Consulting Psychology, 28, 434439.Google Scholar
Delahunty, A., Reeder, C., Wykes, T., Morice, R., & Newton, E. (2001). Cognitive remediation therapy manual (2nd ed.). London: King’s College Institute of Psychiatry.Google Scholar
Delis, D.C., Kramer, J.H., Kaplan, E., & Ober, B.A. (2000). California Verbal Learning Test (2nd ed.), Adult version manual. San Antonio, TX: The Psychological Corporation.Google Scholar
First, M.B.S., Spitzer, R.L., Gibbon, M., Williams, J.B. (1996). Structured Clinical Interview for DSM-IV Axis I Disorders–Patient Edition (SCID-I/P, Version 2.0). New York: Biometrics Research Department, New York State Psychiatric Institute.Google Scholar
Fiszdon, J.M., McClough, J.F., Silverstein, S.M., Bell, M.D., Jaramillo, J.R., & Smith, T.E. (2006). Learning potential as a predictor of readiness for psychosocial rehabilitation in schizophrenia. Psychiatry Research, 143, 159166.CrossRefGoogle ScholarPubMed
Green, M.F., Kern, R.S., Braff, D.L., & Mintz, J. (2000). Neurocognitive deficits and functional outcome in schizophrenia: Are we measuring the “right stuff”? Schizophrenia Bulletin, 26, 119136.Google Scholar
Heaton, R. (1981). The Wisconsin Card Sorting Test manual. Odessa, FL: Psychological Assessment Resources.Google Scholar
Heinrichs, D.W., Hanlon, T.E., & Carpenter, W.T. Jr. (1984). The Quality of Life Scale: An instrument for rating the schizophrenic deficit syndrome. Schizophrenia Bulletin, 10, 388398.Google Scholar
Kay, S.R., Fiszbein, A., & Opler, L.A. (1987). The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophrenia Bulletin, 13, 261276.Google Scholar
Klauer, K.J. (1993). Learning potential testing: The effect of retesting. In Hamers, J.H.M., Sijtsma, K., & Ruijssenaars, A.J.J.M. (Eds.), Learning potential assessment: Theoretical, methodological and practical issues. Lisse, Netherlands: Swets & Zeitlinger Publishers.Google Scholar
Kurtz, M.M., Jeffrey, S.B., & Rose, J. (2010). Elementary neurocognitive function, learning potential and everyday life skills in schizophrenia: What is their relationship? Schizophrenia Research, 116, 280288.Google Scholar
Kurtz, M.M., & Wexler, B.E. (2006). Differences in performance and learning proficiency on the Wisconsin Card Sorting Test in schizophrenia: Do they reflect distinct neurocognitive subtypes with distinct functional profiles? Schizophrenia Research, 81, 167171.CrossRefGoogle ScholarPubMed
Linn, R.L., & Slinde, J.A. (1977). The determination of the significance of change between pre- and post-testing periods Review of Educational Research, 47, 121150.Google Scholar
Ohrmann, P., Kugel, H., Bauer, J., Siegmund, A., Kolkebeck, K., Suslow, T., et al. . (2008). Learning potential on the WCST in schizophrenia is related to the neuronal integrity of the anterior cingulate cortex as measured by proton magnetic resonance spectroscopy. Schizophrenia Research, 106, 156163.Google Scholar
Pedersen, A., Wiedl, K.H., & Ohrmann, P. (2009). Neurobiological correlates of learning potential in healthy subjects and in schizophrenic subjects. Journal of Cognitive Education and Psychology, 8, 8190.CrossRefGoogle Scholar
Rempfer, M., Hamera, E., Brown, C., & Bothwell, R.J. (2006). Learning proficiency on the Wisconsin Card Sorting Test in people with serious mental illness: What are the cognitive characteristics of good learners? Schizophrenia Research, 87, 316322.CrossRefGoogle ScholarPubMed
Schoettke, H., Bartram, M., & Wiedl, K.H. (1993). Psychometric implications of learning potential assessment: A typological approach. In Hamers, J., Sijtsma, K., & Ruijssenaars, A. (Eds.), Learning potential assessment: Theoretical, methodological and pratical issues. Lisse, Netherlands: Swets & Zeitlinger Publishers.Google Scholar
Sergi, M.J., Kern, R.S., Mintz, J., & Green, M.F. (2005). Learning potential and the prediction of work skill acquisition in schizophrenia. Schizophrenia Bulletin, 31, 6772.Google Scholar
SPSS Statistics 17.0. Release 17.0.0. Chicago: SPSS Inc.Google Scholar
Steiger, J.H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245251.Google Scholar
Tenhula, W.N., Kinnaman, J.E.S., & Bellack, A.S. (2007). Is learning potential associated with social skills in schizophrenia? Journal of Rehabilitation Research & Development, 44, 827835.Google Scholar
Vaskinn, A., Sundet, K., Friis, S., Ueland, T., Simonsen, C., Birkenaes, A.B., et al. . (2008). Can learning potential in schizophrenia be assessed with the standard CVLT-II? An exploratory study. Scandinavian Journal of Psychology, 49, 179186.Google Scholar
Waldorf, M., Wiedl, K.H., & Schottke, H. (2009). On the concordance of three reliable change indexes: An analysis applying the dynamic Wisconsin Card Sorting Test. Journal of Cognitive Education and Psychology, 8, 6380.Google Scholar
Watzke, S., Brieger, P., Kuss, O., Schoettke, H., & Wiedl, K.H. (2008). A longitudinal study of learning potential and rehabilitation outcome in schizophrenia. Psychiatric Services, 59, 248255.Google Scholar
Watzke, S., Brieger, P., & Wiedl, K.H. (2009). Prediction of vocational rehabilitation outcome in schizophrenia: Incremental prognostic validity of learning potential beyond basic cognitive performance. Journal of Cognitive Education and Psychology, 8, 5262.CrossRefGoogle Scholar
Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence (WASI). San Antonio, TX: The Psychological Corporation.Google Scholar
Weingartz, S., Wiedl, K.H., & Watzke, S. (2008). Dynamic assessment of executive functioning: (How) can we measure change? Journal of Cognitive Education and Psychology, 7, 368–387.Google Scholar
Wiedl, K.H. (1999). Cognitive modifiability as a measure of readiness for rehabilitation. Psychiatric Services, 50, 14111413.CrossRefGoogle ScholarPubMed
Wiedl, K.H., Schottke, H.H., & Calero-Garcia, D. (2001). Dynamic assessment of cognitive rehabilitation potential in schizophrenic persons and in elderly persons with and without dementia. European Journal of Psychological Assessment, 17, 112117.CrossRefGoogle Scholar
Wiedl, K.H., Schottke, H., Green, M.F., & Nuechterlein, K.H. (2004). Dynamic testing in schizophrenia: Does training change the construct validity of a test? Schizophrenia Bulletin, 30, 703711.Google Scholar
Wiedl, K.H., & Wienobst, J. (1999). Interindividual differences in cognitive remediation research with schizophrenic patients: Indicators of rehabilitation potential? International Journal of Rehabilitation Research, 22, 5559.Google Scholar
Woonings, F.M.J., Appelo, M.T., Kluiter, H., Slooff, C.J., & van den Bosch, R.J. (2003). Learning (potential) and social functioning in schizophrenia. Schizophrenia Research, 59, 287296.Google Scholar