Hostname: page-component-cd9895bd7-jkksz Total loading time: 0 Render date: 2024-12-26T15:11:22.935Z Has data issue: false hasContentIssue false

Acceptability of cognitive remediation for schizophrenia: a systematic review and meta-analysis of randomized controlled trials

Published online by Cambridge University Press:  08 March 2022

Antonio Vita
Affiliation:
Department of Clinical and Experimental Sciences, University of Brescia, Brescia, Italy Department of Mental Health and Addiction Services, ASST Spedali Civili of Brescia, Brescia, Italy
Stefano Barlati*
Affiliation:
Department of Clinical and Experimental Sciences, University of Brescia, Brescia, Italy Department of Mental Health and Addiction Services, ASST Spedali Civili of Brescia, Brescia, Italy
Anna Ceraso
Affiliation:
Department of Clinical and Experimental Sciences, University of Brescia, Brescia, Italy
Giacomo Deste
Affiliation:
Department of Mental Health and Addiction Services, ASST Spedali Civili of Brescia, Brescia, Italy
Gabriele Nibbio
Affiliation:
Department of Clinical and Experimental Sciences, University of Brescia, Brescia, Italy
Til Wykes
Affiliation:
Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK South London and Maudsley NHS Foundation Trust, Maudsley Hospital, Denmark Hill, London, UK
*
Author for correspondence: Stefano Barlati, E-mail: stefano.barlati@unibs.it
Rights & Permissions [Opens in a new window]

Abstract

Background

Acceptability is an important factor for predicting intervention use and potential treatment outcomes in psychosocial interventions. Cognitive remediation (CR) improves cognition and functioning in people with a diagnosis of schizophrenia, but its acceptability, and the impact of participants and treatment characteristics, remain to be investigated. Few studies provide a direct measure of acceptability, but treatment drop-out rates are often available and represent a valid surrogate.

Method

The systematic search conducted for the most comprehensive CR outcomes database for schizophrenia was updated in December 2020. Eligible studies were randomized clinical trials comparing CR with any other control condition in patients diagnosed with schizophrenia spectrum disorders and that also reported drop-out in treatment and control arms separately. Acceptability was measured as odd-ratios (OR) of drop-out.

Results

Of 2119 identified reports, 151 studies, reporting 169 comparisons between CR and control interventions with 10 477 participants were included in the analyses. The overall rate of drop-out was 16.58% for CR programs and 15.21% for control conditions. In the meta-analysis, no difference emerged between CR interventions and controls [OR 1.10, 95% confidence interval (CI) 0.96–1.25, p = 0.177]. Factors improving acceptability were: inpatient only recruitment, participants with fewer years of education and lower premorbid IQ, the presence of all CR core elements, and the presence of techniques to transfer cognitive gains into real-world functioning.

Conclusions

CR for people diagnosed with schizophrenia is effective and has a good acceptability profile, similar to that of other evidence-based psychosocial interventions.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Introduction

Background

Cognitive remediation (CR) for people diagnosed with schizophrenia is a behavioral training-based intervention targeting cognitive processes (Wykes, Huddy, Cellard, McGurk, & Czobor, Reference Wykes, Huddy, Cellard, McGurk and Czobor2011). It produces significant gains not only in cognitive performance, but also in real-world psychosocial functioning, as demonstrated in systematic and recent meta-analyses (Kambeitz-Ilankovic et al., Reference Kambeitz-Ilankovic, Betz, Dominke, Haas, Subramaniam, Fisher and Kambeitz2019; Lejeune, Northrop, & Kurtz, Reference Lejeune, Northrop and Kurtz2021; Vita et al., Reference Vita, Barlati, Ceraso, Nibbio, Ariu, Deste and Wykes2021), even for people who are more clinically compromised (Vita et al., Reference Vita, Barlati, Ceraso, Nibbio, Ariu, Deste and Wykes2021). So, there is little doubt that CR is an important asset in aiding people living with schizophrenia to achieve their recovery goals.

CR implementation is not widespread despite recent guidance (Keepers et al., Reference Keepers, Fochtmann, Anzia, Benjamin, Lyness, Mojtabai and Hong2020; National Institute for Health and Care Excellence, 2020), and there is still some reluctance to include it in everyday clinical practice (Vita & Barlati, Reference Vita and Barlati2019; Wykes, Reference Wykes2018). Acceptability is a key factor in real-world clinical settings as it is a predictor of intervention use and potential outcomes under real-world conditions. We know from the most recent meta-analysis that longer treatments produce better outcomes (Vita et al., Reference Vita, Barlati, Ceraso, Nibbio, Ariu, Deste and Wykes2021), so factors fostering participation as well as potential barriers to treatment delivery are important to discover. Acceptability is a complex construct, which can be assessed in different ways, depending on the theoretical framework in which it is evaluated (Carter, Reference Carter2007). In healthcare interventions acceptability can be estimated through patient feedback, or by treatment drop-out rates (Sekhon, Cartwright, & Francis, Reference Sekhon, Cartwright and Francis2017).

In the few studies that have explored acceptability directly, patient views of CR interventions were generally positive (Bryce, Warren, Ponsford, Rossell, & Lee, Reference Bryce, Warren, Ponsford, Rossell and Lee2018; Contreras, Lee, Tan, Castle, & Rossell, Reference Contreras, Lee, Tan, Castle and Rossell2016; Nemoto et al., Reference Nemoto, Takeshi, Niimura, Tobe, Ito, Kojima and Mizuno2021; Rose et al., Reference Rose, Wykes, Farrier, Doran, Sporle and Bogner2008), and participants' satisfaction and judgements of CR effects matched their efficacy data (Rose et al., Reference Rose, Wykes, Farrier, Doran, Sporle and Bogner2008). In the absence of direct measures, acceptability needs to be investigated indirectly by considering treatment drop-out. For CR studies this is the reported levels of drop-out by trial treatment arm. Meta-analyses have found trial attrition rates of 13–14% for non-pharmacological interventions, though with considerable between-study heterogeneity (Szymczynska, Walsh, Greenberg, & Priebe, Reference Szymczynska, Walsh, Greenberg and Priebe2017; Villeneuve, Potvin, Lesage, & Nicole, Reference Villeneuve, Potvin, Lesage and Nicole2010). CR randomized trials and naturalistic studies, including those with large samples, report drop-out rates of 10–17%, suggesting that it has comparable acceptability (Horan et al., Reference Horan, Dolinsky, Lee, Kern, Hellemann, Sugar and Green2018; Mueller, Schmidt, & Roder, Reference Mueller, Schmidt and Roder2015; Østergaard Christensen et al., Reference Østergaard Christensen, Vesterager, Krarup, Olsen, Melau, Gluud and Nordentoft2014; Soumet-Leman, Medalia, & Erlich, Reference Soumet-Leman, Medalia and Erlich2018; Tan et al., Reference Tan, Zhu, Fan, Tan, Yang, Wang and Wykes2019), while other large trials found much higher drop-out rates (Donohoe et al., Reference Donohoe, Dillon, Hargreaves, Mothersill, Castorina, Furey and Robertson2018; Kantrowitz et al., Reference Kantrowitz, Sharif, Medalia, Keefe, Harvey, Bruder and Lieberman2016; Mahncke et al., Reference Mahncke, Kim, Rose, Stasio, Buckley, Caroff and Keefe2019; van Oosterhout et al., Reference van Oosterhout, Krabbendam, de Boer, Ferwerda, van der Helm, Stant and van der Gaag2014).

It is unclear which variables influence attrition in CR studies, and some suggested are the design, setting, participant socio-demographic and clinical characteristics, treatment duration, and specific treatment components (Best et al., Reference Best, Milanovic, Tran, Leung, Jackowich, Gauvin and Bowie2020; Fiszdon, Kurtz, Choi, Bell, & Martino, Reference Fiszdon, Kurtz, Choi, Bell and Martino2016; Saperstein, Lynch, Qian, & Medalia, Reference Saperstein, Lynch, Qian and Medalia2020; Sedgwick, Hardy, Newbery, & Cella, Reference Sedgwick, Hardy, Newbery and Cella2021).

The core ingredients of CR (presence of an active and trained therapist, repeated practice of cognitive exercises, structured development of cognitive strategies, and use of techniques to improve the transfer of cognitive gains to the real world) identified in a recent expert consensus (Bowie et al., Reference Bowie, Bell, Fiszdon, Johannesen, Lindenmayer, McGurk and Wykes2019) influence treatment effectiveness (Vita et al., Reference Vita, Barlati, Ceraso, Nibbio, Ariu, Deste and Wykes2021). We do not know if these same components have an impact on acceptability nor whether any patient-related characteristics could identify candidates who would complete treatment and therefore be more likely to receive a treatment benefit.

Aims of the study

To investigate CR acceptability (trial drop-out rate) between treatment and control arms in randomized clinical trials and assess if differences were moderated by patient characteristics or beneficial treatment components.

Methods

The review was conducted in accordance with the Preferred Reported Items for Systematic Review and Meta-analysis (PRISMA) guidelines (Moher, Liberati, Tetzlaff, Altman, & Group, Reference Moher, Liberati, Tetzlaff, Altman and Group2009), and can be viewed as a complementary analysis to Vita et al. (Reference Vita, Barlati, Ceraso, Nibbio, Ariu, Deste and Wykes2021). The literature search was completed on Dec 23, 2020, and comprised a systematic search of 3 electronic databases (PubMed, Scopus and PsycInfo) using the terms [(‘cognitive’ or ‘cognit*’) AND (‘training’ or ‘remediation’ or ‘rehabilitation’ or ‘enhancement’) AND (‘schizophrenia’ or ‘psychosis’) AND (‘random*’ or ‘randomized control trial’ or ‘clinical trial’)], a manual search of Google Scholar with combinations of the same keywords, and manual inspection of reference lists of emerging reviews and included papers. Studies previously excluded due to the absence of outcomes of interest or not providing usable outcome data were re-assessed for eligibility.

Eligible studies were randomized trials recruiting participants with a diagnosis of schizophrenia spectrum disorders (at least 70% of the total sample), comparing CR interventions fulfilling the standard Experts Workshop definition (2010) to any control condition other than CR. For this meta-analysis we chose studies explicitly reporting drop-out in each treatment arm. CR could be either delivered as a stand-alone treatment or integrated with other adequately controlled psychosocial interventions. No restriction was applied either to the treatment setting or the duration and delivery mode of CR interventions. The screening was conducted by 2 independent reviewers with disagreements resolved by a third author. Only articles published in English in peer-reviewed journals were considered. The methodological rigor of included studies was evaluated using the Clinical Trials Assessment Measure (CTAM) (Tarrier & Wykes, Reference Tarrier and Wykes2004) by at least 2 reviewers, who also extracted data independently.

Outcomes of interest

The main outcome was the reported number of trial drop-outs due to any reason in each treatment arm. Drop-outs were individuals providing consent to participate in the study, randomized to one of the treatment arms and leaving the study before the end of the active treatment phase. Drop-out occurring after treatment was not considered. All drop-out definitions were considered valid, with no threshold for the minimum number of attended treatment sessions. If the reasons for drop-out were reported then this information was also extracted. A separate analysis was conducted including only drop-out due to lack of motivation, i.e., participants who withdrew consent to participate during the active treatment period or who explicitly considered the treatment tedious or too intensive.

Outcome measures

Acceptability was measured as odd-ratios (OR) of drop-out, with 95% confidence interval (CI), calculated according to the following formula: OR = (drop-out from CR interventions/completers of CR interventions)/(drop-out from control interventions/completers of control interventions). For studies with multiple treatment arms, each eligible comparison between CR interventions and control conditions was considered separately. As including multiple comparisons within a study could lead to a potential bias of dependent effects, sensitivity analyses were conducted introducing only one comparison per study (Rücker, Cates, & Schwarzer, Reference Rücker, Cates and Schwarzer2017; Van den Noortgate, López-López, Marín-Martínez, & Sánchez-Meca, Reference Van den Noortgate, López-López, Marín-Martínez and Sánchez-Meca2013).

Meta-analytic procedures

Given the expected high level of participant clinical heterogeneity of included studies, a random-effect approach was preferred. A sensitivity analysis was also performed using a fixed-effect approach. Statistical heterogeneity was investigated through visual inspection of forest plots and assessment of Q-test and I2 statistic. All meta-analyses were performed using Comprehensive Meta-Analysis version 3.0 (Biostat, Englewood, NJ, USA, 2013). Descriptive statistics and analyses were performed using SPSS 22 (SPSS Inc., Chicago, IL, USA, 2005). p values <0.05 (2-tailed) were considered significant for all analyses.

Moderator effects

Subgroup, sensitivity, and meta-regression analyses were conducted to explore the effect of study methods, participants, and interventions characteristics on acceptability as identified or suggested by other investigators. We also carried out a sensitivity analysis including only trials conducted in real-world settings, and subgroup analysis to compare pilot/feasibility studies to more rigorous trials. The list of moderator variables explored is available in Appendix 1.

Certainty of the evidence

The risk of publication bias was assessed by visual inspection of funnel plots and Egger test for asymmetry (Egger, Smith, Schneider, & Minder, Reference Egger, Smith, Schneider and Minder1997). Other determinants of the quality of evidence such as consistency, precision, and directness were explored using experts' recommendation (Schünemann, Reference Schünemann2013).

Results

The study selection procedure is shown in Fig. 1. A total of 151 studies, reporting 169 comparisons between CR and control interventions with 10 477 participants were included in the analyses; 3 ongoing studies were also identified (see Appendix 2). Included participants were representative of people living with schizophrenia and using mental health services, from individuals experiencing first episodes to those with thirty-year illness duration, and at different stages of recovery.

Fig. 1. PRISMA flow diagram.

The mean CR treatment duration was 15.82 ± 15.45 (range 2–104) weeks; the four core ingredients of CR (Bowie et al., Reference Bowie, Bell, Fiszdon, Johannesen, Lindenmayer, McGurk and Wykes2019) were well represented (single elements present in ⩾70% cases); however, only half (66, 48.88%) included all of them. CR was delivered in the context of a structured psychiatric rehabilitation program in 48 (28.9%) cases.

Included studies

Sixty-five studies were conducted in Europe, 41 in the US, 27 in Asia, 7 in Middle East countries, 5 in Canada, 4 in Australia and 2 in Brazil. Eighty-three studies recruited outpatients, 50 included inpatients from acute and residential care services, and 18 recruited from both. Most took place in real-world clinical practice sites (101, 66.9%), while some trials were conducted in specific settings (e.g. 20 research-oriented sites, 6 home-based or low-support programs, 4 forensic settings, 1 supported university program). Thirty-nine (25.8%) studies were explicitly defined as pilot/feasibility trials. Descriptive data are reported in detail in Table 1.

Table 1. Descriptive characteristics of 151 included studies reporting data on 169 intervention-control comparisons

CGI, Clinical Global Impression; CPZeq, chlorpromazine equivalents; CTAM, Clinical Trial Assessment Measure, ITT, Intention-to-treat; PANSS, Positive and Negative Syndrome Scale; IQ, intelligence quotient; s.d., standard deviation; TAU, treatment-as-usual.

CR was compared with treatment as usual (TAU) (61 studies, 36.1%), to active TAU (24 studies, 14.2%), to active non-specific interventions (50 studies, 29.6%), or to active evidence-based interventions implemented for trial purpose (34 studies, 20.1%). Half the studies (80, 53%) were rated as having higher methodological rigor (CTAM score ⩾ 65). Methodological quality improved over time (Spearman ρ = 0.279; p = 0.001) and was higher in: multicenter studies (Mann–Whitney U = 1622.00; p < 0.001), larger studies (Spearman ρ = 0.450; p < 0.001), and those conducted in outpatient settings (Mann–Whitney U = 1444.00; p = 0.041). Trial quality was also correlated with the number of beneficial CR ingredients included in the intervention (Spearman ρ = 0.187; p = 0.021), but not to other setting- or treatment-related parameters.

Acceptability of cognitive remediation

In 31 studies (34 comparisons) no drop-out occurred during treatment phase in any treatment arm. These studies had smaller sample size (Mann–Whitney U = 671.00; p < 0.001), lower methodological quality (Mann–Whitney U = 1106.50; p = 0.001), lower treatment duration (Mann–Whitney U = 1580.00; p = 0.005) and intensity (hours/week, Mann–Whitney U = 1362.50; p = 0.032), included patients with more severe symptoms (Mann–Whitney U = 466.00; p = 0.033) and were more often pilot trials (χ2 = 7.611, p = 0.006).

The overall rate of drop-out was 16.58% for CR programs and 15.21% for control conditions (18.62 and 17.28% respectively when removing trials with no drop-out). In the meta-analysis, no difference emerged between CR interventions and controls regarding attrition: OR 1.10 (95% CI 0.96–1.25), p = 0.177. Overall heterogeneity was statistically significant (Q = 163.68, df 134, p = 0.041), but low (I 2 = 18.13%). The sensitivity analysis conducted using a fixed-effects model yielded very similar results: OR 1.09 (95% CI 0.97–1.22), p = 0.132. No evidence of publication bias emerged (no funnel plot asymmetry at visual inspection, Egger test: p = 0.591). The results were also comparable when the analysis only included studies where drop-out was reported to be due to low motivation: [OR 1.064 (95% CI 0.821–1.378), p = 0.639], although this reduced the sample size (N = 36).

Moderator effects

Drop-out rate was lower in studies recruiting only inpatients compared to studies carried out in outpatient settings or recruiting both outpatients and inpatients [OR 0.88 (95% CI 0.68–1.13) v. OR 1.10 (95% CI 0.94–1.29) and 1.67 (95% CI 1.15–2.42), χ2 = 7.71, p = 0.021]. Attrition rates were similar in pilot/feasibility trials and more rigorous trials [OR 1.05 (95% CI 0.75–1.46) v. OR 1.10 (95% CI 0.97–1.24), χ2 = 0.07, p = 0.793]. These results were robust when restricted only to studies conducted in real-world clinical practice settings [OR 1.07 (95% CI 0.93–1.25), N = 93 studies]. See Table 2 for details.

Table 2. Effect of moderators

CPZeq, chlorpromazine equivalents; CTAM, Clinical Trial Assessment Measure; PANSS, Positive and Negative Syndrome Scale; IQ, intelligence quotient; TAU, treatment-as-usual.

* = alternative 4th core element.

The type of control had a significant impact (χ2 = 9.90, p = 0.019) with attrition being higher for CR compared to TAU [OR 1.43 (1.10–1.86)], but there was no consistent difference in comparison to an active control activity or an evidence-based psychosocial intervention. Surprisingly acceptability was higher when the comparison was an active TAU [OR 0.71 (0.50–1.03)]. Methodological quality, publication year, sample size, included diagnoses and payment of participants had no significant effect.

Acceptability of CR interventions was significantly higher in studies with participants showing fewer years of education [Coefficient = 0.150 (0.039–0.262), p = 0.008] and lower premorbid IQ [Coefficient = 0.026 (0.002–0.050), p = 0.033]. No significant effect was observed for age, gender, age of onset, duration of illness, or baseline symptom severity. Antipsychotic treatment dosage did not emerge as a significant moderator either.

Among the core CR ingredients in our subgroup analyses, the implementation of techniques to transfer cognitive gains to real-world functioning had a significant positive impact on acceptability [Including this element, OR  1.02 (0.89–1.18) not including this element OR 1.45 (1.06–1.99), χ2 = 4.01, p = 0.045] (see Table 2). The presence of an active and trained therapist, the repetition of cognitive exercises or teaching novel cognitive strategies did not exert a significant effect when considered separately. However, treatments that included all the core ingredients had significantly better acceptability [OR 0.96 (0.80–1.15) v. 1.25 (1.04–1.50), χ2 = 3.99, p = 0.046], which further improved if psychiatric rehabilitation was considered as the optimal transfer technique [OR 0.82 (0.65–1.05) v. 1.20 (1.03–1.40), χ2 = 6.83, p = 0.009]. No significant effect was observed for other treatment-related variables such as duration, intensity, format, and method of treatment delivery.

Discussion

This is the first systematic and comprehensive assessment of CR acceptability for people living with schizophrenia as measured by the study drop-out rate. The overall drop-out rate (16.58%) was equivalent to that observed in control interventions (15.21%), as confirmed by the quantitative meta-analytic synthesis that found no significant differences between the two groups. Of note, the analysis of drop-out due to low motivation, which can be viewed as the reason more specifically related to the intervention, yielded comparable results. The CR drop-out rate was also comparable to one found across different psychosocial interventions for individuals diagnosed with schizophrenia (Szymczynska et al., Reference Szymczynska, Walsh, Greenberg and Priebe2017; Villeneuve et al., Reference Villeneuve, Potvin, Lesage and Nicole2010), and lower with respect to drop-out rates reported in pharmacological trials (Bighelli et al., Reference Bighelli, Leucht, Huhn, Reitmeir, Schwermann, Wallis and Leucht2020; Cramer & Rosenheck, Reference Cramer and Rosenheck1998; Kemmler, Hummer, Widschwendter, & Fleischhacker, Reference Kemmler, Hummer, Widschwendter and Fleischhacker2005; Lieberman & Hsiao, Reference Lieberman and Hsiao2006), which often involve shorter observation periods (Bighelli et al., Reference Bighelli, Leucht, Huhn, Reitmeir, Schwermann, Wallis and Leucht2020).

Acceptability of CR intervention was higher in studies recruiting inpatients. This result replicates previous literature reporting better feasibility of psychosocial interventions in inpatients setting, as confirmed by a systematic review (Villeneuve et al., Reference Villeneuve, Potvin, Lesage and Nicole2010). Treatment programs that included all the core ingredients for CR effectiveness (Bowie et al., Reference Bowie, Bell, Fiszdon, Johannesen, Lindenmayer, McGurk and Wykes2019), and particularly those including techniques to transfer cognitive gains into real-world functioning showed a lower drop-out rate. This is an important finding as it could be linked to a better treatment rationale, improved perceived efficacy by the participants themselves, and may also have positive effects on motivation. Other treatment elements despite having an impact on CR benefits (Vita et al., Reference Vita, Barlati, Ceraso, Nibbio, Ariu, Deste and Wykes2021), did not produce significant effects on acceptability. This result is of practical importance if we are to reduce barriers to successful recovery. Making the treatment rationale clear and linked to functional outcome is part of case formulation and a way of personalizing treatment [see (Wykes & Reeder, Reference Wykes and Reeder2005) for a suggested method of CR case formulation]. To reduce drop-out (the surrogate for acceptability) and improve the cost-effectiveness of treatment, services choosing a CR intervention as part of their recovery programs should choose one that delivers this element.

The presence of an active and trained therapist did not emerge as a significant factor, despite its emphasis in previous literature (Browne et al., Reference Browne, Wright, Berry, Mueser, Cather, Penn and Kurtz2021; Fiszdon et al., Reference Fiszdon, Kurtz, Choi, Bell and Martino2016), although it did have an effect on CR outcomes (Vita et al., Reference Vita, Barlati, Ceraso, Nibbio, Ariu, Deste and Wykes2021). This finding could be explained by therapists enhancing the treatment rationale, encouraging the transfer of CR skill improvement into everyday life and the chances of participants using these skills through the development of a positive therapeutic alliance. This more complex set of relationships requires further analysis.

Participants with lower IQ and fewer years of education displayed better acceptability of CR programs; these characteristics have been already described as important moderators of CR efficacy on both cognition and functioning (Fiszdon, Choi, Bryson, & Bell, Reference Fiszdon, Choi, Bryson and Bell2006; Tan et al., Reference Tan, Zhu, Fan, Tan, Yang, Wang and Wykes2019; Twamley, Burton, & Vella, Reference Twamley, Burton and Vella2011; Vita et al., Reference Vita, Barlati, Ceraso, Nibbio, Ariu, Deste and Wykes2021); a previous study also found a correlation between lower cognitive performance, in particular in attention and working memory domains, and the level of participation to the intervention (Dillon et al., Reference Dillon, Hargreaves, Anderson-Schmidt, Castorina, Corvin, Fitzmaurice and Donohoe2016). This finding suggests again that a link might exist between better effectiveness and better acceptability of the intervention. It may be that participants who are more inclined to commit to treatment are those who are more fragile or more compromised and more motivated to obtain an improvement in their clinical and personal condition (Saperstein et al., Reference Saperstein, Lynch, Qian and Medalia2020). This hypothesis, however, remains to be more appropriately and thoroughly investigated.

Strengths and limitations

One of the main strengths of the present study is its novelty and uniqueness as the first meta-analysis to explore CR intervention acceptability for people living with schizophrenia. The conclusions were drawn from a comprehensive search of the literature and from the largest database reported of CR trials, so the robust results have implications for CR practical implementation.

The most obvious limitation is that we had to adopt drop-out rates as a measure of acceptability because very few studies asked participants what they thought of the treatment. Drop-out from treatment can be affected by many factors, including external life events, change in personal circumstances and symptom changes, although as we were investigating randomized trials these factors would equally occur in the comparison groups. This issue was partially addressed by performing a sub-analysis including only participants who explicitly left the trial due to low motivation. Some heterogeneity also occurred in the study drop-out definitions as they ranged from participants recruited who never received the intervention to those who did not attend the minimum number of treatment sessions.

Engagement in treatment programs might not always coincide with completion rate or sessions attendance (Mahncke et al., Reference Mahncke, Kim, Rose, Stasio, Buckley, Caroff and Keefe2019): it is important to consider this and other indicators, such as satisfaction with treatment, as crucial complementary outcomes, when interpreting acceptability data derived from indirect proxies such as trial drop-out rates.

Although our findings are based on randomized clinical trials, the majority were conducted in real-world clinical settings and the results the same even after excluding trials in highly controlled or research-oriented sites, so generalization is probable.

The role of pharmacotherapy as a potential moderator of drop-out has been marginally investigated in this study, only expressed as baseline therapy dose (chlorpromazine equivalents). In fact, concomitant antipsychotic treatment could be involved in either jeopardizing or enhancing the effects of CR (Biagianti, Castellaro, & Brambilla, Reference Biagianti, Castellaro and Brambilla2021). Further exploring the role of pharmacotherapy in influencing the acceptability of CR, which did not emerge as significant in the current analyses, as well as the eventual role of medication adherence (Nuechterlein et al., Reference Nuechterlein, Ventura, Subotnik, Gretchen-Doorly, Turner, Casaus and Medalia2020), could represent a relevant target for future studies. In this light, it should be pointed out that only a few details on concomitant pharmacotherapy were reported in studies included in the present review, and this issue seems rather frequent in CR trials; besides, it could be better explored using a different methodology for quantitative synthesis of results, such as individual patient data meta-analyses.

Analyzing the influence of pharmacological treatment on adherence to non-pharmacological interventions represents an interesting topic, also considering the growing literature interest for providing cognitive enhancement pharmacological strategies (Fleischhacker et al., Reference Fleischhacker, Podhorna, Gröschl, Hake, Zhao, Huang and Pollentier2021; Harvey & Sand, Reference Harvey and Sand2017; Michalopoulou et al., Reference Michalopoulou, Lewis, Drake, Reichenberg, Emsley, Kalpakidou and Kapur2015; Otto et al., Reference Otto, Kredlow, Smits, Hofmann, Tolin, de Kleine and Pollack2016).

Future studies

We urge two things of our scientist colleagues. To agree on the measure of drop-out as this will make it easier to compare different treatments and then make recommendations to national healthcare services. But just as vital is asking about acceptability directly, as the patient voice should be heard before making key decisions about treatment provision. A further recommendation is about the measurement of outcome in CR trials. We adopt a primary outcome measure and other assessments are then secondary. If a more nuanced approach was implemented then we could use the value placed by different groups (service providers, clinicians, and service users) and use a combined measure of the worth of treatment. These methods have rarely been used and are called Multi-Criterion Decision Modeling (MCDM) (Cinelli, Kadziński, Gonzalez, & Słowiński, Reference Cinelli, Kadziński, Gonzalez and Słowiński2020; Greco, Figueira, & Ehrgott, Reference Greco, Figueira and Ehrgott2016), but would balance what are sometimes competing views of different parts of our health care system. Drop-out rates or satisfaction with treatment might be one element of an MCDM.

Conclusions

CR is an evidence-based intervention for people living with schizophrenia that is not only effective in producing cognitive and functional gains, but is also characterized by a good acceptability profile, similar to that of other evidence-based psychosocial interventions, and superior to that of pharmacological treatments. One core CR ingredient had an impact on acceptability, facilitation of transfer to everyday functioning. Other key elements also contribute to benefits, but this one is of great value in clinical practice as it values the subjective recovery preferences of people living with schizophrenia.

Acknowledgements

Prof. Wykes acknowledges the support of the National Institute for Health Research Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King's College London, as well as a National Institute for Health Research Senior Investigator award. The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. The views expressed are those of the authors and not necessarily those of the National Health Services, the National Institute for Health Research, or the Department of Health and Social Care. We thank Daniele Gravina and Nicola Necchini for their support during data extraction.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291722000319.

Conflict of interests

Prof. Wykes reports grants from National Institute for Health Research during the conduct of the study; and being the creator of CIRCuiTs, a CR software. The other authors have declared that there are no conflicts of interest in relation to the subject of this study.

References

Best, M. W., Milanovic, M., Tran, T., Leung, P., Jackowich, R., Gauvin, S., … Bowie, C. R. (2020). Motivation and engagement during cognitive training for schizophrenia spectrum disorders. Schizophrenia Research, Cognition, 19, 100151. https://doi.org/10.1016/j.scog.2019.100151CrossRefGoogle ScholarPubMed
Biagianti, B., Castellaro, G. A., & Brambilla, P. (2021). Predictors of response to cognitive remediation in patients with major psychotic disorders: A narrative review. Journal of Affective Disorders, 281, 264270. https://doi.org/10.1016/j.jad.2020.12.011CrossRefGoogle ScholarPubMed
Bighelli, I., Leucht, C., Huhn, M., Reitmeir, C., Schwermann, F., Wallis, S., … Leucht, S. (2020). Are randomized controlled trials on pharmacotherapy and psychotherapy for positive symptoms of schizophrenia comparable? A systematic review of patient and study characteristics. Schizophrenia Bulletin, 46(3), 496504. https://doi.org/10.1093/schbul/sbz090CrossRefGoogle ScholarPubMed
Bowie, C. R., Bell, M. D., Fiszdon, J. M., Johannesen, J. K., Lindenmayer, J.-P., McGurk, S. R., … Wykes, T. (2019). Cognitive remediation for schizophrenia: An expert working group white paper on core techniques. Schizophrenia Research, 215, 4953. https://doi.org/10.1016/j.schres.2019.10.047CrossRefGoogle Scholar
Browne, J., Wright, A. C., Berry, K., Mueser, K. T., Cather, C., Penn, D. L., & Kurtz, M. M. (2021). The alliance-outcome relationship in individual psychosocial treatment for schizophrenia and early psychosis: A meta-analysis. Schizophrenia Research, 231, 154163. https://doi.org/10.1016/j.schres.2021.04.002CrossRefGoogle ScholarPubMed
Bryce, S., Warren, N., Ponsford, J., Rossell, S., & Lee, S. (2018). Understanding the lived experience of cognitive remediation in schizophrenia: A qualitative comparison with an active control. Psychiatric Rehabilitation Journal, 41(4), 302311. https://doi.org/10.1037/prj0000309CrossRefGoogle ScholarPubMed
Carter, S. L. (2007). Review of recent treatment acceptability research. Education and Training in Developmental Disabilities, 42(3), 301316. JSTOR. Recuperato da JSTOR.Google Scholar
Cinelli, M., Kadziński, M., Gonzalez, M., & Słowiński, R. (2020). How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy. Omega, 96, 102261. https://doi.org/10.1016/j.omega.2020.102261CrossRefGoogle ScholarPubMed
Contreras, N. A., Lee, S., Tan, E. J., Castle, D. J., & Rossell, S. L. (2016). How is cognitive remediation training perceived by people with schizophrenia? A qualitative study examining personal experiences. Journal of Mental Health (Abingdon, England), 25(3), 260266. https://doi.org/10.3109/09638237.2016.1167856CrossRefGoogle Scholar
Cramer, J. A., & Rosenheck, R. (1998). Compliance with medication regimens for mental and physical disorders. Psychiatric Services, 49(2), 196201. https://doi.org/10.1176/ps.49.2.196CrossRefGoogle ScholarPubMed
Dillon, R., Hargreaves, A., Anderson-Schmidt, H., Castorina, M., Corvin, A., Fitzmaurice, B., … Donohoe, G. (2016). Adherence to a low-support cognitive remediation training program for psychosis. The Journal of Nervous and Mental Disease, 204(10), 741745. https://doi.org/10.1097/NMD.0000000000000557CrossRefGoogle ScholarPubMed
Donohoe, G., Dillon, R., Hargreaves, A., Mothersill, O., Castorina, M., Furey, E., … Robertson, I. H. (2018). Effectiveness of a low support, remotely accessible, cognitive remediation training programme for chronic psychosis: Cognitive, functional and cortical outcomes from a single-blind randomised controlled trial. Psychological Medicine, 48(5), 751764. https://doi.org/10.1017/S0033291717001982CrossRefGoogle ScholarPubMed
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629634. https://doi.org/10.1136/bmj.315.7109.629CrossRefGoogle ScholarPubMed
Fiszdon, J. M., Choi, J., Bryson, G. J., & Bell, M. D. (2006). Impact of intellectual status on response to cognitive task training in patients with schizophrenia. Schizophrenia Research, 87(1), 261269. https://doi.org/10.1016/j.schres.2006.04.011CrossRefGoogle ScholarPubMed
Fiszdon, J. M., Kurtz, M. M., Choi, J., Bell, M. D., & Martino, S. (2016). Motivational interviewing to increase cognitive rehabilitation adherence in schizophrenia. Schizophrenia Bulletin, 42(2), 327334. https://doi.org/10.1093/schbul/sbv143CrossRefGoogle ScholarPubMed
Fleischhacker, W. W., Podhorna, J., Gröschl, M., Hake, S., Zhao, Y., Huang, S., … Pollentier, S. (2021). Efficacy and safety of the novel glycine transporter inhibitor BI 425809 once daily in patients with schizophrenia: A double-blind, randomised, placebo-controlled phase 2 study. The Lancet. Psychiatry, 8(3), 191201. https://doi.org/10.1016/S2215-0366(20)30513-7CrossRefGoogle ScholarPubMed
Greco, S., Figueira, J., & Ehrgott, M. (2016). Multiple criteria decision analysis (Vol. 37). New York, NY: Springer.CrossRefGoogle Scholar
Harvey, P. D., & Sand, M. (2017). Pharmacological augmentation of psychosocial and remediation training efforts in schizophrenia. Frontiers in Psychiatry, 8, 177. https://doi.org/10.3389/fpsyt.2017.00177CrossRefGoogle ScholarPubMed
Horan, W. P., Dolinsky, M., Lee, J., Kern, R. S., Hellemann, G., Sugar, C. A., … Green, M. F. (2018). Social cognitive skills training for psychosis with community-based training exercises: A randomized controlled trial. Schizophrenia Bulletin, 44(6), 12541266. https://doi.org/10.1093/schbul/sbx167CrossRefGoogle ScholarPubMed
Kambeitz-Ilankovic, L., Betz, L. T., Dominke, C., Haas, S. S., Subramaniam, K., Fisher, M., … Kambeitz, J. (2019). Multi-outcome meta-analysis (MOMA) of cognitive remediation in schizophrenia: Revisiting the relevance of human coaching and elucidating interplay between multiple outcomes. Neuroscience and Biobehavioral Reviews, 107, 828845. https://doi.org/10.1016/j.neubiorev.2019.09.031CrossRefGoogle ScholarPubMed
Kantrowitz, J. T., Sharif, Z., Medalia, A., Keefe, R. S. E., Harvey, P., Bruder, G., … Lieberman, J. A. (2016). A multicenter, rater-blinded, randomized controlled study of auditory processing-focused cognitive remediation combined with open-label lurasidone in patients with schizophrenia and schizoaffective disorder. The Journal of Clinical Psychiatry, 77(6), 799806. https://doi.org/10.4088/JCP.15m09998CrossRefGoogle ScholarPubMed
Keepers, G. A., Fochtmann, L. J., Anzia, J. M., Benjamin, S., Lyness, J. M., Mojtabai, R., … Hong, S.-H. (2020). The American psychiatric association practice guideline for the treatment of patients with schizophrenia. American Journal of Psychiatry, 177(9), 868872. https://doi.org/10.1176/appi.ajp.2020.177901CrossRefGoogle ScholarPubMed
Kemmler, G., Hummer, M., Widschwendter, C., & Fleischhacker, W. W. (2005). Dropout rates in placebo-controlled and active-control clinical trials of antipsychotic drugs: A meta-analysis. Archives of General Psychiatry, 62(12), 13051312. https://doi.org/10.1001/archpsyc.62.12.1305CrossRefGoogle ScholarPubMed
Lejeune, J. A., Northrop, A., & Kurtz, M. M. (2021). A meta-analysis of cognitive remediation for schizophrenia: Efficacy and the role of participant and treatment factors. Schizophrenia Bulletin, 47(4), 9971006. https://doi.org/10.1093/schbul/sbab022CrossRefGoogle ScholarPubMed
Lieberman, J. A., & Hsiao, J. K. (2006). Interpreting the results of the CATIE study. Psychiatric Services (Washington, D.C.), 57(1), 139. https://doi.org/10.1176/appi.ps.57.1.139CrossRefGoogle ScholarPubMed
Mahncke, H. W., Kim, S.-J., Rose, A., Stasio, C., Buckley, P., Caroff, S., … Keefe, R. S. E. (2019). Evaluation of a plasticity-based cognitive training program in schizophrenia: Results from the eCaesar trial. Schizophrenia Research, 208, 182189. https://doi.org/10.1016/j.schres.2019.03.006CrossRefGoogle ScholarPubMed
Michalopoulou, P. G., Lewis, S. W., Drake, R. J., Reichenberg, A., Emsley, R., Kalpakidou, A. K., … Kapur, S. (2015). Modafinil combined with cognitive training: Pharmacological augmentation of cognitive training in schizophrenia. European Neuropsychopharmacology: The Journal of the European College of Neuropsychopharmacology, 25(8), 11781189. https://doi.org/10.1016/j.euroneuro.2015.03.009CrossRefGoogle ScholarPubMed
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Group, T. P. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097CrossRefGoogle ScholarPubMed
Mueller, D. R., Schmidt, S. J., & Roder, V. (2015). One-year randomized controlled trial and follow-up of integrated neurocognitive therapy for schizophrenia outpatients. Schizophrenia Bulletin, 41(3), 604616. https://doi.org/10.1093/schbul/sbu223CrossRefGoogle ScholarPubMed
National Institute for Health and Care Excellence (2020). Rehabilitation for adults with complex psychosis NICE guideline. Recuperato da https://www.nice.org.uk/guidance/ng181/resources/rehabilitation-for-adults-with-complex-psychosis-pdf-66142016643013.Google Scholar
Nemoto, T., Takeshi, K., Niimura, H., Tobe, M., Ito, R., Kojima, A., … Mizuno, M. (2021). Feasibility and acceptability of cognitive rehabilitation during the acute phase of schizophrenia. Early Intervention in Psychiatry, 15(3), 457462. https://doi.org/10.1111/eip.12955CrossRefGoogle ScholarPubMed
Nuechterlein, K. H., Ventura, J., Subotnik, K. L., Gretchen-Doorly, D., Turner, L. R., Casaus, L. R., … Medalia, A. (2020). A randomized controlled trial of cognitive remediation and long-acting injectable risperidone after a first episode of schizophrenia: Improving cognition and work/school functioning. Psychological Medicine, Sep 28, 110. https://doi.org/10.1017/S0033291720003335.Google Scholar
Østergaard Christensen, T., Vesterager, L., Krarup, G., Olsen, B. B., Melau, M., Gluud, C., & Nordentoft, M. (2014). Cognitive remediation combined with an early intervention service in first-episode psychosis. Acta Psychiatrica Scandinavica, 130(4), 300310. https://doi.org/10.1111/acps.12287CrossRefGoogle ScholarPubMed
Otto, M. W., Kredlow, M. A., Smits, J. A. J., Hofmann, S. G., Tolin, D. F., de Kleine, R. A., … Pollack, M. H. (2016). Enhancement of psychosocial treatment with D-cycloserine: Models, moderators, and future directions. Biological Psychiatry, 80(4), 274283. https://doi.org/10.1016/j.biopsych.2015.09.007CrossRefGoogle ScholarPubMed
Rose, D., Wykes, T., Farrier, D., Doran, A.-M., Sporle, T., & Bogner, D. (2008). What do clients think of cognitive remediation therapy?: A consumer-led investigation of satisfaction and side effect. American Journal of Psychiatric Rehabilitation, 11(2), 181204. https://doi.org/10.1080/15487760801963694CrossRefGoogle Scholar
Rücker, G., Cates, C. J., & Schwarzer, G. (2017). Methods for including information from multi-arm trials in pairwise meta-analysis. Research Synthesis Methods, 8(4), 392403. https://doi.org/10.1002/jrsm.1259CrossRefGoogle ScholarPubMed
Saperstein, A. M., Lynch, D. A., Qian, M., & Medalia, A. (2020). How does awareness of cognitive impairment impact motivation and treatment outcomes during cognitive remediation for schizophrenia? Schizophrenia Research, 218, 7075. https://doi.org/10.1016/j.schres.2020.02.014CrossRefGoogle ScholarPubMed
Schünemann, H. (2013). The GRADE handbook. Cochrane Collaboration.Google Scholar
Sedgwick, O., Hardy, A., Newbery, K., & Cella, M. (2021). A systematic review of adherence to group interventions in psychosis: Do people attend? Psychological Medicine, 51(5), 707715. https://doi.org/10.1017/S0033291721000404CrossRefGoogle ScholarPubMed
Sekhon, M., Cartwright, M., & Francis, J. J. (2017). Acceptability of healthcare interventions: An overview of reviews and development of a theoretical framework. BMC Health Services Research, 17(1), 88. https://doi.org/10.1186/s12913-017-2031-8CrossRefGoogle ScholarPubMed
Soumet-Leman, C., Medalia, A., & Erlich, M. D. (2018). Acceptability and perceived effectiveness of cognitive remediation in clinical practice. Psychiatric Services, 69(4), 493494. https://doi.org/10.1176/appi.ps.201700308CrossRefGoogle ScholarPubMed
Szymczynska, P., Walsh, S., Greenberg, L., & Priebe, S. (2017). Attrition in trials evaluating complex interventions for schizophrenia: Systematic review and meta-analysis. Journal of Psychiatric Research, 90, 6777. https://doi.org/10.1016/j.jpsychires.2017.02.009CrossRefGoogle ScholarPubMed
Tan, S., Zhu, X., Fan, H., Tan, Y., Yang, F., Wang, Z., … Wykes, T. (2019). Who will benefit from computerized cognitive remediation therapy? Evidence from a multisite randomized controlled study in schizophrenia. Psychological Medicine, 50, 111. https://doi.org/10.1017/S0033291719001594Google ScholarPubMed
Tarrier, N., & Wykes, T. (2004). Is there evidence that cognitive behaviour therapy is an effective treatment for schizophrenia? A cautious or cautionary tale? Behaviour Research and Therapy, 42(12), 13771401. https://doi.org/10.1016/j.brat.2004.06.020CrossRefGoogle ScholarPubMed
Twamley, E. W., Burton, C. Z., & Vella, L. (2011). Compensatory cognitive training for psychosis: Who benefits? Who stays in treatment? Schizophrenia Bulletin, 37(Suppl 2), S55S62. https://doi.org/10.1093/schbul/sbr059CrossRefGoogle ScholarPubMed
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013). Three-level meta-analysis of dependent effect sizes. Behavior Research Methods, 45(2), 576594. https://doi.org/10.3758/s13428-012-0261-6CrossRefGoogle ScholarPubMed
van Oosterhout, B., Krabbendam, L., de Boer, K., Ferwerda, J., van der Helm, M., Stant, A. D., & van der Gaag, M. (2014). Metacognitive group training for schizophrenia spectrum patients with delusions: A randomized controlled trial. Psychological Medicine, 44(14), 30253035. https://doi.org/10.1017/S0033291714000555CrossRefGoogle ScholarPubMed
Villeneuve, K., Potvin, S., Lesage, A., & Nicole, L. (2010). Meta-analysis of rates of drop-out from psychosocial treatment among persons with schizophrenia spectrum disorder. Schizophrenia Research, 121(1–3), 266270. https://doi.org/10.1016/j.schres.2010.04.003CrossRefGoogle ScholarPubMed
Vita, A., & Barlati, S. (2019). The implementation of evidence-based psychiatric rehabilitation: Challenges and opportunities for mental health services. Frontiers in Psychiatry, 10, 147. https://doi.org/10.3389/fpsyt.2019.00147CrossRefGoogle ScholarPubMed
Vita, A., Barlati, S., Ceraso, A., Nibbio, G., Ariu, C., Deste, G., & Wykes, T. (2021). Effectiveness, core elements, and moderators of response of cognitive remediation for schizophrenia: A systematic review and meta-analysis of randomized clinical trials. JAMA Psychiatry, 78(8), 848858. https://doi.org/10.1001/jamapsychiatry.2021.0620CrossRefGoogle ScholarPubMed
Wykes, P. T., & Reeder, D. C. (2005). Cognitive remediation therapy for schizophrenia: Theory and practice. London: Routledge. https://doi.org/10.4324/9780203098707Google Scholar
Wykes, T. (2018). Cognitive remediation – where are we now and what should we do next? Official Journal of the Italian Society of Psychopathology, 24, 5761.Google Scholar
Wykes, T., Huddy, V., Cellard, C., McGurk, S. R., & Czobor, P. (2011). A meta-analysis of cognitive remediation for schizophrenia: Methodology and effect sizes. The American Journal of Psychiatry, 168(5), 472485. https://doi.org/10.1176/appi.ajp.2010.10060855CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. PRISMA flow diagram.

Figure 1

Table 1. Descriptive characteristics of 151 included studies reporting data on 169 intervention-control comparisons

Figure 2

Table 2. Effect of moderators

Supplementary material: File

Vita et al. supplementary material

Vita et al. supplementary material 1

Download Vita et al. supplementary material(File)
File 13.2 KB
Supplementary material: File

Vita et al. supplementary material

Vita et al. supplementary material 2

Download Vita et al. supplementary material(File)
File 28.5 KB