Hostname: page-component-cd9895bd7-7cvxr Total loading time: 0 Render date: 2024-12-30T14:25:35.749Z Has data issue: false hasContentIssue false

Dismantling cognitive-behaviour therapy for panic disorder: a systematic review and component network meta-analysis

Published online by Cambridge University Press:  25 January 2018

Alessandro Pompoli
Affiliation:
MD, Psychiatric Rehabilitation Clinic Villa San Pietro, Trento, Italy
Toshi A. Furukawa*
Affiliation:
Departments of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan
Orestis Efthimiou
Affiliation:
Institute of Social and Preventive Medicine (ISPM), University of Bern, Bern, Switzerland Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece
Hissei Imai
Affiliation:
Departments of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan
Aran Tajika
Affiliation:
Departments of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan
Georgia Salanti
Affiliation:
Institute of Social and Preventive Medicine (ISPM), University of Bern, Bern, Switzerland Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece
*
Author for correspondence: Toshi A. Furukawa, E-mail: furukawa@kuhp.kyoto-u.ac.jp
Rights & Permissions [Opens in a new window]

Abstract

Cognitive-behaviour therapy (CBT) for panic disorder may consist of different combinations of several therapeutic components such as relaxation, breathing retraining, cognitive restructuring, interoceptive exposure and/or in vivo exposure. It is therefore important both theoretically and clinically to examine whether specific components of CBT or their combinations are superior to others in the treatment of panic disorder. Component network meta-analysis (NMA) is an extension of standard NMA that can be used to disentangle the treatment effects of different components included in composite interventions. We searched MEDLINE, EMBASE, PsycINFO and Cochrane Central, with supplementary searches of reference lists and clinical trial registries, for all randomized controlled trials comparing different CBT-based psychological therapies for panic disorder with each other or with control interventions. We applied component NMA to disentangle the treatment effects of different components included in these interventions. After reviewing 2526 references, we included 72 studies with 4064 participants. Interoceptive exposure and face-to-face setting were associated with better treatment efficacy and acceptability. Muscle relaxation and virtual-reality exposure were associated with significantly lower efficacy. Components such as breathing retraining and in vivo exposure appeared to improve treatment acceptability while having small effects on efficacy. The comparison of the most v. the least efficacious combination, both of which may be provided as ‘evidence-based CBT,’ yielded an odds ratio for the remission of 7.69 (95% credible interval: 1.75 to 33.33). Effective CBT packages for panic disorder would include face-to-face and interoceptive exposure components, while excluding muscle relaxation and virtual-reality exposure.

Type
Review Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Cambridge University Press 2018

Introduction

Panic disorder is an anxiety disorder characterized by the recurrence of unexpected panic attacks, in which an intense fear accompanied by a series of bodily and/or cognitive symptoms develops abruptly, without an apparent external cause (American Psychiatric Association, 2013). In the general population, about one-quarter of people suffering from panic disorder also have agoraphobia (Kessler et al. Reference Kessler, Chiu, Jin, Ruscio, Shear and Walters2006). Panic disorder is common in the general population, with a life-time prevalence of 3.7% without agoraphobia and 1.1% with agoraphobia (Kessler et al. Reference Kessler, Chiu, Jin, Ruscio, Shear and Walters2006). In primary care settings, panic syndromes have been reported to have a prevalence of around 10% (King et al. Reference King, Nazareth, Levy, Walker, Morris and Weich2008).

Three types of intervention are recommended for treating individuals with panic disorder (NICE, 2011). The intervention for which there is evidence for the longest duration of effect is psychological therapy, followed by pharmacological therapy and self-help. Among various psychological therapies, guidelines recommend the use of cognitive-behaviour psychotherapy (CBT) (American Psychiatric Association, 1998; Royal Australian & New Zealand College of Psychiatrists, 2003; NICE, 2011; Katzman et al. Reference Katzman, Bleau, Blier, Chokka, Kjernisted and Van Ameringen2014). In line with these recommendations, a recent Cochrane review and network meta-analysis (Pompoli et al. Reference Pompoli, Furukawa, Imai, Tajika, Efthimiou and Salanti2016) found CBT to be the most efficacious treatment among other competing psychological therapies.

CBT for panic disorder is usually administered according to the manuals by Clark & Salkovskis (Clark & Salkovskis, Reference Clark and Salkovskis1986), Barlow & Craske (Barlow & Craske, Reference Barlow and Craske2000) or their adaptations. In its classical form, CBT consists of various therapeutic components, mainly represented by psychoeducation, breathing retraining, muscle relaxation, cognitive restructuring, interoceptive exposure and in vivo exposure. In clinical practice and in the research literature, we find therapies which correspond to the general definition of CBT, but which consist of different sets of therapeutic components. It has been observed, however, that some combinations of these components (i.e. some specific forms of CBT) may lead to better results than their isolated administration (Sanchez-Meca et al. Reference Sanchez-Meca, Rosa-Alcazar, Marin-Martinez and Gomez-Conesa2010). It is therefore clinically and theoretically important to understand the relative efficacy of different components of CBT for panic disorder. Such a component hierarchy will help minimize the complexity of the treatments being offered and may provide an improvement in terms of time, money and efforts for both patients and clinicians. In addition, streamlining CBT intervention would simplify therapist training and possibly allow a broader range of clinicians to be trained, thus improving overall accessibility to CBT.

Component network meta-analysis (NMA) is a newly developed meta-analysis methodology where various components of different therapies can be dismantled and compared (Welton et al. Reference Welton, Caldwell, Adamopoulos and Vedhara2009). We have conducted a systematic review of randomized controlled trials (RCTs) comparing various CBT treatments for panic disorder with or without agoraphobia, in terms of remission, response and dropouts, and applied the component NMA in order to answer the clinical question ‘Are particular components of CBT for panic disorder or combinations of such components more effective than others?’ The objective of the present systematic review is to obtain a hierarchy of the components involved in CBT for panic disorder according to their efficacy and acceptability and to identify those components associated with most and least favourable outcomes.

Methods

The analyses have been conducted in adherence to a pre-specified protocol registered in PROSPERO (CRD42015027601) and the results are reported following the PRISMA extension statement for network meta-analysis (Hutton et al. Reference Hutton, Salanti, Caldwell, Chaimani, Schmid and Cameron2015).

Study eligibility criteria

We included all RCTs that compared any form of CBT against another form of CBT or any other psychotherapeutic control intervention. We included adult patients of both sexes, with a primary diagnosis of panic disorder with or without agoraphobia. We included studies in which diagnoses were made according to operationalized diagnostic criteria. Table 1 presents the 12 different components of interest and their definition. We included a psychological therapy or a control intervention as long as it could be regarded as a combination of these 12 components. Table 2 provides a clarification of how the various forms of CBT were conceptualized according to a component-level perspective.

Table 1. List of included components and their definitions

Group format was not considered a component because in a previous review and NMA comparing various psychological therapies for the treatment of panic disorder (Pompoli et al, Reference Pompoli, Furukawa, Imai, Tajika, Efthimiou and Salanti2016), we did not detect any association between the relative treatment effects and the difference of therapy delivery (individual v. group) format.

Table 2. Conceptualization of various forms of CBT according to a component-level perspective

w, waiting component; pl, placebo effect; ftf, face-to-face setting; pe, psychoeducation; ps, psychological support; br, breathing retraining; mr, muscle relaxation; cr, cognitive restructuring; ine, interoceptive exposure; ive, in vivo exposure; vre, virtual reality exposure; 3w, third wave components.

Note that, abbreviations in uppercase (eg. WL) stand for interventions/controls, whereas abbreviations in lowercase italics stand for therapeutic components (eg. w). Components in parentheses are elective/optional.

Symbols: ‘+’ means ‘and’; ‘±’ means ‘with or without’; ’/’ means ‘and/or’.

Therapies could be of any duration. We included both individual and group therapies. Pharmacological co-administration was allowed as long as there were no systematic differences in drug administration between study arms.

Outcomes

The primary outcome of the study was remission of panic disorder with or without agoraphobia in the short term (measured as close to 3 months as possible, with a maximum of 6 months). Remission was defined as a dichotomous outcome expressing the number of patients who reached a satisfactory end-state, as defined by the original investigators (e.g. achieving a score of 7 or less at end-point on Panic Disorder Severity Scale (PDSS)). Secondary outcomes included response and dropouts for any reason in the short term. The response was defined as a dichotomous outcome expressing the number of patients who had a substantial improvement from baseline, as defined by the original investigators (e.g. at least 40% reduction in PDSS scores from baseline).

Search strategy

In March 2015, we conducted a comprehensive and systematic search of all psychological therapies for panic disorder in order to identify relevant studies for a Cochrane review that has recently been published (Pompoli et al. Reference Pompoli, Furukawa, Imai, Tajika, Efthimiou and Salanti2016). We updated and re-assessed these search results according to relevant inclusion and exclusion criteria for this study in November 2015. Online Supplement 1 provides the details of the databases searched, along with supplementary searches and search strategies used.

Data collection

Two review authors independently screened the titles and abstracts of references identified by the electronic search and reviewed the full text of any study deemed potentially eligible. Reviewers resolved disagreements by discussion.

Two review authors used a structured manualized data collection form to independently extract the data from the included studies. Any disagreement, including the determination of constituent components of interventions, was resolved either by discussion or by consultation with a third member of the review team. We tried to contact the study authors for all relevant missing data. When this attempt failed, we calculated the number of remitted and/or responding participants according to a validated imputation method (Furukawa et al. Reference Furukawa, Cipriani, Barbui, Brambilla and Watanabe2005).

Two review authors independently assessed the risk of bias (RoB) of the included studies using the Cochrane Risk of Bias assessment tool (Higgins et al. Reference Higgins, Altman, Gotzsche, Juni, Moher and Oxman2011).

Data synthesis

For the data synthesis, we employed a component NMA model, similar to the model described in Welton et al. (Reference Welton, Caldwell, Adamopoulos and Vedhara2009). This model is an extension of the standard NMA model, where the effect of each composite intervention is dismantled after modelling the component-specific effects. We hence differentiated between the effect of a CBT component and the effect of an intervention (combination of components). In the primary analyses we assumed additivity of component effects, i.e. the total effect of each composite intervention was assumed equal to the sum of effects of the included components. According to this model, adding a component c to a composite intervention X will lead to an increase (or decrease) of the odds of the event by an amount only dependent on c, and not on X. We denote the corresponding component-specific incremental odds ratio by iOR c so that iOR c = OR (X+cv. (X). Combining these component-specific incremental odds ratio allows the estimation of odds ratios between any two composite interventions. For example, OR (ftf+psv. (w) = iOR ftf × iOR ps/iOR w (see Table 1 for the abbreviations of the components). Consequently, a large iOR c suggests that component c has a large impact on the outcome.

We assessed the assumptions involved in the primary analyses as follows. First, the NMA requires transitivity of treatment effects across the network. We evaluated the assumption of transitivity by comparing the distribution of effect modifiers across studies grouped by treatment comparisons and components. In addition, we employed the design-by-treatment interaction test to assess the consistency of the network statistically (Higgins et al. Reference Higgins, Jackson, Barrett, Lu, Ades and White2012). Second, the additivity assumption of the component NMA was evaluated by comparing the relative intervention effects in appropriate subgroups of studies; e.g. studies X + Z v. X should, on average, estimate the same relative treatment effects as Y + Z v. Y studies. We also ran sensitivity analyses to examine interaction terms among important components.

In previous analyses, we found substantial evidence of small study effects for the comparison of active treatments v. waiting list with respect to their efficacy (Pompoli et al. Reference Pompoli, Furukawa, Imai, Tajika, Efthimiou and Salanti2016). Consequently, our primary model for response and remission was a component network meta-regression with the variance of the study log-odds-ratio as a covariate. No adjustment for small study effects was done for dropout rate. In order to interpret the magnitude of the estimated heterogeneity (τ), for each outcome we compared the estimated heterogeneity with the expected value, defined in accordance with the empirical distributions for comparing non-pharmacological interventions for a subjective outcome (Turner et al. Reference Turner, Davey, Clarke, Thompson and Higgins2012) (median for heterogeneity τ = 0.36; 95% predictive distribution range = 0.07–1.82).

We fitted the model in a Bayesian framework, using OpenBUGS (Lunn et al. Reference Lunn, Spiegelhalter, Thomas and Best2009) and uncertainty in the results was conveyed by the 95% credible intervals (CrI). The model accounted for correlations induced by multi-arm studies and a half-normal prior to heterogeneity standard deviation was used. Online Supplement 2 provides the details of the statistical methods used.

Results

Results of the search

Our search identified 2526 references. After removal of duplicates and screening based on title and abstract, 616 references (353 studies) were retrieved for a full inspection. Finally, 72 studies, representing 4064 participants, were included in quantitative analyses (online Supplement 3).

Description of studies

Online Supplement 4 summarizes the references and characteristics of the included and excluded studies. Table 3 shows the number of study arms that included each component. Apart from third wave components, which were administered only in two studies (each contributing to only one outcome), all other components were well represented in the network. The percentage of agreement among raters for the identification of components ranged from 99.0 to 99.7%.

Table 3. Number and percentage of study arms including each component and estimates of corresponding incremental odds ratios (iOR) parameter, with 95% Credible Intervals (CrI), for remission, response and dropouts

Larger values of the parameters indicate respectively, larger remission, response and dropout rates. Components are ordered according to iORs for remission, from the most to the least beneficial.

The lower part of the table reports the median heterogeneity standard deviation (τ) for the three outcomes and the regression coefficient for the two outcomes for which analyses were adjusted for small study effects.

The risk of bias of many included studies was judged as unclear or high in various important domains. Online Supplement 5 provides the RoB assessment for each domain and for each study. The percentage of agreement among raters for the assessment of RoB ranged from 75 to 96%.

Assessments of transitivity, inconsistency and additivity assumption

We compiled a table of important trial and patient characteristics (therapy duration, percentages of agoraphobic, depressed and drug-treated patients) across treatment comparisons and components. Its visual inspection showed that those effect modifiers were likely to be similarly distributed across the networks of treatments and components, although there was missing information from several studies (online Supplement 2). Overall there was little concern about the plausibility of the transitivity assumption.

After exploring data for inconsistencies, first at the treatment level and then at the component level, we found no strong evidence of inconsistency for any of the explored outcomes but the power of this analysis is expected to be low (online Supplement 6).

We did not find any strong evidence against the additivity assumption (online Supplement 6). Sensitivity analyses examining several clinically relevant interaction terms in the model (ftf with ine, ftf with cr, pe with ine, cr with ive, br with ine, br with ive) did not alter the results: none of these interactions was statistically significant (online Supplement 7).

Primary outcome: remission of panic disorder

Data regarding remission were available from 60 studies, with a total of 134 study arms (3556 patients). Figure 1 shows the network at the treatment level and at the component level.

Fig. 1. The network structure for short-term remission at the composite-interventions level (top) and at the component level (bottom).

Including the variance of the treatment effect in the meta-regression model reduced the median heterogeneity standard deviation from τ = 0.85 (0.56–1.22) to τ = 0.40 (0.05–0.73) and the regression coefficient was estimated to be −1.96 (−2.72 to −1.30) providing strong evidence for the presence of small study effects. Heterogeneity was found to be close to the expected values (Turner et al. Reference Turner, Davey, Clarke, Thompson and Higgins2012). The results from the network meta-regression are presented in Table 3.

The inclusion of third-wave components, interoceptive exposure, face-to-face setting and cognitive restructuring in a composite intervention apparently led to higher odds of remission but uncertainty was large, as seen from the very wide CIs for the corresponding iOR (Table 3). Conversely, placebo effect, breathing retraining, psychoeducation, psychological support, in-vivo exposure and virtual reality exposure were found to decrease the odds of remission, but again with large uncertainty in the estimates. However, including muscle relaxation in a complex treatment was shown to significantly reduce the efficacy in terms of short-term remission. Results were favourable for third-wave components, but with very large uncertainty. As expected, the waiting component (which is mainly administered without other components as a supposedly inert control condition) showed the smallest mean iOR.

Based on the findings of Table 3 (and excluding third wave components, which was only informed by a single study, and for which the estimate was very imprecise) we can identify the CBT associated with the largest remission rates as consisting of (ftf + pl + pe + ps + cr + ine) and the least effective CBT as (pl + pe + ps + br + mr + ive + vre); the components of pl, pe and ps are included here as would be expected in typical CBT programs but in the calculation of relative efficacy their effects are cancelled out and the best treatment would provide an average relative increase in the odds of remission by almost 700% (OR 7.69 CrI 1.75 to 33.33).

Response to the interventions

A total of 55 studies (124 study arms including 3275 patients) provided evidence on the response. There was evidence of small study effects in the comparisons of active interventions v. waiting list. Heterogeneity was found to be within the range of expected values (Turner et al. Reference Turner, Davey, Clarke, Thompson and Higgins2012). Table 3 gives the values of the iOR values for response estimated from the component network meta-regression. Taken together, results about response were in general agreement with those for remission. Results were more precise for muscle relaxation and virtual reality exposure, which appeared to reduce the odds of response.

Dropout rate from the study

Data regarding dropouts was available from 68 studies, with a total of 153 study arms (3705 patients). Table 3 gives the estimates of the iOR parameters for dropouts, where values smaller than 1 are associated with higher treatment acceptability. Heterogeneity was again found to be within the range of expected values (Turner et al. Reference Turner, Davey, Clarke, Thompson and Higgins2012).

The low estimate for iOR ftf suggests that dropouts were generally less frequent in face-to-face therapies than in self-help therapies. Components such as breathing retraining and in vivo exposure seemed to marginally improve treatment acceptability; the inclusion of psychoeducation, interoceptive exposure, cognitive restructuring and muscle relaxation showed negligible influence on dropouts. Finally, psychological support and virtual reality exposure were associated with lower acceptability, although the corresponding estimate came with a lot of uncertainty. The placebo effect was associated with the highest and the waiting component with the second highest odds of dropout. Because all active interventions are administered together with the placebo effect, the estimate for this component can be seen as a sort of an average acceptability of the active treatments. Therefore, our results suggest that the risk of dropout was on average higher in active treatments as a whole than in waiting list (people placed on the waiting list were more likely to return for the assessment at end of a trial than people in active treatments). Results were again favourable but very imprecise for third-wave components.

Discussion

The results of this component NMA seem to support our original hypothesis that, among the wide range of therapeutic components that fall within CBT, there are important differences in terms of efficacy and acceptability. As a consequence, the selection of different combinations of components can greatly influence the outcome of CBT for panic disorder, explaining at least part of the heterogeneity observed in previous studies examining this psychological therapy (Sanchez-Meca et al. Reference Sanchez-Meca, Rosa-Alcazar, Marin-Martinez and Gomez-Conesa2010; Pompoli et al. Reference Pompoli, Furukawa, Imai, Tajika, Efthimiou and Salanti2016).

Based on the analyses for remission after selecting the specific combination of components in order to have the ‘most efficacious CBT’ and the ‘least efficacious CBT’, we would include cognitive restructuring (cr) and interoceptive exposure (ine) in the former, and breathing retraining (br), muscle relaxation (mr), in vivo exposure (ive) and virtual reality exposure (vre) in the latter. In the context of typical CBT, characterized by simultaneous presence of pl, pe and ps, the comparison of such two CBT versions, that is (ftf + pl + pe + ps + cr + ine) v. (pl + pe + ps + br + mr + ive + vre), would yield an OR of 7.69 (CrI 1.75 to 33.33) in favour of the ‘most efficacious’ CBT. On the other hand, if we compare the above defined ‘most efficacious CBT’ and what could be a commonly delivered CBT, comprising for example (ftf + pl + pe + ps + cr + br + ive), we would still have an OR of 2.33 (CrI 1.01 to 5.26). These contrasts are not only statistically significant but also have strong clinical implications.

In our previous review (Pompoli et al. Reference Pompoli, Furukawa, Imai, Tajika, Efthimiou and Salanti2016) we found that, in terms of short-term remission, CBT appeared to be significantly superior to behaviour therapy, with an OR of 1.79 (CrI 1.02 to 3.13), which suggested that the co-administration of cognitive and behavioural therapeutic components was superior to the administration of behavioural components alone. Another review (Sanchez-Meca et al. Reference Sanchez-Meca, Rosa-Alcazar, Marin-Martinez and Gomez-Conesa2010) had previously concluded that the combination of exposure, relaxation/breathing techniques and cognitive therapy may represent the most effective treatment for panic disorder, with smaller effect sizes for any of these components if administered alone.

The present study, however, goes one step further to suggest which particular components, within the broad class of cognitive or behavioural approaches to treat panic disorder, are likely to be more beneficial. First, among behavioural components, interoceptive exposure (ine) tends to be associated with a better outcome than in vivo exposure (ive). Similar findings were reported in previous studies, which showed the positive effects of adding ine to ive alone (Ito et al. Reference Ito, Noshirvani, Basoglu and Marks1996; Craske et al. Reference Craske, Rowe, Lewin and Noriega-Dimitri1997), while showing less benefits in adding ive to ine alone (de Ruiter et al. Reference de Ruiter, Ryken, Garssen and Kraaimaat1989; Craske et al. Reference Craske, DeCola, Sachs and Pontillo2003).

It must be noted that, compared with interoceptive exposure (ine), the inclusion of cognitive restructuring (cr) was shown to influence positive outcomes to a lesser degree. The administration of other components such as breathing retraining (br), psychoeducation (pe) and placebo effect (pl) was also shown to have a small influence on treatment outcome in terms of both response and remission. Interestingly, breathing retraining (br) is among those components which showed a low impact on positive outcomes, although it appeared to improve treatment acceptability. These findings are coherent with previous studies questioning the utility of breathing retraining (br) in addition to other CBT components (Schmidt et al. Reference Schmidt, Woolaway-Bickel, Trakowski, Santiago, Storey and Koselka2000) or comparing breathing retraining (br) to interoceptive exposure (ine) (Craske et al. Reference Craske, Rowe, Lewin and Noriega-Dimitri1997).

On the other hand, the inclusion of muscle relaxation (mr) was shown to be related to a significantly worse outcome both in terms of remission and response, although this component did not appear to influence treatment acceptability. This finding is coherent with a previous review which found that CBT was superior to relaxation therapy in all panic-related domains, although having no differences in terms of drop-out rates (Siev & Chambless, Reference Siev and Chambless2007).

Although two previous reviews, exploring self-help v. face-to-face CBT for various anxiety disorders (Cuijpers et al. Reference Cuijpers, Donker, van Straten, Li and Andersson2010; Lewis et al. Reference Lewis, Pearce and Bisson2012), did not detect important differences between the two delivery forms when analyses were restricted to studies focusing on panic disorder, a more recent Cochrane review (Olthuis et al. Reference Olthuis, Watt, Bailey, Hayden and Stewart2015) found evidence in favor of face-to-face CBT, compared with therapist-guided internet CBT, in terms of anxiety reduction (three studies: SMD 0.29; 95% CI 0.03–0.54). Our study also suggests that the better format for the administration of CBT is the face-to-face setting, which leads to a better outcome both in terms of response and remission. Furthermore, it also seems to improve patients’ adherence to the treatment, reducing the number of dropouts. Finally, we found only two studies exploring third-wave components (Karekla, Reference Karekla2004; Berger et al. Reference Berger, Boettcher and Caspar2014), only one of which contributed data. Further studies exploring third-wave CBTs for panic disorder are warranted.

We were unable to detect any interaction among the components when we added interaction terms as would be expected from clinical or theoretical notions (e.g. Would the efficacy of interoceptive exposure or cognitive restructuring be stronger in face-to-face rather than otherwise? Would psychoeducation facilitate interoceptive exposure? Would cognitive restructuring enhance the efficacy of in vivo exposure? Could breathing retraining be used as a counterproductive safety behaviour during interoceptive or in vivo exposures?). However, it should be noted that our data were sparse and generally had low power to detect interactions. Thus, our findings should not be interpreted as ruling out the possibility of synergistic/antagonistic effects between some CBT components. Future large studies may still be able to detect clinically important interactions.

This review has some weaknesses. First of all, the high number of included studies together with the complexity of statistical analyses took us a long time to complete the review since the search date. Second, despite our efforts, we have probably been unable to include all unpublished studies, as suggested by the evidence of SSE affecting both remission and response. Third, it must be noted that some results came with a high degree of uncertainty as regards each individual component, possibly due to the limited number of relevant studies and heterogeneity among them. In the previous NMA comparing various psychological therapies for the treatment of panic disorder (Pompoli et al. Reference Pompoli, Furukawa, Imai, Tajika, Efthimiou and Salanti2016), however, we did not detect any association between the relative treatment effects and study-level characteristics such as year of publication, percentage of drug-treated patients, percentage of patients with comorbid depression, percentage of agoraphobic patients and therapy delivery setting (individual v. group therapy). Fourth, included studies were often assessed as being at unclear risk of bias for random sequence generation, allocation concealment or selective outcome reporting and a high percentage of studies were assessed as being at high risk of outcome assessment bias, attrition bias and researcher allegiance bias. In addition, different studies used variable definitions of remission or response. While we expect that such differences would more strongly affect absolute measures of efficacy (What percentage of patients respond?) and less strongly relative measures of efficacy (How much more likely are patients to respond on treatment than on control?) (Furukawa et al. Reference Furukawa, Guyatt and Griffith2002), this variability may be one reason that has contributed to uncertainty of estimates in the present analyses. Fifth, the definitions and identifications of components in the broad range of CBT are unavoidably arbitrary to some degree. However, we tried to be as transparent as possible by providing explicit definitions and we were able to achieve satisfactory agreement in the judgments between two independent reviewers. Finally, we did not include any long-term outcome, aware of the limited availability of relevant data (Pompoli et al. Reference Pompoli, Furukawa, Imai, Tajika, Efthimiou and Salanti2016).

This study has some important strengths, however. To our knowledge, this study is among the first attempts to implement a component-level network meta-analyses within the context of a comprehensive and methodologically rigorous systematic review, and represents a pioneering approach to disentangle the individual contributions of every single component pertaining to a complex intervention such as CBT for panic disorder. The high number of included studies, the lack of evidence against the assumptions of transitivity or additivity in the networks and the coherence between results for remission and response, suggest the robustness of our findings.

The identification of important differences between components of CBT has strong implications for clinical practice by contributing to a much more precise identification of those therapeutic components that should be included (or excluded) when offering CBT to patients affected by the panic disorder.

More effective CBT packages for panic disorder would include face-to-face and interoceptive exposure components, while the inclusion of muscle relaxation or virtual reality exposure would decrease the overall efficacy of such CBT packages. The inclusion of other components, such as psychoeducation, cognitive restructuring, breathing retraining and exposure in vivo, seems to have a lower impact on treatment outcome, and could be appropriate depending on theoretical and pragmatic considerations.

Although some components are associated with worse treatment outcome, one must keep in mind that, both in terms of remission and response, all components appear to be beneficial when compared with inert waiting list (the only exception is virtual reality exposure for response). This means that such components cannot be considered ‘detrimental’; rather, it can be hypothesized that, given that a treatment takes a limited amount of time, administering less effective components may lead to a worse/limited administration of the more effective ones, finally leading to a less positive clinical result.

The results from this study also have important implications for future research in complex interventions. Researchers should evaluate the possibility to exploit the used methodology in order to reach a better understanding of advantages and disadvantages of various components included in complex interventions, such as psychotherapies and many other public health interventions.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291717003919.

Acknowledgements

This work was supported in part by the Japan Society for the Promotion of Science KAKENHI Grant-in-Aid for Challenging Exploratory Research (grant no 26670314) to TAF. Georgia Salanti was supported by a Marie-Curie Individual Fellowship (MSCA-IF-703254).

Declaration of interest

Dr Furukawa has received lecture fees from Eli Lilly, Janssen, Meiji, Mitsubishi-Tanabe, MSD, Otsuka, and Pfizer, and consultancy fees from Takeda Science Foundation. He has received research support from Mitsubishi-Tanabe and Mochida. He is Diplomate of the Academy of Cognitive Therapy. No other disclosures were reported.

References

American Psychiatric Association (1998) Practice guideline for the treatment of patients with panic disorder. Work group on panic disorder. American Journal of Psychiatry 155, 134.Google Scholar
American Psychiatric Association (2013) Diagnostic and Statistical Manual of Mental Disorders, 5th edn. Arlington, VA: American Psychiatric Association.Google Scholar
Barlow, DH and Craske, MG (2000) Mastery of Your Anxiety and Panic: MAP-3. New York: Graywind Publications.Google Scholar
Berger, T, Boettcher, J and Caspar, F (2014) Internet-based guided self-help for several anxiety disorders: a randomized controlled trial comparing a tailored with a standardized disorder-specific approach. Psychotherapy (Chic) 51, 207219.Google Scholar
Bernstein, DA and Borkovec, TD (1973) Progressive Relaxation Training: A Manual for the Helping Professions. Champaign, IL: Research Press.Google Scholar
Clark, DM and Salkovskis, PM (1986) Cognitive Treatment of Panic: Therapist's Manual. Oxford: Department of Psychiatry, University of Oxford.Google Scholar
Craske, MG, DeCola, JP, Sachs, AD and Pontillo, DC (2003) Panic control treatment for agoraphobia. Journal of Anxiety Disorders 17, 321333.Google Scholar
Craske, MG, Rowe, M, Lewin, M and Noriega-Dimitri, R (1997) Interoceptive exposure versus breathing retraining within cognitive-behavioural therapy for panic disorder with agoraphobia. British Journal of Clinical Psychology 36(Pt 1), 8599.Google Scholar
Cuijpers, P, Donker, T, van Straten, A, Li, J and Andersson, G (2010) Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychological Medicine 40, 19431957.Google Scholar
de Ruiter, C, Ryken, H, Garssen, B and Kraaimaat, F (1989) Breathing retraining, exposure and a combination of both, in the treatment of panic disorder with agoraphobia. Behavior Research and Therapy 27, 647655.Google Scholar
Furukawa, TA, Cipriani, A, Barbui, C, Brambilla, P and Watanabe, N (2005) Imputing response rates from means and standard deviations in meta-analyses. International Clinical Psychopharmacology 20, 4952.Google Scholar
Furukawa, TA, Guyatt, GH and Griffith, LE (2002) Can we individualize the ‘number needed to treat’? An empirical study of summary effect measures in meta-analyses. International Journal of Epidemiology 31, 7276.Google Scholar
Higgins, JP, Altman, DG, Gotzsche, PC, Juni, P, Moher, D, Oxman, AD et al. (2011) The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 343, d5928.Google Scholar
Higgins, JP, Jackson, D, Barrett, JK, Lu, G, Ades, AE and White, IR (2012) Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies. Research Synthesis Methods 3, 98110.Google Scholar
Hutton, B, Salanti, G, Caldwell, DM, Chaimani, A, Schmid, CH, Cameron, C et al. (2015) The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Annals of Internal Medicine 162, 777784.Google Scholar
Ito, LM, Noshirvani, H, Basoglu, M and Marks, IM (1996) Does exposure to internal cues enhance exposure to external cues in agoraphobia with panic? A pilot controlled study of self-exposure. Psychotherapy and Psychosomatics 65, 2428.Google Scholar
Karekla, M (2004) A comparison between acceptance enhanced cognitive behavioral and panic control treatment for panic disorder. Doctoral Dissertation, New York: University at Albany, State University of New York.Google Scholar
Katzman, MA, Bleau, P, Blier, P, Chokka, P, Kjernisted, K, Van Ameringen, M et al. (2014) Canadian clinical practice guidelines for the management of anxiety, posttraumatic stress and obsessive-compulsive disorders. BMC Psychiatry 14(suppl. 1), S1.Google Scholar
Kessler, RC, Chiu, WT, Jin, R, Ruscio, AM, Shear, K and Walters, EE (2006) The epidemiology of panic attacks, panic disorder, and agoraphobia in the national comorbidity survey replication. Archives of General Psychiatry 63, 415424.Google Scholar
King, M, Nazareth, I, Levy, G, Walker, C, Morris, R, Weich, S et al. (2008) Prevalence of common mental disorders in general practice attendees across Europe. British Journal of Psychiatry 192, 362367.Google Scholar
Lewis, C, Pearce, J and Bisson, JI (2012) Efficacy, cost-effectiveness and acceptability of self-help interventions for anxiety disorders: systematic review. British Journal of Psychiatry 200, 1521.Google Scholar
Lunn, D, Spiegelhalter, D, Thomas, A and Best, N (2009) The BUGS project: evolution, critique and future directions. Statistics in Medicine 28, 30493067.Google Scholar
NICE (2011) Generalised Anxiety Disorder and Panic Disorder in Adults: Management. London: National Institute for Health and Care Excellence.Google Scholar
Olthuis, JV, Watt, MC, Bailey, K, Hayden, JA and Stewart, SH (2015) Therapist-supported internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database of Systematic Reviews 3, CD011565.Google Scholar
Ost, LG (1987) Applied relaxation: description of a coping technique and review of controlled studies. Behavior Research and Therapy 25, 397409.Google Scholar
Pompoli, A, Furukawa, TA, Imai, H, Tajika, A, Efthimiou, O and Salanti, G (2016) Psychological therapies for panic disorder with or without agoraphobia in adults: a network meta-analysis. Cochrane Database of Systematic Reviews 4, CD011004.Google Scholar
Roemer, L, Erisman, SM, and Orsillo, SM (2008) Mindfulness and acceptance-based treatments for anxiety disorders. In Antony, MM, Stein, MB (eds) Oxford Handbook of Anxiety and Related Disorders. Oxford: Oxford University Press, pp. 476487.Google Scholar
Royal Australian and New Zealand College of Psychiatrists (2003) Australian and New Zealand clinical practice guidelines for the treatment of panic disorder and agoraphobia. Australian and New Zealand Journal of Psychiatry 37, 641656.Google Scholar
Sanchez-Meca, J, Rosa-Alcazar, AI, Marin-Martinez, F and Gomez-Conesa, A (2010) Psychological treatment of panic disorder with or without agoraphobia: a meta-analysis. Clinical Psychology Review 30, 3750.Google Scholar
Schmidt, NB, Woolaway-Bickel, K, Trakowski, J, Santiago, H, Storey, J, Koselka, M et al. (2000) Dismantling cognitive-behavioral treatment for panic disorder: questioning the utility of breathing retraining. Journal of Consulting and Clinical Psychology 68, 417424.Google Scholar
Siev, J and Chambless, DL (2007) Specificity of treatment effects: cognitive therapy and relaxation for generalized anxiety and panic disorders. Journal of Consulting and Clinical Psychology 75, 513522.Google Scholar
Turner, RM, Davey, J, Clarke, MJ, Thompson, SG and Higgins, JP (2012) Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane database of systematic reviews. International Journal of Epidemiology 41, 818827.Google Scholar
Welton, NJ, Caldwell, DM, Adamopoulos, E and Vedhara, K (2009) Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease. American Journal of Epidemiology 169, 11581165.Google Scholar
Winston, A, Rosenthal, RN and Pinsker, H (2004) Introduction to Supportive Psychotherapy. American Psychiatric Publishing: Washington, DC.Google Scholar
Figure 0

Table 1. List of included components and their definitions

Figure 1

Table 2. Conceptualization of various forms of CBT according to a component-level perspective

Figure 2

Table 3. Number and percentage of study arms including each component and estimates of corresponding incremental odds ratios (iOR) parameter, with 95% Credible Intervals (CrI), for remission, response and dropouts

Figure 3

Fig. 1. The network structure for short-term remission at the composite-interventions level (top) and at the component level (bottom).

Supplementary material: File

Pompoli et al. supplementary material

Pompoli et al. supplementary material 1

Download Pompoli et al. supplementary material(File)
File 1.3 MB