Hostname: page-component-5d59c44645-klj7v Total loading time: 0 Render date: 2024-02-27T09:27:40.987Z Has data issue: false hasContentIssue false

More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder

Published online by Cambridge University Press:  15 July 2022

David M. Clark*
Affiliation:
Department of Experimental Psychology, University of Oxford, Oxford, UK
Jennifer Wild
Affiliation:
Department of Experimental Psychology, University of Oxford, Oxford, UK
Emma Warnock-Parkes
Affiliation:
Department of Experimental Psychology, University of Oxford, Oxford, UK Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, Kings College, London, UK
Richard Stott
Affiliation:
Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, Kings College, London, UK
Nick Grey
Affiliation:
Sussex Partnership NHS Foundation Trust, Worthing, West Sussex, UK
Graham Thew
Affiliation:
Department of Experimental Psychology, University of Oxford, Oxford, UK
Anke Ehlers
Affiliation:
Department of Experimental Psychology, University of Oxford, Oxford, UK
*
Author for correspondence: David M Clark, E-mail: david.clark@psy.ox.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Background

Cognitive therapy for social anxiety disorder (CT-SAD) is recommended by NICE (2013) as a first-line intervention. Take up in routine services is limited by the need for up to 14 ninety-min face-to-face sessions, some of which are out of the office. An internet-based version of the treatment (iCT-SAD) with remote therapist support may achieve similar outcomes with less therapist time.

Methods

102 patients with social anxiety disorder were randomised to iCT-SAD, CT-SAD, or waitlist (WAIT) control, each for 14 weeks. WAIT patients were randomised to the treatments after wait. Assessments were at pre-treatment/wait, midtreatment/wait, posttreatment/wait, and follow-ups 3 & 12 months after treatment. The pre-registered (ISRCTN 95 458 747) primary outcome was the social anxiety disorder composite, which combines 6 independent assessor and patient self-report scales of social anxiety. Secondary outcomes included disability, general anxiety, depression and a behaviour test.

Results

CT-SAD and iCT-SAD were both superior to WAIT on all measures. iCT-SAD did not differ from CT-SAD on the primary outcome at post-treatment or follow-up. Total therapist time in iCT-SAD was 6.45 h. CT-SAD required 15.8 h for the same reduction in social anxiety. Mediation analysis indicated that change in process variables specified in cognitive models accounted for 60% of the improvements associated with either treatment. Unlike the primary outcome, there was a significant but small difference in favour of CT-SAD on the behaviour test.

Conclusions

When compared to conventional face-to-face therapy, iCT-SAD can more than double the amount of symptom change associated with each therapist hour.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Social anxiety disorder (SAD) is a disabling condition that can markedly interfere with work and social life (NICE, 2013). In the absence of treatment, it is one of the most persistent common mental health problems (Bruce et al., Reference Bruce, Yonkers, Otto, Eisen, Weisberg, Pagano and Keller2005). Randomised controlled trials in the UK, Europe and Japan have established that individual cognitive therapy for social anxiety disorder (CT-SAD) based on the Clark and Wells model (1995) is an effective treatment that compares favourably with several other active interventions. In particular, CT-SAD has been shown to be superior to three versions of group cognitive-behaviour therapy (CBT) (Ingul, Aune, & Nordahl, Reference Ingul, Aune and Nordahl2013; Mörtberg, Clark, Sundin, & Åberg Wistedt, Reference Mörtberg, Clark, Sundin and Åberg Wistedt2007; Stangier, Heidenreich, Peitz, Lauterbach, & Clark, Reference Stangier, Heidenreich, Peitz, Lauterbach and Clark2003), exposure therapy (Clark et al., Reference Clark, Ehlers, Hackmann, McManus, Fennell, Grey and Wild2006), interpersonal psychotherapy (Stangier, Schramm, Heidenreich, Berger, & Clark, Reference Stangier, Schramm, Heidenreich, Berger and Clark2011), psychodynamic therapy (Leichsenring et al., Reference Leichsenring, Salzer, Beutel, Herpertz, Hiller, Hoyer and Leibing2013), paroxetine (Nordahl et al., Reference Nordahl, Vogel, Morken, Stiles, Sandvik and Wells2016), fluoxetine (Clark et al., Reference Clark, Ehlers, McManus, Hackmann, Fennell, Campbell and Louis2003), and medication-based treatment as usual (Mörtberg et al., Reference Mörtberg, Clark, Sundin and Åberg Wistedt2007). Yoshinaga et al. (Reference Yoshinaga, Matsuki, Niitsu, Sato, Tanaka, Ibuki and Shimizu2016) also reported that CT-SAD is effective in patients who remain symptomatic following anti-depressant treatment.

NICE (2013) recommends individual CT-SAD as a first-line intervention, in preference to group CBT and other psychological interventions. However, take-up of the treatment in routine healthcare systems has been hampered by demanding aspects of the treatment format. 14 weekly sessions are required, which is substantially more than the average number (7.5 sessions) that patients receive in the large-scale English Improving Access to Psychological Therapies (IAPT) treatment service (NHS Digital, 2021) or in similar services in Norway (Knapstad, Lervik, Sæther, Aarø, & Smith, Reference Knapstad, Lervik, Sæther, Aarø and Smith2020) and Australia (Baigent et al., Reference Baigent, Smith, Battersby, Lawn, Redpath and McCoy2020). Sessions are usually 90 min, rather than the standard 50–60 min, and therapists are expected to leave the office to accompany patients on some behavioural experiments. These are challenging requirements in busy routine services.

Internet-assisted therapy could potentially provide a solution to the challenges. A substantial literature shows that internet-based versions of CBT can be effective in a range of clinical conditions, including SAD (Andersson, Reference Andersson2016; Andersson, Carlbring, Titov, & Lindefors, Reference Andersson, Carlbring, Titov and Lindefors2019; Andrews et al., Reference Andrews, Basu, Cuijpers, Craske, McEvoy, English and Newby2018). In internet-based therapy, the key skills in CBT are presented in learning modules that patients can access from home 24 h a day. Most programmes also include regular contact with a therapist. However, the contact is typically substantially briefer than in standard treatment and is remote (via in programme messaging, SMS texts, and/or by phone/ video link). Therapists do not accompany patients in out-of-office assignments. Instead within programme videos are used to illustrate, and motivate patients to complete such assignments.

Encouraged by the general success of internet-based CBT, we decided to develop an internet programme (iCT-SAD) that faithfully implements all the key procedures in CT-SAD. Although some of the existing internet CBT programmes for SAD (such as Andersson et al., Reference Andersson, Carlbring, Holmström, Sparthan, Furmark, Nilsson-Ihrfelt and Ekselius2006) present patients with the Clark and Wells (Reference Clark and Wells1995) model on which CT-SAD is based, none implement the full set of CT-SAD procedures, including video feedback and work on social trauma-related memories. In a small pilot study (Stott et al., Reference Stott, Wild, Grey, Liness, Warnock-Parkes, Commins and Clark2013) improvements in social anxiety with the new iCT-SAD programme were broadly in line with those observed in previous trials of CT-SAD. We now report a randomised controlled trial that compares iCT-SAD with CT-SAD and a waitlist control group. We predicted iCT-SAD would be associated with similar improvements to those observed with CT-SAD but would require substantially less therapist time.

Two RCTs (Andrews, Davies, & Titov, Reference Andrews, Davies and Titov2011; Hedman et al., Reference Hedman, Andersson, Andersson, Ljótsson, Rück, Asmundson and Lindefors2011) have compared other internet programmes against face-to-face CBT in patients with SAD and a third (Botella et al., Reference Botella, Gallego, Garcia-Palacios, Guillen, Baños, Quero and Alcañiz2010) compared internet CBT with face-to-face CBT in students with a more circumscribed fear of public speaking. Encouragingly, none of the trials found a difference in outcome between the internet and face-to-face therapy. However, the trials have some limitations that may have impacted on their ability to robustly test for differences. In the two SAD trials, the face-to-face treatment was group CBT, which is considered less cost-effective than individual CT-SAD (Mavranezouli et al., Reference Mavranezouli, Mayo-Wilson, Dias, Kew, Clark, Ades and Pilling2015). Neither trial included a behaviour test to assess anxiety in a live social interaction. All three trials failed to assess the competence with which the face-to-face treatment was delivered, although Hedman et al. (Reference Hedman, Andersson, Andersson, Ljótsson, Rück, Asmundson and Lindefors2011) showed good adherence to the treatment protocol. Therapeutic alliance was not assessed, and different therapists delivered the internet and face-to-face therapies. We address each of these limitations by comparing internet and standard face-to-face delivery of individual CT-SAD with the same therapists; including a behaviour test; assessing the competence with which the face-to-face therapy is delivered; and assessing the quality of the therapeutic alliances.

Method

Design

Patients were randomised to internet cognitive therapy for social anxiety disorder (iCT-SAD), standard cognitive therapy (CT-SAD), or waitlist control (WAIT) with continued GP care, each for 14 weeks. Patients who received either treatment were followed up for 12 months. Patients in the WAIT condition were randomised to iCT-SAD or CT-SAD at the end of the wait period if they still met the entry criteria for the trial (registration: ISRCTN95458747).

Participants

Inclusion criteria: meets DSM-IV (American Psychiatric Association, 1994) criteria for SAD; SAD is the main problem; aged 18–65 years; internet access from home; no psychotropic medication or on a stable dose for at least 2 months (without clinical improvement) and willing to keep dose constant. Exclusion criteria: unable to attend weekly sessions; previous CBT or exposure therapy for SAD; immediate suicide risk; current substance dependency; current or past psychosis; borderline personality disorder.

Improving Access to Psychological Therapy (IAPT) services in the Oxford region and London referred patients for possible inclusion. Referrers and patients were told that controlled trials had established standard CT-SAD is effective and the study was investigating whether it was also effective when delivered online. Local ethics committees approved the study. All referrals were assessed with the SAD module of the Anxiety Disorders Interview Schedule (ADIS: Brown, Nardo, & Barlow, Reference Brown, Nardo and Barlow1994), with the screener modules of the Structured Clinical Interview for DSM-IV, Axis-I (SCID-1; First, Spitzer, Gibbon, & Williams, Reference First, Spitzer, Gibbon and Williams1995) and the screener questionnaire for Axis-II disorders (SCID-II: First, Gibbon, Spitzer, Williams, & Benjamin, Reference First, Gibbon, Spitzer, Williams and Benjamin1997). If the SCID-I or SCID-II screeners indicated another disorder might be present, the relevant SCID module was administered. Regardless of screening responses, all patients were also assessed with the avoidant personality disorder section of the SCID-II. Diagnostic interviews were conducted by clinical psychologists who had received extensive training in the ADIS and SCID.

Of 218 social anxiety patients referred between February 2013 and October 2014 for possible inclusion, 108 did not meet entry criteria. Figure 1 summarises the reasons. Eight patients who met the criteria declined to participate. After signing a consent form, the remaining 102 patients were allocated to one of the treatments or wait at a 1:1:1 ratio on a stratified random basis by an independent allocation office using the Minim computer programme. Stratification was by the severity of SAD (Liebowitz Social Anxiety Scale Score ⩽75 v. ⩾ 76; Liebowitz, Reference Liebowitz1987). At the end of WAIT, patients who still met trial criteria were randomly allocated to iCT (n = 15) or CT (n = 16) using the same stratification.

Fig. 1. Flow chart of patients' progress through the trial.

Treatments

CT-SAD was the same as in Clark et al. (Reference Clark, Ehlers, Hackmann, McManus, Fennell, Grey and Wild2006). Several procedures (therapist manual & video illustrations available at www.oxcadatresources.com) were used to reverse maintaining factors identified in Clark and Wells (Reference Clark and Wells1995) model of social phobia. These include: (a) an individualised version of Clark and Wells (Reference Clark and Wells1995) model; (b) experiential exercises to demonstrate the adverse effects of self-focused attention and safety behaviours; (c) systematic training in externally focused attention; (d) video feedback for restructuring distorted self-imagery (see Warnock-Parkes et al., Reference Warnock-Parkes, Wild, Stott, Grey, Ehlers and Clark2017); (e) surveys of other peoples' attitudes to issues (such as blushing) that concern patients; (f) behavioural experiments in which patients test pre-specified negative predictions while dropping their safety behaviours and focusing externally; (g) decatastrophizing exercises; and (h) techniques (discrimination training and memory rescripting) for reducing the impact of early socially traumatic memories (see Wild and Clark, Reference Wild and Clark2011). The protocol allowed up to 14 weekly (90 min) face-to-face therapy sessions and 3 booster sessions in the first 3 months of follow-up. Patients attended 12.8 (s.d. = 2.1) weekly treatment sessions (18.4 therapist hours) and 2.3 (s.d. = 0.9) booster sessions (2.8 therapist hours). Therapists frequently conducted behavioural experiments in therapy sessions, some of which were outside of the office. Total number of within-session behavioural experiments was 13.5 (s.d. = 6.1)

In iCT-SAD all the CT-SAD procedures were delivered within an internet programme (see Stott et al., Reference Stott, Wild, Grey, Liness, Warnock-Parkes, Commins and Clark2013 for details). The programme comprises 8 core modules (online Supplementary Table S1) that patients complete in the first two weeks. Thereafter treatment is personalised with 16 additional modules (online Supplementary Table S1) on specific fearful beliefs or problems being available, depending on patients' concerns. iCT-SAD includes secure video conferencing with recording functionality to support conducting the self-focused attention and safety behaviour experiment and video feedback, as well as practising giving presentations to a virtual audience. Within module video clips illustrate how to set up and conduct behavioural experiments for particular fearful concerns. Patients were encouraged to do several behavioural experiments each week. Therapists scheduled short weekly phone calls with patients to review progress, assign new modules, deepen learning, and plan behavioural experiments. Summaries of calls were sent via the iCT-SAD secure messaging system, which was also used to provide encouragement and suggestions as appropriate. Reminders for behavioural experiments and questionnaire completion could be sent by within programme SMS. The core modules were released to all patients. On average 8.6 (range 0 to 12) additional modules were released. 81% of released modules were completed. Patients logged into the programme for a total of 43.9 h (s.d. = 24.2) and recorded 21.7 (s.d. = 18.6) completed behavioural experiments. Prior to the 14-week assessment, therapists had a mean of 12.4 (s.d. = 3.2) short weekly phone calls with their patients (2.8 h in total) and a mean of 2.5 (s.d. = 1.4) video calls (1.3 h in total), giving a total of 4.1 h of live therapist-patient contact. They sent an average of 38.2 (s.d. = 22.1) secure messages and 10.7 (s.d. = 12.2) SMS texts. Total estimated time spent supporting patients was 6.8 h up to week 14, with an additional 1 h during the booster period. There were no drop-outs (defined as disengaging before the midpoint) in either treatment.

Therapists, supervision and treatment integrity

Three clinical psychologists (JW, EWP, RS) with substantial prior experience of CT-SAD and at least three practice cases with iCT-SAD each treated a third of the patients in each treatment group. DMC provided regular supervision. To check CT-SAD was consistently delivered to a high standard, a randomly selected session videotape from the treatment of each patient allocated to CT-SAD was rated by an independent expert (Louise Waddington) using the 15-item cognitive therapy competence rating scale for social phobia (CTCS-SP: Ginzburg et al., Reference Ginzburg, Bohn, Höfling, Weck, Clark and Stangier2012; von Consbruch, Clark, & Stangier, Reference von Consbruch, Clark and Stangier2012). Mean item score was 4.92 (s.d. = 0.47). No session was rated below 4 (on a 0–6 scale). All tapes were therefore rated ‘good’ to ‘excellent’. Competence in delivering iCT-SAD was not assessed as no appropriate measure was available.

At the start of the trial, 67 patients (66%) were medication free. The remaining 35 patients had been on a stable dose for at least two months without improvement and were asked not to change their medication. The medications were SSRIs (22 patients), beta-blockers (13 patients), benzodiazepines (2 patients) and another anti-depressant (1 patient). At the post-treatment/wait assessment, 24 of these patients were on the same medication and 11 had discontinued. 2 patients (1 iCT-SAD, 1 wait) started medication.

Primary outcome measure

Online Supplementary Table S2 shows the assessment schedule. The pre-registered primary outcome measure was the social anxiety disorder composite. This was created by combining scores from six independent assessor and patient self-report scales of social anxiety, using Rosenthal and Rosnow's (Reference Rosenthal and Rosnow1991) procedure, as in previous SAD trials (Clark et al., Reference Clark, Ehlers, McManus, Hackmann, Fennell, Campbell and Louis2003, Reference Clark, Ehlers, Hackmann, McManus, Fennell, Grey and Wild2006). Patients' scores on each scale were standardised (M = 0, s.d. = 1) across pre-treatment and post-treatment assessments by converting to Z scores. The composite of each set on that occasion was the mean of the Z scores on that occasion. The individual scales that made up the composite are as follows. Independent assessors, who were blind to treatment allocation on each occasion, rated patients' fear and avoidance across a range of social situations using the ADIS for DSM-IV (Brown et al., Reference Brown, Nardo and Barlow1994). Patients completed five standardised self-report SAD scales, which were: Liebowitz Social Anxiety Scale (LSAS: Baker, Heinrichs, Kim, & Hofmann, Reference Baker, Heinrichs, Kim and Hofmann2002), Social Phobia Inventory (SPIN: Connor et al., Reference Connor, Davidson, Churchill, Sherwood, Foa and Weisler2000), Social Phobia Scale (SPS: Mattick and Clarke, Reference Mattick and Clarke1998), Social Interaction Anxiety Scale (SIAS: Mattick & Clarke, Reference Mattick and Clarke1998), Fear of Negative Evaluation (FNE: Watson & Friend, Reference Watson and Friend1969).

Secondary outcome measures

Social anxiety disorder

Secondary outcomes included the proportion of patients who were rated by the independent assessor as no longer meeting diagnostic criteria for SAD and, for comparison with other studies, several commonly used responder and recovery criteria based on self-report scales. Participation in social activities and satisfaction with relationships was assessed with Alden and Taylor's (Reference Alden and Taylor2011) scales.

Behaviour test

Patients also completed Heimberg's (Reference Heimberg2002) standardised behaviour test which comprises a conversation with two other people, followed by giving a speech to the same people. Patients rated their anxiety (0–100) during the tasks and afterwards rated how well (0–8) they thought they appeared using a 14-item checklist.

Anxious mood and depressed mood

The Generalized Anxiety Disorder scale (GAD-7: Spitzer, Kroenke, Williams, & Löwe, Reference Spitzer, Kroenke, Williams and Löwe2006) and the Patient Health Questionnaire (PHQ-9: Kroenke, Spitzer, & Williams, Reference Kroenke, Spitzer and Williams2001) were used to assess anxious and depressed mood, respectively.

Functional impairment/interference

The Work and Social Adjustment Scale (WSAS: Mundt, Marks, Shear, & Greist, Reference Mundt, Marks, Shear and Greist2002) was used to assess interference with work, social, leisure and home life.

Process measures

Four psychological processes targeted in treatment were assessed using the Social Cognitions Questionnaire (SCQ: frequency and belief in negative thoughts), Social Behaviours Questionnaire (SBQ: safety behaviours), Social Attitudes Questionnaire (SAQ: negative social anxiety-related assumptions) and Social Phobia Weekly Summary Scale (SPWSS: self-focused attention items). See Clark (Reference Clark2005) for details. These questionnaires are available at https://oxcadatresources.com/

Non-specific therapy factors

At the end of the second week, therapist and patient independently completed a measure of therapeutic alliance (Agnew-Davies, Stiles, Hardy, Barkham, & Shapiro, Reference Agnew-Davies, Stiles, Hardy, Barkham and Shapiro1998). Patients also completed Borkovec and Nau's (Reference Borkovec and Nau1972) treatment credibility and expectancy of improvement scales.

Data analysis

Power calculations based on our previous trial of CT-SAD v. wait (Clark et al., Reference Clark, Ehlers, Hackmann, McManus, Fennell, Grey and Wild2006) indicated that a sample size of 34 per group would give power of 99% to detect differences between each treatment and wait. Comparisons between CT and iCT were based on all treated patients (including post-wait patients), with 50 patients per treatment giving 82% power to detect a clinically meaningful difference of 0.45 on the primary outcome measure. We analysed each continuous outcome with a linear mixed-effects regression model to account for repeated measures over time and include all available data from participants in the relevant randomisation. This method has the advantage of implicitly accounting for data missing at random. The models included categorical fixed factors of time (mid- intervention, post-intervention and, when relevant, 3 month and 12 month follow-up), and treatment condition (CT, iCT, Wait). The time-by-condition interaction was modelled as a fixed effect to allow estimation of treatment effect at each timepoint. Covariates were baseline score on the measure being analysed, and the PHQ. The latter was included as, by chance, there was a small imbalance in baseline depression between the groupsFootnote Footnote 1. Participant was specified as a random effect to account for between-person variation. When analysing secondary outcome measures, the baseline score of the primary outcome measure was included as an additional covariate. The CT and iCT conditions were compared using the larger samples generated following the re-randomisation and treatment of the waitlist group participants after the wait period. These models included the data from the three-month and twelve-month follow-up timepoints. All models used restricted maximum likelihood estimation. Q-Q plots indicated that the normality of residuals assumption was met for all models. Between-group effect sizes (Cohen's d) were calculated by dividing the adjusted group difference by the pooled standard deviation.

To examine the potential mediating effect of process variables on clinical outcomes, we applied the analytic procedure described in Freeman et al. (Reference Freeman, Reeve, Robinson, Ehlers, Clark, Spanlang and Slater2017), which follows the Baron and Kenny (Reference Baron and Kenny1986) approach but uses linear mixed-effects models at each step to account for repeated measures within participants. Mid-treatment/wait scores on the composite process variable were examined as a candidate mediator of the relationship between randomisation (each treatment v. wait) and posttreatment/wait scores on the social anxiety composite. All models included baseline scores on the outcome, mediator, and PHQ as covariates, used the intention-to-treat sample and an alpha level of p = 0.05. Analyses were conducted in R version 3.5.1 (R Core Team, 2017) using the package ‘nlme’ (Pinheiro, Bates, DebRoy, & Sarkar, Reference Pinheiro, Bates, DebRoy and Sarkar2018).

Linear regression identified possible predictors of outcome within each treatment. Post-treatment scores on the primary outcome measure were related to each putative predictor while controlling for pre-treatment scores.

Results

Characteristics of patients

Patients' mean age was 32.2 (s.d. = 8.3) and the mean duration of SAD was 18.4 years (s.d. = 9.6). Fifty-two per cent were female. Fifty-four per cent were married, cohabiting or in a long-term relationship. Eighty-eight per cent were Caucasian. Seventy-six per cent were employed, 14% were students and 10% were unemployed. Fourteen per cent left school by age 16, 21% completed high school and 65% had some higher education. Fifty-five per cent met diagnostic criteria for one or more additional current axis-I disorders. The main co-morbid axis-I disorders were: depressive disorder (30%), generalised anxiety disorder (20%), somatoform disorder (8%), specific phobia (8%), panic disorder (6%), alcohol or substance abuse (4%), agoraphobia (2%), obsessive-compulsive disorder (2%), PTSD (1%) and anorexia (1%). Eighty-one per cent met the criteria for one or more personality disorders, which were avoidant (73%), obsessive (30%), and paranoid (13%). There were no significant differences between the groups on these characteristics.

Treatment credibility and therapeutic alliance

Patient ratings of treatment credibility (item means CT-SAD 8.0, s.d. = 1.1; iCT-SAD 7.8 s.d. = 1.2) and therapeutic alliance (CT-SAD 73.1, s.d. = 8.3; iCT-SAD 74.1, s.d. = 7.6) were high and did not differ. However, therapists rated the therapeutic alliance (CT-SAD 77.1, s.d. = 7.0; iCT-SAD 71.3, s.d. = 7.3. t (65) = 3.3, p < 0.001) more highly in CT-SAD.

Comparisons between treatments and waitlist control group

Table 1 shows relevant scores at each assessment. On the primary outcome measure (SAD composite) both treatments were superior to the waitlist, with large effect sizes (d = 2.20 for iCT-SAD and 2.38 for CT-SAD) at post-treatment/wait. Similar results were observed for the behaviour test (Table 2), the other secondary outcome measures (online Supplementary Table S3) and the process composite (Table 1).

Table 1. Comparisons between the treatments and the wait list control group on the primary outcome and the process composite

iCT, Internet-based Cognitive Therapy; CT, Standard (face-to-face) Cognitive Therapy.

Adjusted mean differences based on linear mixed-effects models adjusted for baseline scores. d is the standardised effect size (Cohen's d), calculated using the pooled standard deviation.

Table 2. Behaviour Test: comparisons between the treatments and wait-list control condition

iCT, Internet-based Cognitive Therapy; CT, Standard (face-to-face) Cognitive Therapy.

Adjusted mean differences based on linear mixed-effects models adjusted for baseline scores. d is the standardised effect size (Cohen's d), calculated using the pooled standard deviation. For the behaviour checklist a higher score indicates better performance. Anxiety and behaviour checklist scores are averaged across the conversation and the speech. For the conversation, patients are told they will be meeting two people and should talk with them as though they met them at a party. For the speech the patient stands while the two audience members sit. Patients are asked to talk about a topic that they decide in advance; either some current event, or hobbies, or something work-related. For both the conversation and the speech, patients are given 2 min to prepare before entering the room.

Deterioration rates were calculated using IAPT criteria (NCCMH, 2021, p. 40). No patients in either treatment deteriorated between pre and post, but 9% (n = 3) in the wait group deteriorated (1 due to a reliable increase on the SPIN and 2 due to a reliable increase on the PHQ).

Comparisons between the two treatments

Table 3 shows the scores at each assessment for the primary outcome, the continuous secondary outcome measures, and the process composite. (see online Supplementary Table S4 for components of the composites). On the primary outcome, there were no significant differences between internet (iCT-SAD) and standard (CT-SAD) cognitive therapy at any time point (ds range from 0.22 to 0.31). There were also no significant differences on the process composite at any timepoint (ds range from 0.19 to 0.38). In contrast to the lack of differences on the primary social anxiety measure, there as a significant difference in favour of CT-SAD on one of the two measures in the post-treatment behaviour test (self-reported anxiety, p = 0.011, d = 0.47). CT-SAD was also associated with a significantly lower depression score at post-treatment (p = 0.002, d = 0.64) but not at the 3mth or 12mth follow-ups. There were no significant differences between the treatments on any other measure at post-treatment or follow-up.

Table 3. Comparisons between internet (iCT) and standard face-to-face treatment (CT) on primary outcome, process composite and secondary outcomes

Notes. iCT = Internet-based Cognitive Therapy, CT = Standard (face-to-face) Cognitive Therapy. Table includes everyone who was randomized to iCT or CT, either immediately or at the end of the waitlist. WSAS = Work and Social Adjustment Scale, GAD-7 = Generalised Anxiety Disorder Questionnaire, PHQ-9 = Patient Health Questionnaire. Adjusted mean differences based on linear mixed effects models adjusted for baseline scores. d is the standardised effect size (Cohen’s d), calculated using the pooled standard deviation.

Table 4 shows the proportions of patients who lost the diagnosis of SAD and that met the IAPT criteria for recovery (NCCMH, 2021) at post-treatment and follow-up. There were no significant differences between the treatments at either assessment. The loss of diagnosis rates (72% to 91%) are higher than the recovery rates based on IAPT criteria (59% to 82%) as the latter require individuals to drop below the clinical cut-off on both social anxiety and depression and also code patients with missing data as not recovered (NCCMH, 2021, p. 39). online Supplementary Table S5 shows the proportions of individuals meeting other responder and remission criteria that are commonly cited in the literature.

Table 4. Recovery rates (loss of diagnosis and IAPT criteria)

a Numerator is the number of people meeting the relevant criteria. Denominator is the number of people with data on the relevant measure.

b IAPT recovery requires patients to initially score above the clinical cut-off on the Social Phobia Inventory (19) and/or PHQ (10) and to subsequently score below the clinical cut-off on both the SPIN and the PHQ. All patients scored above the clinical threshold on SPIN at pretreatment and hence are classified as clinical cases at that time point. In line with the IAPT manual (National Collaborating Centre for Mental Health, 2021), patients who did not have a SPIN or PHQ score available at post-treatment or follow-up are assumed to have not recovered. So, the denominators for the % recovery values are n = 49 for iCT and n = 50 for CT.

Most patients (72%, n = 71/99) met the diagnostic criteria for avoidant personality disorder at pre-treatment. For most (60/71), the SCID-II diagnostic interview was repeated at one-year follow-up. At that point, 82% (49/60) had lost the diagnosis of avoidant PD.

To further explore the apparent lack of difference between the two treatments on the primary outcome measure, we adopted Rogers, Howard, and Vessey's (Reference Rogers, Howard and Vessey1993) confidence interval approach to equivalence testing. Setting alpha at 0.05, we were able to reject the hypothesis that iCT-SAD could be more than 25% less effective than CT-SAD at post-treatment or follow-up.

Therapeutic change per hour of therapy

Patients completed the Liebowitz Social Anxiety Scale (LSAS) each week during treatment. Figure 2 shows the weekly scores plotted against cumulating therapist time. By the end of treatment, iCT patients had dropped 45.5 points on the LSAS after an average of 6.45 h contact with their therapist. In CT, 15.8 h of therapist contact were required to achieve the same drop on the LSAS. iCT is therefore associated with 2.45 times more symptom change per hour of therapist contact time.

Fig. 2. Means and standard errors for weekly Liebowitz Social Anxiety Scale (LSAS) plotted against cumulating therapist time.

Mediation analysis

To examine whether the effectiveness of the two treatments was partly due to their ability to change processes specified in the Clark and Wells (Reference Clark and Wells1995) cognitive model, we conducted mediation analyses. For both iCT-SAD and CT-SAD scores on the process composite at mid-treatment/wait mediated the relationship between randomisation (treatment v. wait) and scores on the primary outcome measure at post-treatment/wait (see Table 5). It, therefore, appears that each treatment partly works by changing the process variables.

Table 5. Mediation analysis

Notes. N = 34 per condition. Coefficients estimated using linear mixed-effects models, with total, direct, and indirect effects calculated following Baron and Kenny (Reference Baron and Kenny1986). Models included baseline scores on the mediator and outcome variables as fixed covariates, and a random effect of participant.

Predictors of treatment response

Patients who rated their treatment as more credible and thought they had a better therapeutic relationship with their therapist at week 2 scored lower on the social anxiety composite at post-treatment in both iCT (credibility: standardised β = −0.373, p = 0.01; therapeutic alliance: standardised β = −0.0470, p = 0.001) and CT (credibility: standardised beta = −0.342, p = 0.01; therapeutic alliance: standardised beta = −0.459, p = 0.001). Early therapist ratings of the therapeutic relationship did not predict outcome in CT (standardised β = −0.175, p = 0.225) but did predict outcome in iCT (standardised β = 0.349, p = 0.015). Within iCT, individuals who practised giving presentations to a virtual audience more frequently had better outcomes (standardised β = −0.420, p = 0.003). The presence of avoidant personality disorder did not predict outcome in either treatment.

Discussion

The primary aim of the trial was to determine whether iCT-SAD can achieve similar outcomes to well-conducted individual CT-SAD in less therapist time. Competence ratings for CT-SAD confirmed it was delivered to a high standard and the observed improvements were comparable to those in our previous trial (Clark et al., Reference Clark, Ehlers, Hackmann, McManus, Fennell, Grey and Wild2006). iCT-SAD was also associated with large improvements and did not differ significantly from CT-SAD on the primary outcome, despite not requiring the delivery features of CT-SAD that services find challenging, such as 90 min sessions and accompanying patients on behavioural experiments outside the office. Week by week tracking of social anxiety indicated that the full symptom change associated with iCT-SAD was achieved after only 6.45 h of therapist time whereas CT-SAD required 15.8 h to achieve the same amount of improvement. It, therefore, appears that iCT-SAD achieves 2.45 times more symptom change per hour of therapist time. The total therapist time required for iCT-SAD is similar to the average in IAPT services. Removal of the need to accompany patients on out-of-the-office assignments is also likely to make it easier to use in routine healthcare settings.

Cognitive therapy aims to treat SAD by changing the key maintenance processes specified in Clark and Wells (Reference Clark and Wells1995) and similar (Hofmann, Reference Hofmann2007; Rapee & Heimberg, Reference Rapee and Heimberg1997) cognitive models. To test whether improvements associated with the treatment are at least partly attributable to its ability to change these processes, a mediation analysis was conducted. For both internet and face-to-face versions, change in processes specified in the models accounted for around 60% improvement associated with treatment. As well as supporting the cognitive models on which treatment is based, this finding suggests that therapists should carefully track and maximise change in self-focused attention, negative social anxiety-related beliefs and safety behaviours during treatment. To facilitate this, the iCT-SAD programme automatically graphs change in these variables.

Research has shown that the quality of a therapeutic relationship plays an important role in the outcome of many psychological treatments (Norcross, Reference Norcross2011), including some (see Berger, Reference Berger2017), but not all (Zalaznik et al., Reference Zalaznik, Strauss, Halaj, Barzilay, Fradkin, Katz and Huppert2021), of those delivered over the internet. We also found a significant relationship between early ratings of therapeutic alliance and eventual outcome. It might be thought that the remote support used in iCT-SAD would have an adverse effect on the therapeutic relationship. However, patient ratings of the therapeutic alliance were as high in iCT-SAD as in CT-SAD. Therapist ratings were slightly lower for iCT-SAD, perhaps because the type of communication was something that they were less familiar with. Initial ratings of the credibility of psychological treatment have also often been shown to predict outcome (Devilly & Borkovec, Reference Devilly and Borkovec2000) and did so in iCT-SAD. Therapists should therefore ensure that when patients are allocated to iCT-SAD any concerns about its credibility are identified and addressed.

This trial included a behaviour test that provided additional insights. iCT-SAD was associated with large reductions in anxiety during the test (d = 1.47). In contrast to the other primary and secondary social anxiety measures, there was also a modest (d = 0.47), but significant, difference in favour of CT-SAD. In view of this finding, we suggest future evaluations of internet treatments for SAD include a behaviour test. However, the interpretation of the difference in favour of CT-SAD in this study is complicated by the fact that the test was conducted in the clinic where CT-SAD patients had their treatment. It is unclear whether the additional familiarity that CT-SAD patients had with the setting and staff contributed to the difference. To avoid this ambiguity, behaviour tests in future studies should be conducted elsewhere.

Limitation and further research

To provide a rigorous test of internet delivery we used the same experienced therapists for internet and face-to-face therapy. Further studies are required to determine whether including all the key therapy procedures in the internet programme will enable therapists in routine services who have had less prior experience with standard cognitive therapy to achieve similarly positive results with iCT-SAD.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291722002008.

Acknowledgements

We are grateful to Georgina Bremner, Lauren Canvin, Rachelle Dawson, Ava Forkert, Laura Franklin, Sophie Grant, Harriet Rankin, Jennifer Readings, Gautier Hayoun, Clare Mein, Hannah Stratford, Jade Womersley and Elizabeth Woodward for their assistance.

Financial support

Funding was provided by the Wellcome Trust (069777 and 200796).

Conflicts of interest

The authors have no conflicts of interest to declare.

Footnotes

The notes appear after the main text.

1 Not including baseline PHQ as a covariate produced the same results as reported here.

References

Agnew-Davies, R., Stiles, W. B., Hardy, G. E., Barkham, M., & Shapiro, D. A. (1998). Alliance structure assessed by the Agnew Relationship Measure (ARM). British Journal of Clinical Psychology, 37(2), 155172. doi:https://doi.org/10.1111/j.2044-8260.1998.tb01291.xCrossRefGoogle ScholarPubMed
Alden, L. E., & Taylor, C. T. (2011). Relational treatment strategies increase social approach behaviors in patients with generalized social anxiety disorder. Journal of Anxiety Disorders, 25(3), 309318. doi:https://doi.org/10.1016/j.janxdis.2010.10.003CrossRefGoogle ScholarPubMed
American Psychiatric Association (1994). Diagnostic and statistical manual of mental disorders (Vol. 4th). Washington, D.C.: Author.Google Scholar
Andersson, G. (2016). Internet-delivered psychological treatments. Annual Review of Clinical Psychology, 12, 157179. doi:https://doi.org/10.1146/annurev-clinpsy-021815-093006CrossRefGoogle ScholarPubMed
Andersson, G., Carlbring, P., Holmström, A., Sparthan, E., Furmark, T., Nilsson-Ihrfelt, E., … Ekselius, L. (2006). Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 74(4), 677686. doi:https://doi.org/10.1037/0022-006x.74.4.677CrossRefGoogle ScholarPubMed
Andersson, G., Carlbring, P., Titov, N., & Lindefors, N. (2019). Internet interventions for adults with anxiety and mood disorders: A narrative umbrella review of recent meta-analyses. Canadian Journal of Psychiatry, 64(7), 465470. doi:https://doi.org/10.1177/0706743719839381CrossRefGoogle ScholarPubMed
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018). Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: An updated meta-analysis. Journal of Anxiety Disorders, 55, 7078. doi:https://doi.org/10.1016/j.janxdis.2018.01.001CrossRefGoogle ScholarPubMed
Andrews, G., Davies, M., & Titov, N. (2011). Effectiveness randomized controlled trial of face to face versus internet cognitive behaviour therapy for social phobia. Australian and New Zealand Journal of Psychiatry, 45(4), 337340. doi:https://doi.org/10.3109/00048674.2010.538840CrossRefGoogle ScholarPubMed
Baigent, M., Smith, D., Battersby, M., Lawn, S., Redpath, P., & McCoy, A. (2020). The Australian version of IAPT: Clinical outcomes of the multi-site cohort study of NewAccess. Journal of Mental Health published online 12th May 2020. doi:https://doi.org/10.1080/09638237.2020.1760224.Google ScholarPubMed
Baker, S. L., Heinrichs, N., Kim, H. J., & Hofmann, S. G. (2002). The Liebowitz social anxiety scale as a self-report instrument: A preliminary psychometric analysis. Behaviour Research and Therapy, 40(6), 701715. doi:https://doi.org/10.1016/s0005-7967(01)00060-2CrossRefGoogle ScholarPubMed
Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6), 11731182. doi:https://doi.org/10.1037//0022-3514.51.6.1173CrossRefGoogle ScholarPubMed
Berger, T. (2017). The therapeutic alliance in internet interventions: A narrative review and suggestions for future research. Psychotherapy Research, 27(5), 511524. doi:https://doi.org/10.1080/10503307.2015.1119908CrossRefGoogle ScholarPubMed
Borkovec, T. D., & Nau, S. D. (1972). Credibility of analogue therapy rationales. Journal of Behavior Therapy and Experimental Psychiatry, 3(4), 257260. doi:https://psycnet.apa.org/doi/10.1016/0005-7916(72)90045-6CrossRefGoogle Scholar
Botella, C., Gallego, M. J., Garcia-Palacios, A., Guillen, V., Baños, R. M., Quero, S., & Alcañiz, M. (2010). An internet-based self-help treatment for fear of public speaking: A controlled trial. Cyberpsychology, Behavior, and Social Networking, 13(4), 407421. doi:https://doi.org/10.1089/cyber.2009.0224CrossRefGoogle ScholarPubMed
Brown, T. A., Nardo, P. A., & Barlow, D. H. (1994). Anxiety disorders interview schedule for DSM-IV. Albany, NY: Graywind Publications Inc.Google Scholar
Bruce, S. E., Yonkers, K. A., Otto, M. W., Eisen, J. L., Weisberg, R. B., Pagano, M., … Keller, M. B. (2005). Influence of psychiatric comorbidity on recovery and recurrence in generalized anxiety disorder, social phobia, and panic disorder: A 12-year prospective study. American Journal of Psychiatry, 162(6), 11791187. doi:https://doi.org/10.1176/appi.ajp.162.6.1179CrossRefGoogle ScholarPubMed
Clark, D. M. (2005). Three questionnaires for measuring the central constructs in the cognitive model of social phobia: preliminary analysis. Unpublished manuscript available from www.oxcadatresources.com.Google Scholar
Clark, D. M., Ehlers, A., Hackmann, A., McManus, F., Fennell, M., Grey, N., … Wild, J. (2006). Cognitive therapy versus exposure and applied relaxation in social phobia: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 74(3), 568578. doi:https://doi.org/10.1037/0022-006x.74.3.568CrossRefGoogle ScholarPubMed
Clark, D. M., Ehlers, A., McManus, F., Hackmann, A., Fennell, M., Campbell, H., … Louis, B. (2003). Cognitive therapy versus fluoxetine in generalized social phobia: A randomized placebo-controlled trial. Journal of Consulting and Clinical Psychology, 71(6), 10581067. doi:https://doi.org/10.1037/0022-006x.71.6.1058CrossRefGoogle ScholarPubMed
Clark, D. M., & Wells, A. (1995). A cognitive model of social phobia. Social phobia: Diagnosis, assessment, and treatment (pp. 6993). New York, NY, US: The Guilford Press.Google Scholar
Connor, K. M., Davidson, J. R., Churchill, L. E., Sherwood, A., Foa, E., & Weisler, R. H. (2000). Psychometric properties of the social phobia inventory (SPIN). New self-rating scale. British Journal of Psychiatry, 176, 379386. doi:https://doi.org/10.1192/bjp.176.4.379CrossRefGoogle ScholarPubMed
Devilly, G. J., & Borkovec, T. D. (2000). Psychometric properties of the credibility/expectancy questionnaire. Journal of Behavior Therapy and Experimental Psychiatry, 31(2), 7386. doi:https://doi.org/10.1016/s0005-7916(00)00012-4CrossRefGoogle ScholarPubMed
First, B. M., Gibbon, M., Spitzer, R. L., Williams, J. B. W., & Benjamin, L. S. (1997). User's guide for the structured clinical interview for DSM-IV axis II personality disorders:SCID II. Washington, D.C.: American Psychiatric Press.Google Scholar
First, B. M., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1995). User's guide for the structured clinical interview for DSM-IV axis I disorders: SCID-I clinician version. Washington, DC: American Psychiatric Press.Google Scholar
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychological Medicine, 47(14), 23932400. doi:https://doi.org/10.1017/s003329171700040xCrossRefGoogle ScholarPubMed
Ginzburg, D. M., Bohn, C., Höfling, V., Weck, F., Clark, D. M., & Stangier, U. (2012). Treatment specific competence predicts outcome in cognitive therapy for social anxiety disorder. Behaviour Research and Therapy, 50(12), 747752. doi:https://dx.doi.org/10.1016%2Fj.brat.2012.09.001CrossRefGoogle ScholarPubMed
Hedman, E., Andersson, G., Andersson, E., Ljótsson, B., Rück, C., Asmundson, G. J., & Lindefors, N. (2011). Internet-based cognitive-behavioural therapy for severe health anxiety: Randomised controlled trial. British Journal of Psychiatry, 198(3), 230236. doi:https://doi.org/10.1192/bjp.bp.110.086843CrossRefGoogle ScholarPubMed
Heimberg, R. G. (2002). Pre-Treatment Behavior Test Package. Unpublished manuscript Temple University. USA.Google Scholar
Hofmann, S. G. (2007). Cognitive factors that maintain social anxiety disorder: A comprehensive model and its treatment implications. Cognitive Behaviour Therapy, 36(4), 193209. doi:https://dx.doi.org/10.1080%2F16506070701421313CrossRefGoogle ScholarPubMed
Ingul, J., Aune, T., & Nordahl, H. (2013). A randomized controlled trial of individual cognitive therapy, group cognitive behaviour therapy and attentional placebo for adolescent social phobia. Psychotherapy and Psychosomatics, 83, 5461. doi:http://dx.doi.org/10.1159/000354672CrossRefGoogle ScholarPubMed
Knapstad, M., Lervik, L. V., Sæther, S. M. M., Aarø, L. E., & Smith, O. R. F. (2020). Effectiveness of prompt mental health care, the Norwegian version of improving access to psychological therapies: A randomized controlled trial. Psychotherapy and Psychosomatics, 89(2), 90105. doi:https://doi.org/10.1159/000504453CrossRefGoogle ScholarPubMed
Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606613. doi:https://doi.org/10.1046/j.1525-1497.2001.016009606.xCrossRefGoogle ScholarPubMed
Leichsenring, F., Salzer, S., Beutel, M. E., Herpertz, S., Hiller, W., Hoyer, J., … Leibing, E. (2013). Psychodynamic therapy and cognitive-behavioral therapy in social anxiety disorder: A multicenter randomized controlled trial. American Journal of Psychiatry, 170(7), 759767. doi:https://doi.org/10.1176/appi.ajp.2013.12081125CrossRefGoogle ScholarPubMed
Liebowitz, M. R. (1987). Social phobia. Modern Problems of Pharmacopsychiatry, 22, 141173. doi:https://doi.org/10.1159/000414022CrossRefGoogle ScholarPubMed
Mattick, R. P., & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36(4), 455470. doi:https://doi.org/10.1016/s0005-7967(97)10031-6CrossRefGoogle ScholarPubMed
Mavranezouli, I., Mayo-Wilson, E., Dias, S., Kew, K., Clark, D. M., Ades, A. E., & Pilling, S. (2015). The cost effectiveness of psychological and pharmacological interventions for social anxiety disorder: A model-based economic analysis. PLoS ONE, 10(10), e0140704. doi:https://doi.org/10.1371/journal.pone.0140704CrossRefGoogle ScholarPubMed
Mörtberg, E., Clark, D. M., Sundin, Ö, & Åberg Wistedt, A. (2007). Intensive group cognitive treatment and individual cognitive therapy vs. treatment as usual in social phobia: A randomized controlled trial. Acta Psychiatrica Scandinavica, 115(2), 142154. doi:https://doi.org/10.1111/j.1600-0447.2006.00839.xCrossRefGoogle ScholarPubMed
Mundt, J. C., Marks, I. M., Shear, M. K., & Greist, J. M. (2002). The work and social adjustment scale: A simple measure of impairment in functioning. The British Journal of Psychiatry, 180(5), 461464. doi:https://doi.org/10.1192/bjp.180.5.461CrossRefGoogle Scholar
National Collaborating Centre for Mental Health. (2021). The Improving Access to Psychological Therapies (IAPT) Manual Retrieved from https://www.england.nhs.uk/wp-content/uploads/2018/06/the-iapt-manual-v5.pdf.Google Scholar
NHSDigital. (2021). Psychological Therapies: reports on the use of IAPT services, England August 2020 Final including reports on the IAPT pilots. Retrieved from https://digital.nhs.uk/data-and-information/publications/statistical/psychological-therapies-annual-reports-on-the-use-of-iapt-services/annual-report-2020-21.Google Scholar
NICE. (2013). Social anxiety disorder: Recognition, assessment and treatment (clinical guideline 159). London, UK: National Institute for Health and Care Excellence. Retrieved from https://www.nice.org.uk/guidance/cg159.Google Scholar
Norcross, J. C. (2011). Psychotherapy relationships that work: Evidence-based responsiveness (2nd ed). New York, NY, US: Oxford University Press.CrossRefGoogle Scholar
Nordahl, H. M., Vogel, P. A., Morken, G., Stiles, T. C., Sandvik, P., & Wells, A. (2016). Paroxetine, cognitive therapy or their combination in the treatment of social anxiety disorder with and without avoidant personality disorder: A randomized clinical trial. Psychotherapy and Psychosomatics, 85(6), 346356. doi:https://doi.org/10.1159/000447013CrossRefGoogle ScholarPubMed
Pinheiro, J., Bates, D., DebRoy, S., & Sarkar, D., & R Core Team. (2018). nlme: Linear and Nonlinear Mixed Effects Models. [R package version 3.1-131.1.]. Retrieved from https://CRAN.R-project.org/package=nlme.Google Scholar
R Core Team. (2017). R: A language and environment for statistical computing. Vienna, Austria. Retrieved from https://www.r-project.org/.Google Scholar
Rapee, R. M., & Heimberg, R. G. (1997). A cognitive-behavioral model of anxiety in social phobia. Behaviour Research and Therapy, 35(8), 741756. doi:https://doi.org/10.1016/s0005-7967(97)00022-3CrossRefGoogle ScholarPubMed
Rogers, J. L., Howard, K. I., & Vessey, J. T. (1993). Using significance tests to evaluate equivalence between two experimental groups. Psychological Bulletin, 113(3), 553565. doi:https://doi.org/10.1037/0033-2909.113.3.553CrossRefGoogle ScholarPubMed
Rosenthal, R., & Rosnow, R. L. (1991). Essentials of behavioural research: Methods and data analysis (2nd ed.). New York: McGraw-Hill.Google Scholar
Spitzer, R. L., Kroenke, K., Williams, J. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The gad-7. Archives of Internal Medicine, 166(10), 10921097. doi:https://doi.org/10.1001/archinte.166.10.1092CrossRefGoogle ScholarPubMed
Stangier, U., Heidenreich, T., Peitz, M., Lauterbach, W., & Clark, D. M. (2003). Cognitive therapy for social phobia: Individual versus group treatment. Behaviour Research and Therapy, 41(9), 9911007. doi:https://doi.org/10.1016/s0005-7967(02)00176-6CrossRefGoogle ScholarPubMed
Stangier, U., Schramm, E., Heidenreich, T., Berger, M., & Clark, D. M. (2011). Cognitive therapy vs interpersonal psychotherapy in social anxiety disorder: A randomized controlled trial. Archives of General Psychiatry, 68(7), 692700. doi:https://doi.org/10.1001/archgenpsychiatry.2011.67CrossRefGoogle ScholarPubMed
Stott, R., Wild, J., Grey, N., Liness, S., Warnock-Parkes, E., Commins, S., … Clark, D. M. (2013). Internet-delivered cognitive therapy for social anxiety disorder: A development pilot series. Behavioural and Cognitive Psychotherapy, 41, 383397. doi:https://doi.org/10.1017/s1352465813000404CrossRefGoogle ScholarPubMed
von Consbruch, K., Clark, D. M., & Stangier, U. (2012). Assessing therapeutic competence in cognitive therapy for social phobia: Psychometric properties of the cognitive therapy competence scale for social phobia (CTCS-SP). Behavioural and Cognitive Psychotherapy, 40(2), 149161. doi:https://doi.org/10.1017/s1352465811000622CrossRefGoogle ScholarPubMed
Warnock-Parkes, E., Wild, J., Stott, R., Grey, N., Ehlers, A., & Clark, D. M. (2017). Seeing Is believing: Using video feedback in cognitive therapy for social anxiety disorder. Cognitive and Behavioral Practice, 24(2), 245255. doi:https://doi.org/10.1016/j.cbpra.2016.03.007CrossRefGoogle ScholarPubMed
Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33(4), 448457. doi:https://doi.org/10.1037/h0027806CrossRefGoogle ScholarPubMed
Wild, J., & Clark, D. M. (2011). Imagery rescripting of early traumatic memories in social phobia. Cognitive and Behavioral Practice, 18(4), 433443. doi:https://dx.doi.org/10.1016%2Fj.cbpra.2011.03.002CrossRefGoogle ScholarPubMed
Yoshinaga, N., Matsuki, S., Niitsu, T., Sato, Y., Tanaka, M., Ibuki, H., … Shimizu, E. (2016). Cognitive behavioral therapy for patients with social anxiety disorder who remain symptomatic following antidepressant treatment: A randomized, assessor-blinded, controlled trial. Psychotherapy and Psychosomatics, 85(4), 208217. doi:https://doi.org/10.1159/000444221CrossRefGoogle ScholarPubMed
Zalaznik, D., Strauss, A. Y., Halaj, A., Barzilay, S., Fradkin, I., Katz, B. A., … Huppert, J. D. (2021). Patient alliance with the program predicts treatment outcomes whereas alliance with the therapist predicts adherence in internet-based therapy for panic disorder. Psychotherapy Research, 31(8), 10221035. doi:https://doi.org/10.1080/10503307.2021.1882712CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. Flow chart of patients' progress through the trial.

Figure 1

Table 1. Comparisons between the treatments and the wait list control group on the primary outcome and the process composite

Figure 2

Table 2. Behaviour Test: comparisons between the treatments and wait-list control condition

Figure 3

Table 3. Comparisons between internet (iCT) and standard face-to-face treatment (CT) on primary outcome, process composite and secondary outcomes

Figure 4

Table 4. Recovery rates (loss of diagnosis and IAPT criteria)

Figure 5

Fig. 2. Means and standard errors for weekly Liebowitz Social Anxiety Scale (LSAS) plotted against cumulating therapist time.

Figure 6

Table 5. Mediation analysis

Supplementary material: File

Clark et al. supplementary material

Tables S1-S5

Download Clark et al. supplementary material(File)
File 46 KB