Hostname: page-component-848d4c4894-8bljj Total loading time: 0 Render date: 2024-06-29T14:20:19.011Z Has data issue: false hasContentIssue false

Recover recovery style from psychosis: a psychometric evaluation of the German version of the Recovery Style Questionnaire (RSQ)

Published online by Cambridge University Press:  11 September 2018

M. Gruber
Affiliation:
Division of Social Psychiatry, Department of Psychiatry and Psychotherapy, Medical University of Vienna, Austria
T. Rumpold
Affiliation:
Division of Social Psychiatry, Department of Psychiatry and Psychotherapy, Medical University of Vienna, Austria Department of Radiation Oncology, Comprehensive Cancer Center Medical University of Vienna, Waehringer Straße 18-20, 1090 Vienna, Austria
B. Schrank
Affiliation:
Department of Adult Psychiatry, Karl Landsteiner University of Health Sciences, University Clinic Tulln, Austria
I. Sibitz
Affiliation:
Division of Social Psychiatry, Department of Psychiatry and Psychotherapy, Medical University of Vienna, Austria Department of Radiation Oncology, Comprehensive Cancer Center Medical University of Vienna, Waehringer Straße 18-20, 1090 Vienna, Austria Department of Adult Psychiatry, Karl Landsteiner University of Health Sciences, University Clinic Tulln, Austria Institute of Psychology, University of Vienna, Austria
B. Otzelberger
Affiliation:
Institute of Psychology, University of Vienna, Austria
R. Jahn
Affiliation:
Division of Social Psychiatry, Department of Psychiatry and Psychotherapy, Medical University of Vienna, Austria
M. Amering
Affiliation:
Division of Social Psychiatry, Department of Psychiatry and Psychotherapy, Medical University of Vienna, Austria
A. Unger*
Affiliation:
Division of Social Psychiatry, Department of Psychiatry and Psychotherapy, Medical University of Vienna, Austria
*
Author for correspondence: Annemarie Unger, E-mail: annemarie.unger@meduniwien.ac.at
Rights & Permissions [Opens in a new window]

Abstract

Aims

The way an individual handles the experience of psychosis, the so-called ‘recovery style’, has been shown to substantially affect long-term outcomes. The Recovery Style Questionnaire (RSQ) measures this psychological dimension. The aim of this study was to provide a validation of the German version of the RSQ and to raise awareness for recovery-oriented approaches.

Methods

The RSQ was translated into German according to the guidelines of the WHO and patients were administered this questionnaire and measures of internalised stigma, psychotic symptoms, illness concept, empowerment, self-esteem and quality of life. Descriptive statistics were demonstrated to characterise the sample. Reliability was assessed in different forms: internal consistency, test–retest reliability and split-half reliability. Items were evaluated with descriptive data and item-total correlations. Convergent and discriminant validity were shown, and a confirmatory factor analysis was performed. In order to ameliorate the model, a post hoc model modification was done.

Results

The sample consisted of 138 patients diagnosed with schizophrenia spectrum disorders (mean age: 35.7 years; 53.6% men; mean duration of illness: 20.6 years) with a mean RSQ overall percentage of 66.12 (s.d. ± 17.43%), mainly representing the categories ‘mixed picture’ and ‘tends towards integration’. The reliability of the RSQ was acceptable with a Cronbach's α of 0.741 and a test–retest coefficient of 0.502. Item-total correlations were not acceptable for 27 of 39 items. Moderate evidence for convergent validity of the RSQ was found. Confirmatory factor analysis revealed that the 13-factor model with 39 items originally proposed was partially poorly replicated in the present sample (χ2 ratio to degrees of freedom (χ2/df) of 1.732, Comparative Fit Index (CFI) of 0.585, Normed Fit Index (NFI) of 0.414, Tucker–Lewis Index (TLI) of 0.508, root mean square error of approximation (RMSEA) of 0.095). The RSQ was modified based on item-total correlations and path coefficients of the single items. The confirmatory factor analysis of the resulting one-factor model with 11 items showed adequate fit to the data (χ2/df of 1.562, CFI of 0.936, NFI of 0.847, TLI of 0.910, RMSEA of 0.083) and demonstrated good model fit.

Conclusions

Despite partially insufficient psychometric data of the original RSQ, the concept of recovery style is beneficial to psychiatric research and clinical practice. The underlying idea is valuable, and the questionnaire needs further development. Therefore, a short version of the RSQ is proposed.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s) 2018

Introduction

A lot of recent research efforts have been devoted to prodromal and first-episode symptoms of schizophrenia spectrum disorders; however, the long-term outcome and handling of these complex disorders also deserve attention. Recovery from schizophrenia is possible and approximately 40% of individuals affected have positive outcomes in occupational and social domains (Jääskeläinen et al., Reference Jääskeläinen, Juola, Hirvonen, McGrath, Saha, Isohanni, Veijola and Miettunen2013). Although the associated stigma has not subsided sufficiently from society or the health care system, the concept of recovery from schizophrenia has evolved and is finding growing acceptance (Slade et al., Reference Slade, Leamy, Bacon, Janosik, Le Boutillier, Williams and Bird2012; Norman et al., Reference Norman, Li, Sorrentino, Hampson and Ye2017). Recovery-oriented approaches have been recognised as best suited for psychiatric rehabilitation in severe mental disorders (Xu et al., Reference Xu, Lay, Oexle, Drack, Bleiker, Lengler, Blank, Müller, Mayer, Rössler and Rüsch2018).

The concept of recovery style provides an important approach to understand how individuals handle psychosis (Espinosa et al., Reference Espinosa, Valiente, Rigabert and Song2016). It has been proposed that people recovering from psychosis adopt one of two distinct recovery styles: either they ‘seal-over’ by avoiding the psychotic experience, not seeing it as a part of themselves or they ‘integrate’ by incorporating the psychotic episode into their identity (McGlashan et al., Reference McGlashan, Docherty and Siris1976; Reference McGlashan, Wadeson, Carpenter and Levy1977). Recovery style has been demonstrated to influence treatment engagement and illness status (Tait et al., Reference Tait, Birchwood and Trower2003).

‘Sealing-over’ recovery style is associated with insecure identity and little resilience (Drayton et al., Reference Drayton, Birchwood and Trower1998; Tait et al., Reference Tait, Birchwood and Trower2004). These individuals more often have negative experiences in early attachment as well as current social difficulties. This might explain why these patients seek less contact with services and have a higher rate of involuntary measures (Tait et al., Reference Tait, Birchwood and Trower2004; O'Donoghue et al., Reference O'Donoghue, Lyne, Hill, O'Rourke, Daly, Larkin and O'Callaghan2011). A weaker therapeutic alliance was observed to be more frequent in patients with a sealing-over recovery style (Cavelti et al., Reference Cavelti, Homan and Vauth2016). ‘Sealing-over’ recovery style was also associated with more predominant negative symptoms and more overall illness severity. Higher levels of thought disorders may interfere with the patient's capability to understand experiences and predicted rather avoidant coping strategies (Cavelti et al., Reference Cavelti, Homan and Vauth2016).

‘Integration’ is the more favourable recovery style. In presence of the same severity of illness, an integrative recovery style may indicate higher service engagement (Tait et al., Reference Tait, Birchwood and Trower2003; Vender et al., Reference Vender, Poloni, Aletti, Bonalumi and Callegari2014). In patients with severe mental illness in community services and long-term secure services, not recovery style but insight directly influenced the type of treatment service. However, insight was closely related to recovery style (Fitzgerald, Reference Fitzgerald2010). A moderator role of recovery style between internalised stigma and emotional distress was found in people with persecutory delusions. People with ‘integration’ recovery styles, even if feeling stigmatised, tend to be more resilient to depression (Espinosa et al., Reference Espinosa, Valiente, Rigabert and Song2016). Nevertheless, in individuals with recent onset of psychosis and post-traumatic stress disorder syndrome, a trend towards an integrative coping style was found (Mueser et al., Reference Mueser, Lu, Rosenberg and Wolfe2010).

To identify these distinct recovery styles, two instruments have been developed for research purposes and clinical use. The ‘Integration Sealing over Scale’ (ISOS, McGlashan, Reference McGlashan1987) is an extensive semi-structured clinical interview requiring rating by a clinician. The ‘Recovery Style Questionnaire’ (RSQ; Drayton et al., Reference Drayton, Birchwood and Trower1998) has been developed as a short self-report version of the ISOS. Initial psychometric evaluation of the RSQ by the developers showed good internal consistency, test–retest reliability, face- and criterion-related validity with the ISOS (Drayton et al., Reference Drayton, Birchwood and Trower1998). Sound psychometric parameters were also reported by others (Modestin et al., Reference Modestin, Caveng, Wehrli and Malti2009; Poloni et al., Reference Poloni, Callegari, Buzzi, Aletti, Beranzini, Vecchi and Vender2010; Nasillo et al., Reference Nasillo, Santos, Arrufat and Obiol2013).

However, efforts of further scale validation have been scarce (Cavelti et al., Reference Cavelti, Kvrgic, Beck, Kossowsky and Vauth2012) and a factorial validity assessment of the RSQ has so far never been conducted to the best of our knowledge (Grinter, Reference Grinter2012). Furthermore, a German instrument to measure recovery style in psychosis is needed. Therefore, the aim of this study was to psychometrically re-evaluate the RSQ during the process of developing a German version of the questionnaire.

Methods

Participants

The participants were recruited from psychiatric inpatient and outpatient treatment units. Patients included were (a) aged between 18 and 65, (b) had a diagnosis of a schizophrenia spectrum disorder according to ICD-10, (c) gave written informed consent and (d) able to understand the German language sufficiently. Exclusion criteria were (a) severe cognitive impairment with serious impairment or inability to communicate, (b) seriously impaired judgement and reality testing as in the case of an acute psychotic episode.

Procedures

Data were collected at the Department of Psychiatry and Psychotherapy at the Medical University of Vienna and a collaborating public mental health centre in Vienna. Recruitment was done by psychiatric residents or psychiatric consultants. Patients received detailed information about the study and were able to ask questions concerning the project. Those willing to participate signed informed consent. The presence of psychotic symptoms and medical data were asked for, and the questionnaires mentioned below were administered.

Instrument

The RSQ (Drayton et al., Reference Drayton, Birchwood and Trower1998, see Table 1) consists of 39 items divided into 13 subscales each comprising three separate questions (see Table 2). The patient rates each item with either ‘agree’ or ‘disagree’. Using a coding frame, each answer is identified as either ‘sealing-over’ (1 point) or ‘integration’ (2 points). Each of the 13 subscales is rated separately (3–4 points ‘sealing-over’ and 5–6 points ‘integration’) and finally a formula is used to calculate the overall percentage of integration: (RSQ overall percentage = number of scales with overall rating of integration/13 × 100%). From the RSQ overall percentage, the following categories are built: 0–17% = 6 sealing-over, 18–33% = 5 tends towards sealing-over, 34–49% = 4 mixed picture, sealing-over predominates, 50–67% = 3 mixed picture, integration predominates, 68–82% = 2 tends towards integration, 84–100% = 1 integration. The initial scale development paper (Drayton et al., Reference Drayton, Birchwood and Trower1998) reported good psychometric properties with Cronbach's α of 0.73, test–retest reliability of 0.81 and suggested two recovery styles (i.e. sealing-over and integration) composed of 13 factors, without reporting a factor analysis.

Table 1. Items of the Recovery Style Questionnaire with valid answers (n) and item-total correlation r it

a Inverted items, bold: item-total correlation ⩾0.20, items selected via model modification after confirmatory factor analysis.

Table 2. Definitions of domains of the Recovery Style Questionnaire and Cronbach's α values

a Poor but acceptable Cronbach's α ⩾ 0.5.

b Good Cronbach's α ⩾ 0.7.

Translation and back translation

The RSQ was translated into German according to the guidelines of the WHO (Sartorius and Janca, Reference Sartorius and Janca1996). One of the authors (A.U.) is a German and English native speaker and works as a psychiatrist. She translated the English original version into German and then an English back-translation was done by a German–English professional translator. The English back-translation was reviewed and checked for consistency by one of the authors of the original English version (M.B.; Drayton et al., Reference Drayton, Birchwood and Trower1998).

Validation

As recommended by Guadonoli and Velicer (Reference Guadagnoli and Velicer1988) and Costello and Osborne (Reference Costello and Osborne2005), about 150 cases were planned to be appropriate when performing a factor analysis on the 39-item RSQ. The correlation coefficient should become an adequate estimator of the population correlation coefficient when sample sizes reach this level. To establish test–retest reliability with a power of 0.80 and an α of 0.05, assuming that at least 10% of the sample agrees with the item and considering the possibility that occasionally items might be missing, we found a sample of 30 patients to be suitable to fill out the questionnaire again after a couple of weeks. For the assessment of convergent and discriminant validity, other instruments with related or distinguishing constructs were administered. The Internalised Stigma of Mental Illness inventory (ISMI) (Ritsher et al., Reference Ritsher, Otilingam and Grajales2003; German Version: Sibitz et al., Reference Sibitz, Friedrich, Unger, Bachmann, Benesch and Amering2013) was developed to measure internalised stigma. The 27-item scale consists of the subscales alienation, discrimination experience, social withdrawal, stereotype endorsement and resistance. The German version of the ISMI showed good psychometric properties (Sibitz et al., Reference Sibitz, Friedrich, Unger, Bachmann, Benesch and Amering2013). The well-established Positive and Negative Syndrome Scale (PANSS) (Kay et al., Reference Kay, Fiszbein and Opler1987) was used. The Illness Concept Scale (KK-Scale) (Linden et al., Reference Linden, Nather and Wilms1988) is a German questionnaire, also named ‘Krankheitskonzept Skala’ (KK-Scale). It consists of 29 items and was designed for schizophrenic patients. The scale assesses patients’ illness-related attitudes. Chronbach's α and retest–test reliability were moderate (Linden et al., Reference Linden, Nather and Wilms1988). The 28-item Rogers Empowerment Scale (Rogers et al., Reference Rogers, Chamberlin, Ellison and Crean1997) measures empowerment in five different dimensions: self-esteem and self-determination, power v. feeling powerless, autonomy, optimism and control over the future, justified anger. The scale demonstrated excellent reliability and validity in large samples (Rogers et al., Reference Rogers, Ralph and Salzer2010). The revised version of the self-esteem scale by Rosenberg (Reference Rosenberg1965) is a ten-item self-rating instrument measuring positive and negative feelings about the self. It has been validated in German language and showed good psychometric properties (Von-Collani and Herzberg, Reference Von-Collani and Herzberg2003). The well-established WHOQOL-BREF is a 26-item short version of the WHOQOL-100 instrument with satisfactory internal consistency (WHO, 1996). It entails the dimensions physical well-being, psychological well-being, social relations and the environment.

Statistical analysis

The statistical analysis was calculated using the software packages SPSS® 24 and AMOS® 24. Descriptive statistics are presented in absolute numbers and percentages. Internal consistency of the RSQ was calculated and corrected for dichotomous variables by the Kuder–Richardson Formula 20 (Kuder and Richardson, Reference Kuder and Richardson1937). A Cronbach's α coefficient >0.70 was considered acceptable. Pearson correlation coefficient was used to evaluate test–retest reliability. Additionally, split-half reliability was calculated with the Spearman–Brown coefficient. The convergent and discriminant validity were examined with correlational analyses of the RSQ overall percentage score with other constructs.

A confirmatory factor analysis was performed to test the fit of our data to a 13-factor model deriving from the original 13-subscale structure of the English RSQ with 39 dichotomous items (Drayton et al., Reference Drayton, Birchwood and Trower1998). The acceptability of the model was judged by following recommended standards: χ 2 ratio to degrees of freedom (χ 2/df) < 2.00, Comparative Fit Index (CFI), Normed Fit Index (NFI) and Tucker–Lewis Index (TLI) > 0.90 and the root mean square error of approximation (RMSEA) values of 0.06 or less for a good fit and 0.08 or less for a reasonable fit (Bentler, Reference Bentler1990; Backhaus et al., Reference Backhaus, Erichson, Plinke and Weiber2006; Schreiber, Reference Schreiber2008; Moosbrugger and Kelava, Reference Moosbrugger and Kelava2012). To compute fit indices in the CFA, estimates of standardised regression weights were used because the weight gives information about the implication that each item should preferably have. They can be interpreted like effect sizes following the effect size classification by Cohen (Reference Cohen1988).

Results

Sample characteristics

Of 251 persons approached, 94 declined to participate, 16 dropped out because they did not meet the inclusion criteria and three patients did not complete the RSQ. The study sample comprised 138 participants, 56 of them missed at least one RSQ item. Therefore, only 82 cases could be included into some of the calculations (e.g. internal consistency). In Table 3, socio-demographic and illness-related data of the sample are shown. Overall, 74 men (53.6%) and 64 women (46.4%) aged between 19 and 69 years (M 36.4, s.d. ± 11.3) were included. Ninety-one persons (65.9%) were diagnosed with paranoid schizophrenia (WHO, 1993) (ICD-10: F20.0), three (2.2%) with hebephrenic schizophrenia (ICD-10: F20.1), one (0.7%) with undifferentiated schizophrenia (ICD-10: F20.3), three (2.2%) with residual schizophrenia (ICD-10: F20.5), four (2.9%) with schizotypal disorder (ICD-10: F21), three (2.2%) with persistent delusional disorder (ICD-10: F22), two (1.5%) with acute polymorphic psychotic disorders (ICD-10: F23.1) and 31 (22.5%) with schizoaffective disorder (ICD-10: F25). Most participants had been suffering from a psychosis of the schizophrenic spectrum for several years (M 15.1, s.d. ± 15). The patients were moderately to severely ill (PANSS M 72.9, s.d. ± 12.6) and demographic characteristics reflected the typical adverse effects of this illness: 110 participants were unmarried (79.7%) and more than half (n = 52, 52.9%) lived alone. Nearly half of all participants (n = 65, 47.1%) received invalidity pension and only three people had a paid work.

Table 3. Socio-demographic and illness-related data

Standard deviation s.d.

Out of 138 participants, the mean RSQ overall percentage of integration in our sample was 66.12% (s.d. ± 17.43), representing the category ‘mixed picture, integration predominates’. The majority of participants showed either a ‘mixed picture where integration predominates’ (n = 38, 27.0%), ‘tends towards integration’ (n = 46, 32.6%) or ‘integration’ (n = 28, 19.9%). Few participants showed either ‘mixed picture where sealing-over predominates’ (n = 21, 14.9%), ‘tend towards seal-over’ (n = 4, 2.8%) or ‘sealing-over’ (n = 1, 0.7%) (see Fig. 1).

Fig. 1. Distribution of recovery styles, percentages with standard errors, N = 138.

Reliability

Eighty-two questionnaires with no missing items were included for internal consistency. An acceptable Cronbach's α of 0.741 was achieved. Most of the subscales performed below an acceptable range (see Table 1). The test–retest coefficient for the RSQ overall per cent scores (n = 24) was r = 0.502 for 52.17 days with a significance of p = 0.01 (two-tailed). The split-half reliability for the 39 RSQ items yielded a Spearman–Brown coefficient of 0.686 with n = 82.

Descriptive statistical evaluation of items

The RSQ consists of 39 items, 17 items were inverted during questionnaire development (Drayton et al., Reference Drayton, Birchwood and Trower1998). Table 1 shows the formulation of each individual item. It was found that the proportion of integrative answers is lower for items with negative formulations. The 17 negatively poled items were answered by 38.0% of the participants with integrative patterns, while the 22 positively poled items of 65.8% were given an integrative answer. Respondents rejected items like item 23, ‘My illness has had little effect on my life’ or item 4 ‘I am not interested in my illness’. In addition, separation powers were calculated for the individual items (see Table 1). The power of separation indicates how well a single item distinguishes persons with a ‘sealing-over’ and an ‘integrative recovery style’. Corrected separations r it of ⩽0.20 were considered too low. Only 22 items showed satisfactory values. For example, item 19, ‘I can manage the problems caused by my illness, alone’ was not clearly distinguishable between the two types of recovery styles.

Convergent and discriminant validity

The convergent and discriminant validity were examined with correlations of the RSQ overall percentage score with other constructs. The RSQ was positively correlated with psychological quality of life (r = 0.323; p < 0.01) and showed an overlap with following concepts: resistance on the internalised stigma scale (r = 0.389; p < 0.01), empowerment (r = 0.422; p < 0.01) and specifically optimism on the empowerment scale (r = 0.428; p < 0.01). There was a positive relationship between the recovery style and the construct of self-esteem, on the self-esteem scale (r = 0.324; p < 0.01) and self-esteem on the empowerment scale (0.381; p < 0.01). A negative association of the RSQ with alienation on the internalised stigma scale was found (−0.309; p < 0.01) (see Table 4).

Table 4. Correlation of the RSQ overall percentage with different scales, (n = 92, listwise)

a Values under 0.01 were considered highly significant.

b Values under 0.05 were considered significant.

Confirmatory factor analysis

The results of the confirmatory factor analysis are displayed in Supplementary Table 1. The χ 2 test was significant (p < 0.001, χ 2 = 1080.604, 624 df) and the χ 2/df of 1.732 demonstrated good model fit, but other indices showed poor model fit with CFI of 0.586, NFI of 0.414 and a TLI of 0.508. The RMSEA of 0.095 indicated reasonable model fit.

Model modification

The fit to the proposed model was partially poor. In order to ameliorate the model, a post hoc model modification was done. It is good practice to assess the fit of each construct and its items individually to determine particularly weak items. Items with low corrected item total correlations (r it ⩽ 0.20, see Table 1 and Supplementary Table 2) indicate very high levels of error. These items were removed from the model step by step (Hooper et al., Reference Hooper, Coughlan and Mullen2008). Path coefficients for each item derived from the CFA were also comparable with the results of the item-total correlations (see Supplementary Table S1 and Supplementary Fig. S1). Model modification revealed a one-factor model consisting of 11 items with acceptable fit to the data (see Fig. 2; Supplementary Table S2). χ 2/df of 1.562 and CFI of 0.936, NFI of 0.847 and a TLI of 0.910 demonstrated good model fit. The RMSEA of 0.083 indicated reasonable but better model fit. The remaining items with the best parameters were marked in bold in Table 1.

Fig. 2. Path diagram of the confirmatory factor analysis of an alternative one-factor model (11 items) with observed and latent variables, left number of rectangle refers to the number of subscale and right number indicates item number; n = 82.

Discussion

The aim of the present study was the validation of the RSQ. Overall, the reliability of the RSQ scale was acceptable. Confirmatory factor analysis revealed that the 13-factor model originally proposed was not replicated in the present sample. The RSQ was modified based on item-total correlations and path coefficients, the confirmatory factor analysis of the resulting model showed adequate fit to the data.

Internal consistency of the RSQ showed an acceptable value at Cronbach's α = 0.741, similar to the original paper where internal consistency was α = 0.73 and other validation papers reporting values from α = 0.73 (Poloni et al., Reference Poloni, Callegari, Buzzi, Aletti, Beranzini, Vecchi and Vender2010) to α = 0.78 (Modestin et al., Reference Modestin, Caveng, Wehrli and Malti2009; Grinter, Reference Grinter2012). However, the internal consistency of most of the subscales was below an acceptable value, which could be expected because each subscale consists only of three items. The test–retest reliability was moderate with a correlation of r = 0.502 which translates to only about half of all responses being identical when asked again a second time after a couple of weeks. A previous study has also reported a test–retest reliability correlation coefficient of r = 0.50 for the RSQ (Poloni et al., Reference Poloni, Callegari, Buzzi, Aletti, Beranzini, Vecchi and Vender2010), whereas the test–retest reliability for 1 month of the original validation was r = 0.81 (Drayton et al., Reference Drayton, Birchwood and Trower1998).

The sample size of 56 participants in the original study was small with a low proportion of female participants (26.8%) (Drayton et al., Reference Drayton, Birchwood and Trower1998). In comparison, our study included 138 participants with a balanced gender distribution. In the original paper, only people diagnosed with schizophrenia according to ICD-10 criteria were included. The present sample consisted of a broader diagnostic spectrum with 65.9% diagnosed with paranoid schizophrenia, 2.2% with hebephrenic schizophrenia, 0.7% with undifferentiated schizophrenia, 2.2% with residual schizophrenia, 2.9% with schizotypal disorder, 2.2% with persistent delusional disorder, 1.5% with acute polymorphic psychotic disorders and 22.5% with schizoaffective disorder. The age at onset of illness and the duration of illness were quite similar in both studies but the number of admissions was higher in our investigation with 5.9 hospital stays on average compared with three admissions in the original paper. The present sample was moderately to markedly ill with a mean PANSS score of 72.9 (s.d. 12.6) (Leucht et al., Reference Leucht2014). Therefore, the larger sample with a broader range but more severe disorders could have influenced the results.

In summary, the confirmatory factor analysis performed on our data yielded a poor-to-moderate model fit to the original 13-subscale structure with 39 items of the RSQ (Drayton et al., Reference Drayton, Birchwood and Trower1998). To our knowledge, this is the first study to examine the factor structure of the RSQ by means of factor analysis. In the original paper by Drayton (Reference Drayton, Birchwood and Trower1998), no factor analysis was conducted. The basis for the formation of 13 subscales was the ISOS (McGlashan et al., Reference McGlashan, Docherty and Siris1976), an observer report measure requiring the interviewer to assess the patient over 13 concepts pertaining to illness-related attitudes. The RSQ was designed as a short self-report assessment with three questions assigned to each concept presented in the ISOS and therefore a face validity with the ISOS was stated. The criterion-related validity with the ISOS was good achieving similar results for the RSQ (r = 0.92; Drayton et al., Reference Drayton, Birchwood and Trower1998). However, most subscales did perform below an acceptable reliability. The evaluation of the questionnaire is not based on a sum score of the 39 items. Each subscale consisting of three items is rated separately and an overall percentage is calculated which refers to an either integrative or sealing-over recovery style. The 13-scubscale structure did disappoint and this might distort the results. Furthermore, 17 out of 39 items showed disappointing separation power. It seemed that more than a third of negatively worded questions (17 items) were more likely to be answered in a non-integrative pattern. Reversing a proportion of items is often used to reduce the effects of response styles by changing the direction of the item. Although this is an established practice, there is no consensus about its effectiveness (van Sonderen et al., Reference Van Sonderen, Sanderman and Coyne2013). Ebesutani et al. (Reference Ebesutani, Drescher, Reise, Heiden, Hight, Damon and Young2012) found that non-reverse-worded items were associated with superior psychometric properties relative to the reverse-worded items. Often it makes questions more complex and more difficult to understand. Questions like RSQ item 2 ‘My illness is not a part of my personality’ or item 4 ‘I am not interested in my illness’ may not be well read and understood by respondents. Especially patients suffering from schizophrenia for years often have impaired cognitive functioning with thought disorders. They may lack sufficient attention to carefully read and understand the questions, this might influence the truth of the given answers. In contrast, the dichotomous answer format of the RSQ may be beneficial for this patient group due to a dichotomous thinking style often found in patients with psychotic disorders (Peters et al., Reference Peters, Moritz, Schwannauer, Wiseman, Greenwood, Scott, Beck, Donaldson, Hagen, Ross, Veckenstedt, Ison, Williams, Kuipers and Garety2014).

The concept of recovery style was related to the construct of resistance to internalised stigma measured with the ISMI (Ritsher et al., Reference Ritsher, Otilingam and Grajales2003). This is consistent with recent findings where recovery style was shown to have a moderator role between internalised stigma and depression in people with persecutory delusions (Espinosa et al., Reference Espinosa, Valiente, Rigabert and Song2016). Recovery style was also found to overlap with the concept of empowerment and optimism. Recovery style provides an important approach to understand how individuals handle psychosis in a psychological dimension. The RSQ is continued to be used in recovery-oriented research (Modestin et al., Reference Modestin, Caveng, Wehrli and Malti2009; O'Donoghue et al., Reference O'Donoghue, Lyne, Hill, O'Rourke, Daly, Larkin and O'Callaghan2011; Vender et al., Reference Vender, Poloni, Aletti, Bonalumi and Callegari2014; Espinosa et al., Reference Espinosa, Valiente, Rigabert and Song2016) and clinical practice. The ISOS, which is essentially the same construct, is still applied, too (Modestin et al., Reference Modestin, Caveng, Wehrli and Malti2009; Cavelti et al., Reference Cavelti, Homan and Vauth2016). Recovery style has been shown to affect symptoms, treatment and outcome in schizophrenia (McGlashan et al., Reference McGlashan1987; Modestin et al., Reference Modestin, Soult and Malti2004; Reference Modestin, Caveng, Wehrli and Malti2009; Cavelti et al., Reference Cavelti, Homan and Vauth2016).

Strengths and limitations

The study provides a comprehensive and independent psychometric evaluation of the RSQ. To the authors’ knowledge, it is the first study to investigate the factor structure of the RSQ and to compare the underlying construct with an independent concept of stigma internalisation (ISMI). Although the sample size of the present study is relatively small, it is acceptable for factor analytical procedures and it is so far the largest sample to investigate psychometric properties of the RSQ. The composition of the present sample could be a limitation. Patients were in part recruited at an outpatient clinic where mainly patients with a chronic progression of schizophrenia are often repeatedly treated on a rather long-term basis over years. These patients are usually very advanced in their expertise about psychotic experiences and are, in the majority of cases, stabilised due to the extensive treatment and support. This limits the examined population to those who were in treatment at the time of assessment, and it is not known how results might have differed in a ‘real-world’ population of those who are partly out of treatment or completely on their own without support. The influence of duration of illness on recovery style is unclear and further studies are warranted to determine how transition from sealing-over to integration can best be promoted.

Conclusions

The use of the RSQ in clinical practice might be inspiring and helpful, especially for treatment planning. The RSQ does cover several topics that are clinically relevant, with items such as ‘I have a medical illness’ and ‘My illness had a strong impact on my life’ insight and the impact the illness has on patients’ lives is reflected. Yet, addressing and discussing topics such as showing interest in one's illness, believing in one's influence on the course of the illness and accepting help and support within the therapeutic relationship might facilitate the acceptance of the illness and further the recovery process. The use of the RSQ in mental health practice might provide the therapist and the patient with an indication of areas in need of enhanced therapeutic discussion and support. First, the RSQ can be a helpful tool for measuring the integration of the recovery concept on the consumer side. Second, identifying patients with sealing-over recovery styles might enable professionals to provide more intensive support to those at risk for poorer service engagement. Anyway, considering the results of the present study pointing to statistical and conceptual shortcomings, the RSQ cannot be recommended for use in recovery-oriented research in its original version (Drayton e t al., Reference Drayton, Birchwood and Trower1998). Therefore, a short version with better psychometric properties is proposed for research use but further scale validation is needed.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S2045796018000471

Acknowledgements

The authors acknowledge the assistance and help of all people who contributed to the study.

Financial support

This research received a grant from Jubiläumsfonds of the Austrian National Bank (ÖNB – Österreichische Nationalbank) project number 12034.

Conflict of interest

None.

Ethical standards

The study was approved by the ethics committee of the Medical University of Vienna (Nr. 455/2005). The authors assert that all procedures contributing to this work comply with the ethical standards of the committee of the Medical University of Vienna in accordance with the Helsinki Declaration of 1975, as revised in 2008.

Availability of data and materials

The data that support the findings of this study are available for qualified researchers from, but restrictions for academic and not-commercial use apply to the availability of these data. Data are however available from upon reasonable request.

Footnotes

Deceased.

References

Backhaus, K, Erichson, B, Plinke, W and Weiber, R (2006) [Multivariate Analysis Methods. An Application-Oriented Introduction], Berlin: Springer.Google Scholar
Bentler, PM (1990) Comparative fit indexes in structural models. Psychological bulletin 107, 238246.Google Scholar
Cavelti, M, Kvrgic, S, Beck, EM, Kossowsky, J and Vauth, R (2012) Assessing recovery from schizophrenia as an individual process. A review of self-report instruments. European Psychiatry 27, 1932.Google Scholar
Cavelti, M, Homan, P and Vauth, R (2016) The impact of thought disorders on therapeutic alliance and personal recovery in schizophrenia and schizoaffective disorder: an exploratory study. Psychiatry Research 239, 9298.Google Scholar
Cohen, J (1988) Statistical Power Analysis for the Behavioral Sciences. 2nd Edn. Hillsdale, NJ: Erlbaum.Google Scholar
Costello, AB and Osborne, JW (2005) Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation 10, 19.Google Scholar
Drayton, M, Birchwood, M and Trower, P (1998) Early attachment experience and recovery from psychosis. British Journal of Clinical Psychology 37, 269284.Google Scholar
Ebesutani, C, Drescher, CF, Reise, SP, Heiden, L, Hight, TL, Damon, JD and Young, J (2012) The loneliness questionnaire-short version: an evaluation of reverse-worded and non-reverse-worded items via item response theory. Journal of Personality Assessment 94, 427437.Google Scholar
Espinosa, R, Valiente, C, Rigabert, A and Song, H (2016) Recovery style and stigma in psychosis the healing power of integration. Cognitive Neuropsychiatry 21, 146155.Google Scholar
Fitzgerald, MM (2010) Comparison of recovery style and insight of patients with severe mental illness in secure services with those in community services. Journal of Psychiatric and Mental Health Nursing 17, 229235.Google Scholar
Grinter, DJ (2012) Non-engagement in psychosis: a narrative analysis of service-users’ experiences of relationships with mental health services. (Clinical Psychology thesis). University of Glasgow.Google Scholar
Guadagnoli, E and Velicer, WF (1988) Relation of sample size to the stability of component patterns. Psychological bulletin 103, 265275.Google Scholar
Hooper, D, Coughlan, J and Mullen, MR (2008) Structural equation modelling: guidelines for determining model Fit. Electronic Journal of Business Research Methods 6, 5360.Google Scholar
Jääskeläinen, E, Juola, P, Hirvonen, N, McGrath, JJ, Saha, S, Isohanni, M, Veijola, J and Miettunen, J (2013) A systematic review and meta-analysis of recovery in schizophrenia. Schizophrenia Bulletin 39, 12961306.Google Scholar
Kay, SR, Fiszbein, A and Opler, LA (1987) The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia Bulletin 13, 261276.Google Scholar
Kuder, GF and Richardson, MW (1937) The theory of the estimation of test reliability. Psychometrika 2, 151160.Google Scholar
Leucht, S (2014) Measurements of response, remission, and recovery in schizophrenia and examples for their clinical application. The Journal of Clinical Psychiatry 75, 814.Google Scholar
Linden, M, Nather, J and Wilms, HU (1988) [Definition, significance and measurement of disease concepts of patients. The disease concept scale for schizophrenic patients]. [Article in German] Fortschritte der Neurologie und Psychiatrie 56, 3543.Google Scholar
McGlashan, TH, Docherty, JP and Siris, S (1976) Integrative and sealing-over recoveries form schizophrenia: distinguishing case studies. Psychiatry 39, 325338.Google Scholar
McGlashan, TH, Wadeson, HS, Carpenter, WT Jr and Levy, ST (1977) Art and recovery style from psychosis. Journal of Nervous and Mental Disorders 164, 182190.Google Scholar
McGlashan, TH (1987) Recovery style from mental illness and long-term outcome. Journal of Nervous and Mental Disorders 175, 681685.Google Scholar
Modestin, J, Soult, J and Malti, T (2004) Correlates of coping styles in psychotic illness. Psychopathology 37, 175180.Google Scholar
Modestin, J, Caveng, I, Wehrli, MV and Malti, T (2009) Correlates of coping styles in psychotic illness – an extension study. Psychiatry Research 168, 5056.Google Scholar
Moosbrugger, H and Kelava, A (2012) Testtheorie und Fragebogenkonstruktion. Berlin, Heidelberg: Springer-Verlag.Google Scholar
Mueser, KT, Lu, W, Rosenberg, SD and Wolfe, R (2010) The trauma of psychosis: posttraumatic stress disorder and recent onset of psychosis. Schizophrenia Research 116, 217227.Google Scholar
Nasillo, V, Santos, JM, Arrufat, F and Obiol, J (2013) Translation and adaptation of the Recovery Style Questionnaire into Spanish. Interpsiquis. 14th Virtual Psiquiatria.com Congress [unpublished] from: Lemos-Giráldez S, Garcia-Alvarez L, Paino M, … Andresen R (2015) . Measuring stages of recovery from psychosis. Comprehensive Psychiatry 56, pp. 5158.Google Scholar
Norman, RMG, Li, Y, Sorrentino, R, Hampson, E and Ye, Y (2017) The differential effects of a focus on symptoms versus recovery in reducing stigma of schizophrenia. Social Psychiatry and Psychiatric Epidemiology 52, 13851394.Google Scholar
O'Donoghue, B, Lyne, J, Hill, M, O'Rourke, L, Daly, S and Larkin, CO'Callaghan, E (2011) Perceptions of involuntary admission and risk of subsequent readmission at one-year follow-up: the influence of insight and recovery style. Journal of Mental Health 20, 249259.Google Scholar
Peters, E, Moritz, S, Schwannauer, M, Wiseman, Z, Greenwood, KE, Scott, J, Beck, AT, Donaldson, C, Hagen, R, Ross, K, Veckenstedt, R, Ison, R, Williams, S, Kuipers, E and Garety, PA (2014) Cognitive biases questionnaire for psychosis. Schizophrenia Bulletin 40, 300313.Google Scholar
Poloni, N, Callegari, C, Buzzi, A, Aletti, F, Beranzini, F, Vecchi, F and Vender, S (2010) [The Italian version of ISOS and RSQ, two suitable scales for investigating recovery style from psychosis] [Article in Italian]. Epidemiologia e Psichiatrica Sociale 19, 352359.Google Scholar
Ritsher, JB, Otilingam, PG and Grajales, M (2003) Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Research 121, 3149.Google Scholar
Rogers, SE, Chamberlin, J, Ellison, ML and Crean, T (1997) A consumer constructed scale to measure empowerment among users of mental health services. Psychiatric Services 48, 10421047.Google Scholar
Rogers, SE, Ralph, RO and Salzer, MS (2010) Validation the empowerment scale with a multisite sample of consumers of mental health services. Psychiatric Services 61, 933936.Google Scholar
Rosenberg, M (1965) Conceiving the Self. New York: Basic books.Google Scholar
Sartorius, N and Janca, A (1996) Psychiatric assessment instruments developed by the World Health Organization. Social Psychiatry and Psychiatric Epidemiology 31, 5569.Google Scholar
Schreiber, JB (2008) Core reporting practices in structural equation modeling. Research in Social and Administrative Pharmacy 4, 8397.Google Scholar
Sibitz, I, Friedrich, ME, Unger, A, Bachmann, A, Benesch, T and Amering, M (2013) [Internalized stigma of Schizophrenia: validation of the German version of the Internalized Stigma of Mental Illness-Scale (ISMI)] [Article in German]. Psychiatrische Praxis 40, 8291.Google Scholar
Slade, M, Leamy, M, Bacon, F, Janosik, M, Le Boutillier, C, Williams, J and Bird, V (2012) Epidemiology and Psychiatric Sciences 21, 353364.Google Scholar
SPSS Inc. Released (2016) SPSS for Windows, Version 24.0. Chicago, SPSS Inc.Google Scholar
Tait, L, Birchwood, M and Trower, P (2003) Predicting engagement with services for psychosis: insight, symptoms and recovery style. British Journal of Psychiatry 182, 123128.Google Scholar
Tait, L, Birchwood, M and Trower, P (2004) Adapting to the challenge of psychosis: personal resilience and the use of sealing-over (avoidant) coping strategies. British Journal of Psychiatry 185, 410415.Google Scholar
Van Sonderen, E, Sanderman, R and Coyne, JC (2013) Ineffectiveness of reverse wording of questionnaire items: let's learn from cows in the rain. PLoS ONE 8, e68967. doi: 10.1371/journal.pone.0068967.Google Scholar
Vender, S, Poloni, N, Aletti, F, Bonalumi, C and Callegari, C (2014) Service engagement: psychopathology, recovery style and treatments. Psychiatry Journal [published online], doi: 10.1155/2014/249852.Google Scholar
Von-Collani, G and Herzberg, PY (2003) Eine revidierte fassung der deutschsprachigen Skala zum Selbstwertgefühl von Rosenberg. Zeitschrift für Differentielle und Diagnostische Psychologie 24, 37.Google Scholar
World Health Organisation (1993) International classification of diseases 10th revision (ICD-10). 2.Auflage. Bern: Huber.Google Scholar
World Health Organization (1996) WHOQOL-BREF Introduction, Administration, Scoring and Generic Version of the Assessment: Field Trial Version. [Last accessed 23.04.2018]. Available at http://www.who.int/iris/handle/10665/63529.Google Scholar
Xu, Z, Lay, B, Oexle, N, Drack, T, Bleiker, M, Lengler, S, Blank, C, Müller, M, Mayer, B, Rössler, W and Rüsch, N (2018) Involuntary psychiatric hospitalisation, stigma stress and recovery: a 2-year stud. Epidemiology and Psychiatric Sciences 31, 18.Google Scholar
Figure 0

Table 1. Items of the Recovery Style Questionnaire with valid answers (n) and item-total correlation rit

Figure 1

Table 2. Definitions of domains of the Recovery Style Questionnaire and Cronbach's α values

Figure 2

Table 3. Socio-demographic and illness-related data

Figure 3

Fig. 1. Distribution of recovery styles, percentages with standard errors, N = 138.

Figure 4

Table 4. Correlation of the RSQ overall percentage with different scales, (n = 92, listwise)

Figure 5

Fig. 2. Path diagram of the confirmatory factor analysis of an alternative one-factor model (11 items) with observed and latent variables, left number of rectangle refers to the number of subscale and right number indicates item number; n = 82.

Supplementary material: File

Gruber et al. supplementary material

Tables S1-S2 and Figure S1

Download Gruber et al. supplementary material(File)
File 22 KB
Supplementary material: File

Gruber et al. supplementary material

Tables S5-S6 and Figure 2

Download Gruber et al. supplementary material(File)
File 17.6 KB