Hostname: page-component-7bb8b95d7b-s9k8s Total loading time: 0 Render date: 2024-09-06T11:15:28.391Z Has data issue: false hasContentIssue false

Use of virtual reality in bipolar disorder: a systematic review

Published online by Cambridge University Press:  04 September 2024

Gonzalo Salazar de Pablo*
Affiliation:
Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK Child and Adolescent Mental Health Services, South London and Maudsley NHS Foundation Trust, London, UK Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón School of Medicine, Universidad Complutense, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), CIBERSAM, Madrid, Spain
Omar Rios Hernandez
Affiliation:
Department of Psychology, Consorcio Hospitalario Provicial de Castellon, Spain Department of Personality, Evaluation and Psychological Treatments, University of Valencia, Spain
Sandra Gómez Vallejo
Affiliation:
Child and Adolescent Psychiatry and Psychology Department, Institute of Neurosciences, Hospital Clínic, Barcelona, Spain
Allan H. Young
Affiliation:
Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK South London and Maudsley NHS Foundation Trust, Bethlem Royal Hospital, Kent, UK
Matteo Cella
Affiliation:
Department of Psychology, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK NIHR Biomedical Research Centre, South London and Maudsley NHS Foundation Trust, London, UK
Lucia Valmaggia
Affiliation:
Department of Psychology, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK Department of Psychiatry, Katholieke Leuven Universitet, Leuven, Belgium Orygen, Centre for Youth Mental Health, The University of Melbourne, Melbourne, Australia
*
Corresponding author: Gonzalo Salazar de Pablo; Email: gonzalo.salazar_de_pablo@kcl.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Virtual reality (VR) is a technology that allows to interact with recreated digital environments and situations with enhanced realism. VR has shown good acceptability and promise in different mental health conditions. No systematic review has evaluated the use of VR in Bipolar Disorder (BD). This PRISMA-compliant systematic review searched PubMed and Web of Science databases (PROSPERO: CRD42023467737) to identify studies conducted in individuals with BD in which VR was used. Results were systematically synthesized around four categories (cognitive and functional evaluation, clinical assessment, response to VR and safety/acceptability). Eleven studies were included (267 individuals, mean age = 36.6 years, 60.7% females). Six studies using VR to carry out a cognitive evaluation detected impairments in neuropsychological performance and delayed reaction times. VR was used to assess emotional regulation. No differences in well-being between VR-based and physical calm rooms were found. A VR-based stress management program reduced subjective stress, depression, and anxiety levels. VR-based cognitive remediation improved cognition, depressive symptoms, and emotional awareness. 48.7% of the individuals with BD considered VR-based cognitive remediation ‘excellent’, whereas 28.2% considered it ‘great’. 87.2% of individuals did not report any side effects. 81.8% of studies received a global quality rating of moderate. Emerging data point towards a promising use of VR in BD as an acceptable assessment/intervention tool. However, multiple unstudied domains as comorbidity, relapse and prodromal symptoms should be investigated. Research on children and adolescents is also recommended. Further research and replication of findings are required to disentangle which VR-interventions for which populations and outcomes are effective.

Type
Review Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press

Introduction

Bipolar disorder (BD) is a chronic, recurrent, and debilitating illness (Skjelstad, Malt, & Holte, Reference Skjelstad, Malt and Holte2010) that is characterized by fluctuations in mood states and energy (Grande, Berk, Birmaher, & Vieta, Reference Grande, Berk, Birmaher and Vieta2016). BD significantly affects psychosocial functioning and quality of life (Carlson & Pataki, Reference Carlson and Pataki2016; Salazar de Pablo et al., Reference Salazar de Pablo, Guinart, Cornblatt, Auther, Carrión, Carbon and Correll2020) and is the second most common mental disorder affecting days out of role functioning in young people (Alonso et al., Reference Alonso, Petukhova, Vilagut, Chatterji, Heeringa, Üstün and Kessler2011). A recent large-scale meta-analysis estimated that the global peak age at onset of BD is 19.5 years (Solmi et al., Reference Solmi, Radua, Olivola, Croce, Soardo, Salazar de Pablo and Fusar-Poli2021). Despite such an early onset, and despite different diagnostic strategies having been used for the detection of BD and the difficulties associated, the BD diagnosis is typically delayed by as long as 5–10 years after the occurrence of early symptomatology (Berk et al., Reference Berk, Dodd, Callaly, Berk, Fitzgerald, de Castella and Kulkarni2007). Furthermore, a significant number of individuals with BD do not receive any treatment, and there is a significant gap in their treatment provision. For instance, an epidemiological survey found that 80% of adolescents meeting the criteria for a bipolar spectrum disorder were not on any treatment (Merikangas et al., Reference Merikangas, He, Burstein, Swanson, Avenevoli, Cui and Swendsen2010).

Different interventions have been evaluated or piloted to ameliorate the negative consequences of BD. Mood-stabilizing agents, such as lithium, have shown antimanic, antidepressant, and anti-suicidal effects (McIntyre et al., Reference McIntyre, Berk, Brietzke, Goldstein, López-Jaramillo, Kessing and Mansur2020; Salazar de Pablo & Young, Reference Salazar de Pablo and Young2024) but are associated with significant side effects. Psychosocial interventions, including psychotherapy, when added to medication for the treatment of BD, consistently show advantages over medication alone, particularly for individuals with bipolar depression (Swartz & Swanson, Reference Swartz and Swanson2014). However, even in bipolar depression, psychotherapy is often not available and is underused (Linden, Reference Linden2013). Besides, limited insight and awareness, may result in difficulties to engage in therapy, particularly present in individuals with a recent onset of illness (Özdel, Kart, & Türkçapar, Reference Özdel, Kart and Türkçapar2021). Furthermore, additional clinical challenges, such as intense fears about being outside in everyday situations, may also appear (Freeman et al., Reference Freeman, Lambe, Kabir, Petit, Rosebrock and Yu2022).

Virtual reality (VR) is defined by the use of computer modeling and simulation, enabling a person to interact with an artificial three-dimensional (3-D) visual or other sensory environment (Lowood, Reference Lowood2023). VR enables researchers and clinicians to design realistic scenarios that can be used to assess the individual response to an environment and has been used in different mental health conditions (Peng, Menhas, Dai, & Younas, Reference Peng, Menhas, Dai and Younas2022).

In psychosis, several systematic reviews have been conducted (Chan et al., Reference Chan, Hui, Suen, Lee, Chang, Chan and Chen2023; Riches et al., Reference Riches, Pisani, Bird, Rus-Calafell, Garety and Valmaggia2021; Rus-Calafell, Garety, Sason, Craig, & Valmaggia, Reference Rus-Calafell, Garety, Sason, Craig and Valmaggia2018; Schroeder et al., Reference Schroeder, Bogie, Rahman, Thérond, Matheson and Guimond2022). Two of them have found that VR has been used as an intervention and also for the assessment of clinical symptoms and neurocognitive deficits (Chan et al., Reference Chan, Hui, Suen, Lee, Chang, Chan and Chen2023; Rus-Calafell et al., Reference Rus-Calafell, Garety, Sason, Craig and Valmaggia2018). Other two recent systematic reviews found that VR is a promising tool for the assessment and treatment of social functioning impairments in psychosis (Riches et al., Reference Riches, Pisani, Bird, Rus-Calafell, Garety and Valmaggia2021; Schroeder et al., Reference Schroeder, Bogie, Rahman, Thérond, Matheson and Guimond2022). These difficulties are often present in BD. In recent years, research has begun to evaluate the use of VR in people with BD. This approach has offered benefits such as increased ecological validity, enhanced personalization, and improved engagement (Bell, Nicholas, Alvarez-Jimenez, Thompson, & Valmaggia, Reference Bell, Nicholas, Alvarez-Jimenez, Thompson and Valmaggia2020). Other key advantages include the possibility to use realistic scenarios as part of therapy work and rehabilitation.

However, despite its potential benefits and clinical importance, to our knowledge, there is no systematic review appraising the research findings and the relevance of the field. To address this gap, this is the first systematic review evaluating the use of VR in BD. Our aim was to evaluate VR as an assessment (either for a cognitive evaluation, functional evaluation, or clinical assessment) or an intervention for individuals with BD.

Methods

This study (protocol: PROSPERO CRD42023467737) was conducted in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) (Moher, Liberati, Tetzlaff, & Altman, Reference Moher, Liberati, Tetzlaff and Altman2009) (online eTables 1–2) statements.

Search strategy and selection criteria

A systematic search strategy was used to identify relevant articles, and a two-step literature search was implemented by two independent researchers (GSP, ORH). PubMed and Web of Science database (Clarivate Analytics) were searched until the 1 August 2023, the last one incorporating the Web of Science Core Collection, BIOSIS Citation Index, KCI-Korean Journal Database, MEDLINE, Russian Science Citation Index, and SciELO Citation Index, as well as Cochrane Central Register of Reviews, and Ovid/PsychINFO databases. The following search terms were applied: (‘virtual reality’ OR ‘VR’) AND (‘mania’ OR ‘manic’ OR ‘bipolar disorder’ OR ‘bipolar’). Articles identified were screened as abstracts, and after the exclusion of those which did not meet our inclusion criteria, the texts of the remaining articles were assessed for eligibility, and decisions were made regarding their inclusion or exclusion in the review. We completed the search process by manually reviewing the references of previously published articles and extracting any additional relevant titles. We also looked for thesis and gray literature in Open Grey database.

Inclusion Criteria: (a) studies with original data, including original articles, abstracts, conference proceedings or gray literature (b) conducted in individuals with BD (children, adolescents, or adults), (c) in any language, (d) in which VR is used as a diagnostic or treatment tool. In line with previous studies, the criteria for inclusion from a VR perspective were that the studies used immersive and interactive VR environments in three-dimensional (3D) graphics presented with a head-mounted display, or that they used 2D graphics on a computer screen but were interactive, meaning that individuals could navigate through the environment using a joystick or a mouse/keyboard and they had elements or objects they could interact with (Rus-Calafell et al., Reference Rus-Calafell, Garety, Sason, Craig and Valmaggia2018). Exclusion criteria were: (a) reviews, clinical cases, study protocols, or studies providing only qualitative data, (b) studies focusing on other physical health or mental health conditions, (c) studies using other treatment strategies only. As stated in our protocol, studies including individuals with mood disorders in which BD represented >50% of the individuals in a relevant group for which results are provided were included, but the corresponding authors were contacted to gather additional information on the use of VR on BD specifically.

Data extraction

Two researchers (OR, SGV) independently extracted data from included studies into a database. Discrepancies were resolved through consensus with a senior researcher (GSP). The following variables were extracted: first author and year of publication, cohort, country, sample size, design (cross-sectional, longitudinal, RCT, other clinical trial), designation of individuals (BD-I, BD-II, BD-NOS), instrument used to characterize BD (e.g. DSM, ICD), age, sex, quality assessment (see below), VR equipment (e.g. Head-mounted displays -HMD-, Cave Automatic Virtual Environment -CAVE- etc), task carried out, category (cognitive and functional evaluation; clinical assessment; response to VR as a treatment; safety/acceptability) and key findings per outcome.

Risk of bias (quality) assessment

The Evaluation of Public Health Practice Project ‘Quality Assessment Tool for Quantitative Studies’ (QATQ) was used to assess the quality of all the studies included in the systematic review. The QATQ rates studies across six general domains: selection bias, study design, confounders, blinding, data collection, and withdrawals. A global rating for the paper is described as follows: Strong = no weak ratings; Moderate = one weak rating; Weak = two or more weak ratings on the subscales. The QATQ has favorable content and construct validity, and inter-rater reliability (Thomas, Ciliska, Dobbins, & Micucci, Reference Thomas, Ciliska, Dobbins and Micucci2004).

Strategy for data synthesis

Results were systematically synthesized around four categories based on previously published systematic reviews (cognitive and functional, clinical assessment, response to VR as a treatment, safety/acceptability). Categories were pre-defined, although due to the evidence available, cognitive evaluation category was expanded to ‘cognitive and functional evaluation’. Our aim was to stratify according to the population of study (children & adolescents; adults), but because all the studies were conducted in adults, this was not possible.

Results

Sample characteristics

The literature search yielded 361 citations, which were screened, and 41 full-text articles were assessed for eligibility (Fig. 1). After excluding those not meeting the inclusion criteria, 11 studies from 10 samples were included in the systematic review.

Figure 1. PRISMA flowchart outlining study selection process.

The overall database comprised 267 individuals. The mean age of the individuals was 36.6 years and 60.7% were female. 70% of samples were involved in cross-sectional studies and 30% were clinical trials (one RCT and two other clinical trials). Three study samples were conducted in Denmark, two in South Korea, one in Iran, one in Italy, one in Singapore, one in Sweden, and one in the USA. Characteristics of the included studies can be found in Table 1, including key findings and a summary of the equipment and tasks/experiments carried out. For more details regarding equipment and tasks, please check online supplementary eTable 3. A summary of findings from clinical, functional, and cognitive evaluation can be found in Fig. 2.

Table 1. Characteristics of the included studies

AVLT, Auditory-Verbal Learning Test; BD, Bipolar Disorder; CANTAB, Cambridge Neuropsychological Test Automated Battery; CAVE, Cave Automatic Virtual Environment; CAVIR, Cognition Assessment in Virtual Reality; DSM, Diagnostic and Statistical Manual of Mental Disorders; FAS, Functioning Assessment Short Test; HMD, Head-mounted displays; ICD, International Classification of Diseases; JEF, Jansari assessment of Executive Functions. FAST, Functioning Assessment Short Test; MMSE, Mini-Mental State Examination; QA, quality assessment; RAVLT, Rey Auditory Verbal Learning Test; RBANS, Repeatable Battery for the Assessment of Neuropsychological Status Effort Scale; RCT, randomized clinical trial; ROCFT-R, Rey-Osterrieth Complex Figure Test (ROCFT-R); ROCFTD, Rey-Osterrieth Complex Figure Test; RVP, Rapid Visual Information Processing; SCAN, Schedules for Clinical Assessment in Neuropsychiatry; SCID, Structured Clinical Interview for DSM–IV; SWM, Spatial Working Memory; UD, unipolar depression; UPSA-B, Performance-based Skills Assessment; VRNT VR, virtual reality.: Virtual Reality Navigation Test; WAIS-III, Wechsler Adult Intelligence Scale.

a Mood disorders: unipolar and bipolar disorder.

b Data available for combined mood disorder only.

Figure 2. Summary of findings from clinical, functional, and cognitive evaluation.

Key finding by outcome category

Cognitive and functional evaluation

Six studies used VR to carry out a cognitive and functional evaluation (Gould et al., Reference Gould, Holmes, Fantie, Luckenbaugh, Pine and Zarate2007; Hørlyck, Obenhausen, Jansari, Ullum, & Miskowiak, Reference Hørlyck, Obenhausen, Jansari, Ullum and Miskowiak2021; Kim et al., Reference Kim, Jung, Ku, Kim, Lee and Cho2009a; Miskowiak et al., Reference Miskowiak, Jespersen, Kessing, Aggestrup, Glenthøj, Nordentoft and Lumbye2021; Mohammadi, Hesami, Kargar, & Shams, Reference Mohammadi, Hesami, Kargar and Shams2018).

One of them also carried out a neuroimaging evaluation (Kim et al., Reference Kim, Jung, Ku, Kim, Lee and Cho2009a). This study compared euthymic individuals with BD and healthy controls who underwent functional MRI while performing a VR 2-D non-immersive social cognition task (Kim et al., Reference Kim, Jung, Ku, Kim, Lee and Cho2009a). Individuals with BD compared to healthy controls showed delayed reaction times when presented to different conditions (angry avatar, happy avatar and neutral avatar, all p < 0.001) with comparable response accuracy (p > 0.05). Relative to healthy controls, individuals with BD showed reduced activations in the ‘mirror neuron system’, including the right inferior frontal cortex with the angry avatar and reduced activations in the premotor cortex and insula with the happy avatar (p < 0.05) (Kim et al., Reference Kim, Jung, Ku, Kim, Lee and Cho2009a).

Another study assessed adults with BD, schizophrenia and healthy controls in spatial navigation (allocentric memory, egocentric memory), verbal memory and visual memory using VR. While individuals with schizophrenia appeared significantly impaired on allocentric, egocentric, visual, and verbal memory tasks (p < 0.05), there were no statistically significant differences between individuals with BD and healthy controls in spatial navigation (p > 0.05) (Mohammadi et al., Reference Mohammadi, Hesami, Kargar and Shams2018).

In a third study, individuals with mood disorders (unipolar/bipolar depression) found significantly fewer locations on the spatial navigation task than healthy controls (p = 0.01) while navigating a town using a 3-D (nonaerial) view. Among individuals with depression, cognitive deficits in spatial memory navigation correlated with the severity of depression (r = −0.33, p = 0.02). There were no differences in scores on the spatial working memory task between individuals with unipolar or bipolar depression and healthy controls (p = 0.95). There were no differences between individuals with and without a history of substance abuse either (p > 0.05) (Gould et al., Reference Gould, Holmes, Fantie, Luckenbaugh, Pine and Zarate2007).

In another study, individuals with BD completed executive functions tasks in a virtual, non-immersive office environment on a computer. Individuals with unipolar disorder and BD reported significantly more functional problems in everyday life on the Functioning Assessment Short Test (FAST)- focusing on six domains (autonomy, occupational functioning, cognitive functioning, finances, interpersonal relationships and leisure activities)- than the healthy control group (p < 0.001). There were no differences between the groups when using another scale, the Performance-based Skills Assessment (UPSA-B), measuring financial skills and communication skills (Hørlyck et al., Reference Hørlyck, Obenhausen, Jansari, Ullum and Miskowiak2021). Lower cognitive scores were correlated with more functional disability (r = 0.30–0.44 depending on the scale, p < 0.01). No differences were found between individuals with unipolar disorder and those with BD on any clinical/functional outcome evaluated (p > 0.05) (Hørlyck et al., Reference Hørlyck, Obenhausen, Jansari, Ullum and Miskowiak2021).

A study comparing individuals with mood disorders (either unipolar depression or BD) showed impaired global neuropsychological performance (p = 0.001). Across individual domains, they exhibited impairments in verbal learning and memory (p = 0.02), processing speed (p < 0.001), working memory (p = 0.004) and executive functions (p = 0.011). They showed no impairment in sustained attention (p = 0.59) (Miskowiak et al., Reference Miskowiak, Jespersen, Kessing, Aggestrup, Glenthøj, Nordentoft and Lumbye2021). Individuals with unipolar depression and BD were not compared.

Finally, individuals with unipolar disorder and BD showed impaired performance in global cognition and executive functions compared to the healthy control group (p < 0.01). They showed reduced performance compared to the healthy control group on the executive function sub-composite score (p < 0.01), the attention sub-composite score (p < 0.05) and the verbal learning and memory sub-composite score (p < 0.05) (Hørlyck et al., Reference Hørlyck, Obenhausen, Jansari, Ullum and Miskowiak2021). In the verbal learning and memory sub-composite score, individuals with BD scored significantly lower than those with unipolar depression (p = 0.05) (Hørlyck et al., Reference Hørlyck, Obenhausen, Jansari, Ullum and Miskowiak2021). There were no differences between individuals with unipolar disorder and BD on other cognitive outcomes.

Clinical assessment

Three studies from two samples used VR to carry out a clinical evaluation for individuals with BD (Kim, Reference Kim2008; Kim et al., Reference Kim, Ku, Kim, Lee, Han, Kim and Cho2009b; Kjærstad et al., Reference Kjærstad, Hellum, Haslum, Lopes, Noer, Kessing and Miskowiak2022).

A study found impairments in emotional regulation in individuals with BD compared to unaffected first-degree relatives and healthy controls using a VR-based social scenarios test. Individuals with BD completed a traditional behavioral paradigm, and a novel VR-based social scenarios test called the VERA test in which they were presented with social scenarios in a fully immersive 360-degree VR environment and were instructed to either simply view the scenario or try to dampen their emotional response. The study found a decrease in emotion regulation success in negative VR social scenarios in individuals with BD (p = 0.01). Individuals with BD were less able to damper their emotional response than healthy controls (p = 0.04) and unaffected first-degree relatives (p = 0.02), whereas results in unaffected first-degree relatives were comparable to healthy controls (p = 0.97) (Kjærstad et al., Reference Kjærstad, Hellum, Haslum, Lopes, Noer, Kessing and Miskowiak2022).

In another study which generated two publications, the mean interpersonal distance (IPD) of individuals with bipolar mania to an avatar in VR was inversely correlated with the severity of manic symptoms (p < 0.05) (Kim, Reference Kim2008; Kim et al., Reference Kim, Ku, Kim, Lee, Han, Kim and Cho2009b). However, they demanded greater personal space (p < 0.001), more so in female than male participants (p = 0.007) (Kim, Reference Kim2008; Kim et al., Reference Kim, Ku, Kim, Lee, Han, Kim and Cho2009b). Individuals with bipolar mania showed more gaze aversion (p < 0.001) (Kim, Reference Kim2008; Kim et al., Reference Kim, Ku, Kim, Lee, Han, Kim and Cho2009b). They exhibited a reduced affective valence toward angry avatars (p = 0.041), heightened arousal toward neutral avatars (p = 0.011) and reduced arousal toward happy avatars (p = 0.018) compared to healthy controls (Kim, Reference Kim2008). Affective valence toward angry avatars was significantly diminished in the individuals with BD compared to healthy controls (p = 0.041) (Kim et al., Reference Kim, Ku, Kim, Lee, Han, Kim and Cho2009b). Individuals with BD showed enhanced arousal toward neutral avatars (p = 0.011), but diminished arousal toward happy avatars (p = 0.018) (Kim et al., Reference Kim, Ku, Kim, Lee, Han, Kim and Cho2009b).

Response to virtual reality as a treatment

Three studies used VR as an intervention and measured its efficacy (Ilioudi et al., Reference Ilioudi, Lindner, Ali, Wallström, Thunström, Ioannou and Steingrimsson2023; Perra et al., Reference Perra, Galetti, Zaccheddu, Locci, Piludu, Preti and Carta2023; Shah et al., Reference Shah, Torres, Kannusamy, Chng, He and Klainin-Yobas2015).

One study used VR to provide cognitive remediation through an app – 24 sessions of 45 min, two sessions per week- (Perra et al., Reference Perra, Galetti, Zaccheddu, Locci, Piludu, Preti and Carta2023). The app offered psychoeducation and exercises of varying difficulty, divided into three modules: memory and learning; cognitive estimates: and attention and working memory. Compared to the waitlist group, individuals with BD receiving reported a significant improvement regarding cognitive functions (memory: p = 0.003; attention: p = 0.002, verbal fluency: p = 0.010; executive function: p = 0.003), depressive symptoms (p = 0.030), emotional awareness (p = 0.007) and biological rhythms (p = 0.029) (Perra et al., Reference Perra, Galetti, Zaccheddu, Locci, Piludu, Preti and Carta2023).

Another study compared the use of a VR-based and a physical calm room in a sample of individuals admitted to an inpatient psychiatric intensive care unit specialized in BD (but also accepting individuals with anxiety and depression). After the intervention, well-being improved (p < 0.01) and heart rate decreased (p = 0.02) in both present calm rooms and the VR-based calm room. No changes in blood pressure were found (p > 0.05) (Ilioudi et al., Reference Ilioudi, Lindner, Ali, Wallström, Thunström, Ioannou and Steingrimsson2023). There were no significant differences in the efficacy of the two interventions in enhancing well-being (Ilioudi et al., Reference Ilioudi, Lindner, Ali, Wallström, Thunström, Ioannou and Steingrimsson2023). No specific analyses for individuals with BD were carried out.

A feasibility study evaluated a VR-based stress management program on stress-related variables for individuals with BD (n = 12) and major depressive disorder (n = 10) (Shah et al., Reference Shah, Torres, Kannusamy, Chng, He and Klainin-Yobas2015). Following the 3-day intervention (1-h sessions administered by researchers), individuals had lowered subjective stress, depression and anxiety levels (p < 0.001) (Shah et al., Reference Shah, Torres, Kannusamy, Chng, He and Klainin-Yobas2015). Significant differences in skin temperature (p < 0.001) were found, but no differences in systolic blood pressure (p = 0.10), diastolic blood pressure (p = 0.97) and heart rate (p = 0.14) (Shah et al., Reference Shah, Torres, Kannusamy, Chng, He and Klainin-Yobas2015). No specific analyses for individuals with BD were carried out.

Safety/acceptability

Three studies used VR as an intervention and measured directly or indirectly its safety/acceptability for the interventions detailed above (Ilioudi et al., Reference Ilioudi, Lindner, Ali, Wallström, Thunström, Ioannou and Steingrimsson2023; Perra et al., Reference Perra, Galetti, Zaccheddu, Locci, Piludu, Preti and Carta2023; Shah et al., Reference Shah, Torres, Kannusamy, Chng, He and Klainin-Yobas2015). The rest of the studies included were cross-sectional.

48.7% of the individuals with BD considered VR-based cognitive remediation ‘excellent’, whereas 28.2% considered it ‘great’ and 23.1% considered it ‘good’. At the end of the intervention, 87.2% of individuals did not report any side effects (Perra et al., Reference Perra, Galetti, Zaccheddu, Locci, Piludu, Preti and Carta2023).

Of the individuals receiving a VR-based stress management program, 86.4% completed the study. Qualitatively, participants reported that the program helped them ‘be strong and determined’, ‘think positively’, ‘see things in a bigger picture’, ‘open mind’, ‘look forward to the future’, ‘learn to relax’, ‘manage insomnia’, and ‘cope with stress’ (Shah et al., Reference Shah, Torres, Kannusamy, Chng, He and Klainin-Yobas2015), although note some of these outcomes are related to the efficacy of the intervention.

Finally, the mean duration of stay in the VR calm room was 25.4 min, while it was 15.2 min in physical calm room (Ilioudi et al., Reference Ilioudi, Lindner, Ali, Wallström, Thunström, Ioannou and Steingrimsson2023). 20% participants declined to participate.

Quality of the included studies

81.8% of studies received a global rating of moderate and 18.2% received a global rating of strong. ‘Data collection’ was strong in all the included studies, while 81.8% were assessed as weak in quality due in the ‘withdrawals and dropout’ section.

Discussion

To the best of our knowledge, this is the first systematic review to evaluate the use of VR in BD. BD poses significant challenges in terms of diagnosis, delayed onset recognition, and limited treatment options. The present systematic review explores the application of VR as a diagnostic and therapeutic tool in BD, shedding light on its potential contributions to clinical, cognitive, and functional assessments, treatment interventions, and safety/acceptability.

This systematic review revealed a range of studies employing VR for cognitive evaluations in BD. There is increasing awareness of the importance of cognitive difficulties in BD, and assessments and interventions are being recommended. Our results speak to this more recent emphasis and provide a useful and potentially engaging assessment method for this group. Specifically, impairments in verbal learning, memory, processing speed, working memory, and executive function were found in adults with BD, which can lead to poor outcomes and poor functioning. The findings regarding special navigation were conflicting, as one study found impairment in BD while the other one did not. In any case, VR shows promise to carry out cognitive assessments and detect some of these difficulties. Unfortunately, cognitive assessments typically have limited ecological validity (Miskowiak et al., Reference Miskowiak, Jespersen, Kessing, Aggestrup, Glenthøj, Nordentoft and Lumbye2021). VR assessments can dynamically adapt to the individuals' responses in real time, which provides an interactive and personalized experience which can be beneficial when doing a cognitive evaluation. The impairments identified can also serve to develop VR-based interventions (Moreno et al., Reference Moreno, Wall, Thangavelu, Craven, Ward and Dissanayaka2019).

In regard to clinical outcomes, impairments in emotional regulation were found in individuals with BD compared to unaffected first-degree relatives and healthy controls (Kjærstad et al., Reference Kjærstad, Hellum, Haslum, Lopes, Noer, Kessing and Miskowiak2022). This offers us a useful way to assess emotional regulation performance, which can be useful for assessment and therapy. Understanding the specific challenges faced by individuals with BD in social scenarios provides a foundation for tailoring treatment strategies. For instance, positive emotion regulation interventions could be incorporated into comprehensive treatment plans (Painter et al., Reference Painter, Mote, Peckham, Lee, Campellone, Pearlstein and Moskowitz2019).

Two of the interventions evaluated seemed particularly promising, both from an efficacy and from a safety/acceptability perspective: VR-based cognitive remediation for cognitive functions, depressive symptoms, emotional awareness and biological rhythms (Perra et al., Reference Perra, Galetti, Zaccheddu, Locci, Piludu, Preti and Carta2023); and VR-based stress management program on stress-related variables, anxiety, and depression (Shah et al., Reference Shah, Torres, Kannusamy, Chng, He and Klainin-Yobas2015). The number of interventions studied is still very limited to make specific recommendations at individual level, at least compared to other mental health fields. In the psychosis field, it has been suggested that VR could be particularly helpful for individuals with intense fears about being outside in everyday situations (Freeman et al., Reference Freeman, Lambe, Kabir, Petit, Rosebrock and Yu2022). Precision strategies should aim to assess outcomes and develop interventions that are more likely to be effective at the group or individual level (Salazar de Pablo et al., Reference Salazar de Pablo, Studerus, Vaquerizo-Serrano, Irving, Catalan, Oliver and Fusar-Poli2021). VR may not be the best tool for everyone, the same way as house exercise through VR may be a good substitute to exercising outside for some individuals but not others (Peng et al., Reference Peng, Menhas, Dai and Younas2022). For instance, remotely-delivered cognitive behavioral therapy (CBT) seems to be equally efficacious as face-to-face CBT, except for those individuals with higher severity of OCD symptoms at baseline, in which face-to-face CBT is more effective (Salazar de Pablo, Pascual-Sánchez, Panchal, Clark, & Krebs, Reference Salazar de Pablo, Pascual-Sánchez, Panchal, Clark and Krebs2023). Furthermore, adolescents seem to be particularly attracted to VR for its broad range of immersive activities and social engagement opportunities (Maloney, Freeman, & Robb, Reference Maloney, Freeman and Robb2021). This may mean that the effectiveness of VR interventions could be higher. Unfortunately, none of the studies included in this review focused on this population and this remains an area needing research.

Other studies have included individuals with BD among their participants, although they were not included as they did not fulfill the inclusion criteria. For instance, an RCT evaluated a virtual screen-based stress management program on individuals admitted into the hospital with several mental disorders including schizophrenia, depression, and BD. They found a significant increase in perceived relaxation and knowledge after the intervention compared with the waiting list group (Tan, Chng, Lau, & Klainin-Yobas, Reference Tan, Chng, Lau and Klainin-Yobas2021). Other interventions could be trialled or piloted in the future, including VR-based exposure therapy, which has been used for anxiety disorders (Boeldt, McMahon, McFaul, & Greenleaf, Reference Boeldt, McMahon, McFaul and Greenleaf2019) and for post-traumatic stress disorder (PTSD) (Kothgassner et al., Reference Kothgassner, Goreis, Kafka, Van Eickels, Plener and Felnhofer2019). In PTSD, VR-based exposure therapy has meta-analytically shown an improvement in PTSD symptoms and depressive symptoms (Kothgassner et al., Reference Kothgassner, Goreis, Kafka, Van Eickels, Plener and Felnhofer2019). Another example would be VR-based CBT, which has been used for anxiety and depression (Baghaei et al., Reference Baghaei, Chitale, Hlasnik, Stemmet, Liang and Porter2021; Wu, Sun, Zhang, Zhou, & Ren, Reference Wu, Sun, Zhang, Zhou and Ren2021). VR interventions could integrate real-time mood monitoring and feedback mechanisms to help individuals with BD track their emotional states and recognize early warning signs of mood episodes. Furthermore, interventions (e.g. cognitive restructuring exercises) could target maladaptive thought patterns associated with depressive symptoms or manic symptoms. Novel interventions are also being trialled. For instance, Lithium Hindsight 360 (LH360) is a VR prototype intended to help individuals with BD communicate, though alternatives to writing, such as dance and somatic movement (Kim & Crowe, Reference Kim and Crowe2020). There is also an ongoing study looking at retinal electrophysiological markers in individuals with BD (https://clinicaltrials.gov/study/NCT05161546?cond=Bipolar%20Disorder&intr=Virtual%20Reality&rank=4) and another looking at enhancing cognitive reserve of the offspring of individuals with BD and schizophrenia (https://clinicaltrials.gov/study/NCT03722082?cond=Bipolar%20Disorder&intr=Virtual%20Reality&rank=7).

This study has some limitations that have to be taken into consideration when interpreting its results. First, the number of included studies and the number of individuals with BD was small. Further studies, including collaborative studies with a larger sample size are recommended. Second, the predominant focus on adults limits the generalizability of the results. Future research should explore the application of VR in other populations as adolescents with BD. Third, there were methodological flaws in some of the included studies. For future studies, matching participants and adjusting groups and results is recommended. Fourth, the populations, including BD characterizations, were heterogeneous and some studies included individuals with mood disorders. Furthermore, some studies did not provide their results for individuals with BD only and combined them with data from individuals with other mood disorders. Evidence from studies focusing on participants with BD is more likely to be applicable to individuals with BD. Fifth, the VR equipment used were also heterogeneous and some studies did not provide details on the characteristics of the equipment used. These details including the degrees of immersion are important. Finally, with six studies focusing on cognitive evaluation, three on clinical evaluation and three on the efficacy and tolerability of interventions, there are many domains that have not been studied. We recommend researching other domains, including management of comorbidity, relapse or appearance of new episodes and prodromal symptoms, among others.

Conclusion

In conclusion, emerging data point towards the promising utility of VR in BD as a tool for cognitive and clinical assessments in individuals with BD. Furthermore, certain VR interventions show potential for improving cognitive functions and managing symptoms. However, multiple domains have not been investigated and studies have been limited to adults. New domains as comorbidity, relapse and prodromal symptoms should be investigated. Research on children and adolescents is also recommended. Further investigation and replication of findings are required to disentangle which VR-based interventions and for which populations and outcomes are effective. More research is also needed to explore the long-term effects of VR interventions on individuals with BD.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291724001247.

Acknowledgements

This study was supported by the NIHR/Wellcome Trust King's Clinical Research Facility and NIHR Maudsley Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King's College London. The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.

Funding statement

None.

Competing interests

Dr Salazar de Pablo reports honoraria from Janssen-Cilag, Lundbeck, Menarini and Angelini. Prof Young has received compensation for lectures or advisory boards from the following companies: AstraZeneca, Boehringer Ingelheim, Eli Lilly, LivaNova, Lundbeck, Sunovion, Servier, Janssen, Allegan, Bionomics, Sumitomo Dainippon Pharma, COMPASS, Sage, Novartis, and Neurocentrx.

Footnotes

*

Dr Cella and Prof Valmaggia have contributed equally and share the senior position authorship.

References

Alonso, J., Petukhova, M., Vilagut, G., Chatterji, S., Heeringa, S., Üstün, T. B., … Kessler, R. C. (2011). Days out of role due to common physical and mental conditions: Results from the WHO World Mental Health surveys. Molecular Psychiatry, 16(12), 12341246. https://doi.org/10.1038/mp.2010.101CrossRefGoogle ScholarPubMed
Baghaei, N., Chitale, V., Hlasnik, A., Stemmet, L., Liang, H. N., & Porter, R. (2021). Virtual reality for supporting the treatment of depression and anxiety: Scoping review. JMIR Mental Health, 8(9), e29681. https://doi.org/10.2196/29681CrossRefGoogle ScholarPubMed
Bell, I. H., Nicholas, J., Alvarez-Jimenez, M., Thompson, A., & Valmaggia, L. (2020). Virtual reality as a clinical tool in mental health research and practice. Dialogues Clinical Neuroscience, 22(2), 169177. https://doi.org/10.31887/DCNS.2020.22.2/lvalmaggiaCrossRefGoogle ScholarPubMed
Berk, M., Dodd, S., Callaly, P., Berk, L., Fitzgerald, P., de Castella, A. R., … Kulkarni, J. (2007). History of illness prior to a diagnosis of bipolar disorder or schizoaffective disorder. Journal of Affective Disorders, 103(1–3), 181186. https://doi.org/10.1016/j.jad.2007.01.027CrossRefGoogle ScholarPubMed
Boeldt, D., McMahon, E., McFaul, M., & Greenleaf, W. (2019). Using virtual reality exposure therapy to enhance treatment of anxiety disorders: Identifying areas of clinical adoption and potential obstacles. Frontiers in Psychiatry, 10, 773. https://doi.org/10.3389/fpsyt.2019.00773CrossRefGoogle ScholarPubMed
Carlson, G. A., & Pataki, C. (2016). Understanding early age of onset: A review of the last 5 years. Current Psychiatry Reports, 18(12), 114. https://doi.org/10.1007/s11920-016-0744-8CrossRefGoogle ScholarPubMed
Chan, K. C., Hui, C. L., Suen, Y. N., Lee, E. H., Chang, W. C., Chan, S. K., … Chen, E. Y. (2023). Application of immersive virtual reality for assessment and intervention in psychosis: A systematic review. Brain Sciences, 13(3), 471. https://doi.org/10.3390/brainsci13030471CrossRefGoogle ScholarPubMed
Freeman, D., Lambe, S., Kabir, T., Petit, A., Rosebrock, L., Yu, L. M., … Group GT (2022). Automated virtual reality therapy to treat agoraphobic avoidance and distress in patients with psychosis (gameChange): A multicentre, parallel-group, single-blind, randomised, controlled trial in England with mediation and moderation analyses. Lancet Psychiatry, 9(5), 375388. https://doi.org/10.1016/S2215-0366(22)00060-8CrossRefGoogle ScholarPubMed
Gould, N. F., Holmes, M. K., Fantie, B. D., Luckenbaugh, D. A., Pine, D. S., Gould, T. D., … Zarate, C. A. (2007). Performance on a virtual reality spatial memory navigation task in depressed patients. American Journal of Psychiatry, 164(3), 516519. https://doi.org/10.1176/ajp.2007.164.3.516CrossRefGoogle ScholarPubMed
Grande, I., Berk, M., Birmaher, B., & Vieta, E. (2016). Bipolar disorder. Lancet, 387(10027), 15611572. https://doi.org/10.1016/S0140-6736(15)00241-XCrossRefGoogle ScholarPubMed
Hørlyck, L. D., Obenhausen, K., Jansari, A., Ullum, H., & Miskowiak, K. W. (2021). Virtual reality assessment of daily life executive functions in mood disorders: Associations with neuropsychological and functional measures. Journal of Affective Disorders, 280(Pt A), 478487. https://doi.org/10.1016/j.jad.2020.11.084CrossRefGoogle ScholarPubMed
Ilioudi, M., Lindner, P., Ali, L., Wallström, S., Thunström, A. O., Ioannou, M., … Steingrimsson, S. (2023). Physical versus virtual reality-based calm rooms for psychiatric inpatients: Quasi-randomized trial. Journal of Medical Internet Research, 25, e42365. https://doi.org/10.2196/42365CrossRefGoogle ScholarPubMed
Kim, E. (2008). Characteristics of social behavior of patients with bipolar disorder measured by proximal spacing in immersive virtual reality environment. Yonsei University Health System Repository. https://ir.ymlib.yonsei.ac.kr/handle/22282913/136127Google Scholar
Kim, E., Jung, Y. C., Ku, J., Kim, J. J., Lee, H., … Cho, H. S. (2009a). Reduced activation in the mirror neuron system during a virtual social cognition task in euthymic bipolar disorder. Prog Neuropsychopharmacol Biological Psychiatry, 33(8), 14091416. https://doi.org/10.1016/j.pnpbp.2009.07.019CrossRefGoogle ScholarPubMed
Kim, E., Ku, J., Kim, J. J., Lee, H., Han, K., Kim, S. I., & Cho, H. S. (2009b). Nonverbal social behaviors of patients with bipolar mania during interactions with virtual humans. The Journal of Nervous and Mental Disease, 197(6), 412418. https://doi.org/10.1097/NMD.0b013e3181a61c3dCrossRefGoogle ScholarPubMed
Kim, E. S., & Crowe, A. (2020). Lithium Hindsight 360: Designing a process to create movement-based VR illness narratives. Proceedings of the 31st Australian conference on human-computer-interaction, Fremantle, WA, Australia. Available at https://doi.org/10.1145/3369457.3369526CrossRefGoogle Scholar
Kjærstad, H. L., Hellum, K. S., Haslum, N. H., Lopes, M. N., Noer, T. S., Kessing, L. V., & Miskowiak, K. W. (2022). Assessment of the validity and feasibility of a novel virtual reality test of emotion regulation in patients with bipolar disorder and their unaffected relatives. Journal of Affective Disorders, 318, 217223. https://doi.org/10.1016/j.jad.2022.09.004CrossRefGoogle ScholarPubMed
Kothgassner, O. D., Goreis, A., Kafka, J. X., Van Eickels, R. L., Plener, P. L., & Felnhofer, A. (2019). Virtual reality exposure therapy for posttraumatic stress disorder (PTSD): A meta-analysis. European Journal of Psychotraumatology, 10(1), 1654782. https://doi.org/10.1080/20008198.2019.1654782CrossRefGoogle ScholarPubMed
Linden, M. (2013). How to define, find and classify side effects in psychotherapy: From unwanted events to adverse treatment reactions. Clinical Psychology and Psychotherapy, 20(4), 286296. https://doi.org/10.1002/cpp.1765CrossRefGoogle ScholarPubMed
Lowood, H. E. (2023). Virtual Reality (Accessed 27 September 2023).Google Scholar
Maloney, D., Freeman, G., & Robb, A. (2021). Stay connected in an immersive world: Why teenagers engage in social virtual reality. Proceedings of the 20th annual ACM interaction design and children conference, Athens, Greece. Available at https://doi.org/10.1145/3459990.3460703CrossRefGoogle Scholar
McIntyre, R. S., Berk, M., Brietzke, E., Goldstein, B. I., López-Jaramillo, C., Kessing, L. V., … Mansur, R. B. (2020). Bipolar disorders. Lancet, 396(10265), 18411856. https://doi.org/10.1016/S0140-6736(20)31544-0CrossRefGoogle ScholarPubMed
Merikangas, K. R., He, J. P., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., … Swendsen, J. (2010). Lifetime prevalence of mental disorders in U.S. Adolescents: Results from the national comorbidity survey replication–adolescent supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 49(10), 980989. https://doi.org/10.1016/j.jaac.2010.05.017CrossRefGoogle ScholarPubMed
Miskowiak, K. W., Jespersen, A. E., Kessing, L. V., Aggestrup, A. S., Glenthøj, L. B., Nordentoft, M., … Lumbye, A. (2021). Cognition assessment in virtual reality: Validity and feasibility of a novel virtual reality test for real-life cognitive functions in mood disorders and psychosis spectrum disorders. Journal of Psychiatric Research, 145, 182189. https://doi.org/10.1016/j.jpsychires.2021.12.002CrossRefGoogle ScholarPubMed
Mohammadi, A., Hesami, E., Kargar, M., & Shams, J. (2018). Detecting allocentric and egocentric navigation deficits in patients with schizophrenia and bipolar disorder using virtual reality. Neuropsychological Rehabilitation, 28(3), 398415. https://doi.org/10.1080/09602011.2017.1369888CrossRefGoogle ScholarPubMed
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Group P (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ, 339, b2535. https://doi.org/10.1136/bmj.b2535CrossRefGoogle ScholarPubMed
Moreno, A., Wall, K. J., Thangavelu, K., Craven, L., Ward, E., & Dissanayaka, N. N. (2019). A systematic review of the use of virtual reality and its effects on cognition in individuals with neurocognitive disorders. Alzheimers Dementia (New York), 5, 834850. https://doi.org/10.1016/j.trci.2019.09.016CrossRefGoogle ScholarPubMed
Özdel, K., Kart, A., & Türkçapar, M. H. (2021). Cognitive behavioral therapy in treatment of bipolar disorder. Archives of Neuropsychiatry, 58(Suppl 1), S66S76. https://doi.org/10.29399/npa.27419Google ScholarPubMed
Painter, J. M., Mote, J., Peckham, A. D., Lee, E. H., Campellone, T. R., Pearlstein, J. G., … Moskowitz, J. T. (2019). A positive emotion regulation intervention for bipolar I disorder: Treatment development and initial outcomes. General Hospital Psychiatry, 61, 96103. https://doi.org/10.1016/j.genhosppsych.2019.07.013CrossRefGoogle ScholarPubMed
Peng, X., Menhas, R., Dai, J., & Younas, M. (2022). The COVID-19 pandemic and overall wellbeing: Mediating role of virtual reality fitness for physical-psychological health and physical activity. Psychology Research and Behavior Management, 15, 17411756. https://doi.org/10.2147/PRBM.S369020CrossRefGoogle ScholarPubMed
Perra, A., Galetti, A., Zaccheddu, R., Locci, A., Piludu, F., Preti, A., … Carta, M. G. (2023). A recovery-oriented program for people with bipolar disorder through virtual reality-based cognitive remediation: Results of a feasibility randomized clinical trial. Journal of Clinical Medicine, 12(6), 2142. https://doi.org/10.3390/jcm12062142CrossRefGoogle ScholarPubMed
Riches, S., Pisani, S., Bird, L., Rus-Calafell, M., Garety, P., & Valmaggia, L. (2021). Virtual reality-based assessment and treatment of social functioning impairments in psychosis: A systematic review. International Review of Psychiatry, 33(3), 337362. https://doi.org/10.1080/09540261.2021.1918648CrossRefGoogle ScholarPubMed
Rus-Calafell, M., Garety, P., Sason, E., Craig, T. J. K., & Valmaggia, L. R. (2018). Virtual reality in the assessment and treatment of psychosis: A systematic review of its utility, acceptability and effectiveness. Psychological Medicine, 48(3), 362391. https://doi.org/10.1017/S0033291717001945CrossRefGoogle ScholarPubMed
Salazar de Pablo, G., Guinart, D., Cornblatt, B., Auther, A., Carrión, R., Carbon, M., … Correll, C. (2020). Demographic and clinical characteristics, including subsyndromal symptoms across bipolar-spectrum disorders in adolescents. Journal of Child and Adolescent Psychopharmacology, 30, 222234.CrossRefGoogle ScholarPubMed
Salazar de Pablo, G., Pascual-Sánchez, A., Panchal, U., Clark, B., & Krebs, G. (2023). Efficacy of remotely-delivered cognitive behavioural therapy for obsessive-compulsive disorder: An updated meta-analysis of randomised controlled trials. Journal of Affective Disorders, 322, 289299. https://doi.org/10.1016/j.jad.2022.11.007CrossRefGoogle ScholarPubMed
Salazar de Pablo, G., Studerus, E., Vaquerizo-Serrano, J., Irving, J., Catalan, A., Oliver, D., … Fusar-Poli, P. (2021). Implementing precision psychiatry: A systematic review of individualized prediction models for clinical practice. Schizophrenia Bulletin, 47(2), 284297. https://doi.org/10.1093/schbul/sbaa120CrossRefGoogle ScholarPubMed
Salazar de Pablo, G., & Young, A. H. (2024). Should lithium be used in children and adolescents with bipolar disorder? European Neuropsychopharmacology, 82, 12. https://doi.org/10.1016/j.euroneuro.2024.01.007CrossRefGoogle ScholarPubMed
Schroeder, A. H., Bogie, B. J. M., Rahman, T. T., Thérond, A., Matheson, H., & Guimond, S. (2022). Feasibility and efficacy of virtual reality interventions to improve psychosocial functioning in psychosis: Systematic review. JMIR Mental Health, 9(2), e28502. https://doi.org/10.2196/28502CrossRefGoogle ScholarPubMed
Shah, L. B., Torres, S., Kannusamy, P., Chng, C. M., He, H. G., & Klainin-Yobas, P. (2015). Efficacy of the virtual reality-based stress management program on stress-related variables in people with mood disorders: The feasibility study. Archives of Psychiatric Nursing, 29(1), 613. https://doi.org/10.1016/j.apnu.2014.09.003CrossRefGoogle ScholarPubMed
Skjelstad, D. V., Malt, U. F., & Holte, A. (2010). Symptoms and signs of the initial prodrome of bipolar disorder: A systematic review. Journal of Affective Disorders, 126(1–2), 113. https://doi.org/10.1016/j.jad.2009.10.003CrossRefGoogle ScholarPubMed
Solmi, M., Radua, J., Olivola, M., Croce, E., Soardo, L., Salazar de Pablo, G., … Fusar-Poli, P. (2021). Age at onset of mental disorders worldwide: Large-scale meta-analysis of 192 epidemiological studies. Molecular Psychiatry, 27(1), 281295. https://doi.org/10.1038/s41380-021-01161-7CrossRefGoogle ScholarPubMed
Swartz, H. A., & Swanson, J. (2014). Psychotherapy for bipolar disorder in adults: A review of the evidence. Focus (American Psychiatric Publishing), 12(3), 251266. https://doi.org/10.1176/appi.focus.12.3.251Google ScholarPubMed
Tan, H. L. E., Chng, C. M. L., Lau, Y., & Klainin-Yobas, P. (2021). Investigating the effects of a virtual reality-based stress management programme on inpatients with mental disorders: A pilot randomised controlled trial. International Journal of Psychology, 56(3), 444453. https://doi.org/10.1002/ijop.12713CrossRefGoogle ScholarPubMed
Thomas, B. H., Ciliska, D., Dobbins, M., & Micucci, S. (2004). A process for systematically reviewing the literature: Providing the research evidence for public health nursing interventions. Worldviews on Evidence-Based Nursing, 1(3), 176184. https://doi.org/10.1111/j.1524-475X.2004.04006.xCrossRefGoogle ScholarPubMed
Wu, J., Sun, Y., Zhang, G., Zhou, Z., & Ren, Z. (2021). Virtual reality-assisted cognitive behavioral therapy for anxiety disorders: A systematic review and meta-analysis. Frontiers in Psychiatry, 12, 575094. https://doi.org/10.3389/fpsyt.2021.575094CrossRefGoogle ScholarPubMed
Figure 0

Figure 1. PRISMA flowchart outlining study selection process.

Figure 1

Table 1. Characteristics of the included studies

Figure 2

Figure 2. Summary of findings from clinical, functional, and cognitive evaluation.

Supplementary material: File

Salazar de Pablo et al. supplementary material

Salazar de Pablo et al. supplementary material
Download Salazar de Pablo et al. supplementary material(File)
File 88.6 KB