Hostname: page-component-8448b6f56d-c47g7 Total loading time: 0 Render date: 2024-04-25T00:04:45.664Z Has data issue: false hasContentIssue false

Indirect social contact interventions to reduce mental health-related stigma in low- and middle-income countries: systematic review

Published online by Cambridge University Press:  09 November 2022

A. Makhmud*
Affiliation:
Centre for Global Mental Health and Centre for Implementation Science, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
G. Thornicroft
Affiliation:
Centre for Global Mental Health and Centre for Implementation Science, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
P. C. Gronholm
Affiliation:
Centre for Global Mental Health and Centre for Implementation Science, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
*
Author for correspondence: A. Makhmud, E-mail: akerkemakhmud@gmail.com; akerke.1.makhmud@kcl.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Aims

Mental health-related stigma and discrimination are a complex and widespread issue with negative effects on numerous aspects of life of people with lived experience of mental health conditions. Research shows that social contact is the best evidence-based intervention to reduce stigma. Within the context of a rapid development of remote technology, and COVID-19-related restrictions for face-to-face contact, the aim of this paper is to categorise, compare and define indirect social contact (ISC) interventions to reduce stigma and discrimination in mental health in low- and middle-income countries (LMICs).

Methods

MEDLINE, Global Health, EMBASE, PsychINFO, Cochrane Central Register of Control Trials (CENTRAL), Cumulative Index to Nursing and Allied Health Literature (CINAHL) were searched using a strategy including terms related to ‘stigma and discrimination’, ‘intervention’, ‘indirect social contact’, ‘mental health’ and ‘low- and middle-income countries’. Relevant information on ISC interventions was extracted from the included articles, and a quality assessment was conducted. Emerging themes were coded using a thematic synthesis method, and a narrative synthesis was undertaken to present the results.

Results

Nine studies were included in the review overall. One study was ineffective; this was not considered for the categorisation of interventions, and it was considered separately for the comparison of interventions. Of the eight effective studies included in synthesis, interventions were categorised by content, combination of stigma-reducing strategies, medium of delivery, delivery agents, target condition and population, as well as by active or passive interaction and follow-up. Most of the interventions used education and ISC. Recovery and personal experience were important content components as all studies included either one or both. Cultural adaptation and local relevance were also important considerations.

Conclusions

ISC interventions were effective in overall terms for both the general public and healthcare providers, including medical students. A new definition of ISC interventions in LMICs is proposed. More research and better reporting of intervention details are needed to explore the effectiveness of ISC strategies in LMICs, especially in regions where little relevant research has been conducted.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Introduction

Stigma and discrimination are a complex and multifaceted phenomenon conceptualised in various ways across disciplines and literature. Conceptualisation of stigma includes problems related to knowledge (ignorance), attitude (prejudice) and behaviour (discrimination) (Thornicroft et al., Reference Thornicroft, Rose, Kassam and Sartorius2007). This definition is evident also in how stigma is assessed using measures capturing these aspects of knowledge (e.g. Mental Health Knowledge Schedule (Evans-Lacko et al., Reference Evans-Lacko, Little, Meltzer, Rose, Rhydderch, Henderson and Thornicroft2010)), attitudes (e.g. Community Attitudes to Mental Illness scale (Wolff et al., Reference Wolff, Pathare, Craig and Leff1996)) and behaviour (e.g. Reported and Intended Behaviour Scale (Evans-Lacko et al., Reference Evans-Lacko, Rose, Little, Flach, Rhydderch, Henderson and Thornicroft2011)).

Stigma and discrimination may vary between cultures but are prevalent in all regions of the world (Thornicroft et al., Reference Thornicroft, Brohan, Rose, Sartorius and Leese2009; Koschorke et al., Reference Koschorke, Evans-Lacko, Sartorius and Thornicroft2017; Winkler et al., Reference Winkler, Krupchanka, Roberts, Kondratova, Machů, Höschl, Sartorius, Van Voren, Aizberg and Bitter2017; Aliev et al., Reference Aliev, Roberts, Magzumova, Panteleeva, Yeshimbetova, Krupchanka, Sartorius, Thornicroft and Winkler2021). Stigma is a major part of frequently experienced personal distress, systematic disadvantages, economic loss and social exclusion linked to mental illness globally. The negative impacts of stigma can have widespread effects on the personal (Corrigan et al., Reference Corrigan, Watson and Barr2006; Thornicroft et al., Reference Thornicroft, Brohan, Rose, Sartorius and Leese2009), social (Yang et al., Reference Yang, Kleinman, Link, Phelan, Lee and Good2007; Gonsalves et al., Reference Gonsalves, Hodgson, Michelson, Pal, Naslund, Sharma and Patel2019), economic (Sharac et al., Reference Sharac, Mccrone, Clement and Thornicroft2010) and other (Clement et al., Reference Clement, Brohan, Sayce, Pool and Thornicroft2011, Reference Clement, Schauman, Graham, Maggioni, Evans-Lacko, Bezborodovs, Morgan, Rüsch, Brown and Thornicroft2015) aspects of lives of people with mental health needs. Also, stigma and discrimination have important implications in policy with low investment, and political commitment towards mental healthcare programmes (Saraceno et al., Reference Saraceno, Van Ommeren, Batniji, Cohen, Gureje, Mahoney, Sridhar and Underhill2007) which reflect structural stigma (Pescosolido and Martin, Reference Pescosolido and Martin2015).

Strategies to reduce mental health-related stigma can use education, protest or social contact approaches (Corrigan et al., Reference Corrigan, River, Lundin, Penn, Uphoff-Wasowski, Campion, Mathisen, Gagnon, Bergman and Goldstein2001). Educational approaches targeting knowledge and beliefs about mental health-related problems have been shown to be effective and widely used (Mehta et al., Reference Mehta, Clement, Marcus, Stona, Bezborodovs, Evans-Lacko, Palacios, Docherty, Barley and Rose2015; Thornicroft et al., Reference Thornicroft, Mehta, Clement, Evans-Lacko, Doherty, Rose, Koschorke, Shidhaye, O'reilly and Henderson2016; Rao et al., Reference Rao, Elshafei, Nguyen, Hatzenbuehler, Frey and Go2019). Protest strategies challenge negative representation and images of mental illness and people with mental health needs (Corrigan et al., Reference Corrigan, River, Lundin, Penn, Uphoff-Wasowski, Campion, Mathisen, Gagnon, Bergman and Goldstein2001). However, evidence on their effectiveness is limited (Corrigan et al., Reference Corrigan, Morris, Michaels, Rafacz and Rüsch2012). Social contact involves contact between the stigmatised group and those displaying stigmatising attitudes, knowledge or behaviour (London and Evans-Lacko, Reference London and Evans-Lacko2010), and is the most effective type of intervention to reduce mental health-related stigma and discrimination (Thornicroft et al., Reference Thornicroft, Mehta, Clement, Evans-Lacko, Doherty, Rose, Koschorke, Shidhaye, O'reilly and Henderson2016).

Social contact interventions targeting mental health-related stigma take various forms and cover a range of intervention types. More recently, indirect social contact (ISC) interventions that do not entail in-person face-to-face contact have been developed and evaluated. ISC interventions have been broadly divided into those occurring through: (i) another person (e.g. someone who knows a person with mental health needs), (ii) media (e.g. the Internet) or (iii) imagined contact, or having passive or active interaction with ISC media (e.g. discussing videos or vignettes) (Paolini et al., Reference Paolini, White, Tropp, Turner, Page-Gould, Barlow, Gomez, Borinca, Vezzali, Reynolds, Blomster Lyshol, Verrelli and Falomir-Pichastor2021).

Yet there is a limited understanding of what defines ISC interventions or how various types of ISC differ. Some reviews have explored the effects of intergroup social contact (Maunder and White, Reference Maunder and White2019) or effects of certain types of ISC (Ando et al., Reference Ando, Clement, Barley and Thornicroft2011; Janoušková et al., Reference Janoušková, Tušková, Weissová, Trančík, Pasz, Evans-Lacko and Winkler2017), but no systematic reviews defining and comparing ISC in low- and middle-income countries (LMICs) have been published. A focus on LMICs is important because of the broader mental health research and evidence gap on contact-based intervention in such contexts, and because the large majority of the world's population live in LMICs (Thornicroft et al., Reference Thornicroft, Mehta, Clement, Evans-Lacko, Doherty, Rose, Koschorke, Shidhaye, O'reilly and Henderson2016).

The COVID-19 pandemic has led to an increase in risk factors for mental health conditions and exacerbated barriers to support for people with pre-existing mental health needs (Moreno et al., Reference Moreno, Wykes, Galderisi, Nordentoft, Crossley, Jones, Cannon, Correll, Byrne and Carr2020). Effects of the pandemic on mental health are more prominent in LMICs given other local endemics, stigma and pre-existing difficulties in mental healthcare (De Sousa et al., Reference De Sousa, Mohandas and Javed2020). ISC can be useful to target mental health-related stigma under current circumstances where face-to-face contact is restricted and the mental health burden is rising (Vigo et al., Reference Vigo, Thornicroft and Gureje2020; Naslund and Deng, Reference Naslund and Deng2021).

The aims of this systematic review are to address the gap in research on ISC in LMICs by categorising, comparing and defining ISC interventions to reduce mental health-related stigma in LMICs.

Methods

Inclusion and exclusion criteria

The protocol for the systematic review was registered on PROSPERO, ID CRD42021248559. This review included studies with interventions containing an element of ISC aimed to reduce any type of mental health-related stigma or discrimination against people with mental health needs. Studies that focused on other stigmatised conditions such as HIV, substance use disorders and neurological conditions were excluded. ISC of any kind – including for example videos, presentations, personal narratives, photo-voice and theatrical performances – were eligible for inclusion. Comparators such as a non-exposed control group or a control group exposed to another type of stigma-reducing intervention were included as long as the effect of ISC specifically or its effect alongside one other stigma-reducing intervention could be analysed. Studies that did not have a comparator or control group were included as long as outcome measures were taken pre- and post-intervention. In this review, studies were considered to assess stigma if they explicitly stated they assessed stigma, or also if they captured stigma via the constructs of knowledge, attitudes and/or behaviour. Studies of all experimental designs were eligible for this review as long as at least one mental health-related stigma measure was collected pre and post intervention. Studies eligible for this review must have been conducted in a country classified as LMIC by the World Bank classification of gross national income (2019). Studies of any duration, size or follow-up were included. No restrictions were applied on target populations and publishing date. Searches were restricted to English language, and to human subjects.

Search strategy

The search strategy development was guided by other systematic reviews on stigma (Mehta et al., Reference Mehta, Clement, Marcus, Stona, Bezborodovs, Evans-Lacko, Palacios, Docherty, Barley and Rose2015; Morgan et al., Reference Morgan, Reavley, Ross, San Too and Jorm2018; Clay et al., Reference Clay, Eaton, Gronholm, Semrau and Votruba2020; Heim et al., Reference Heim, Kohrt, Koschorke, Milenova and Thornicroft2020). Five categories of terms (‘stigma’, ‘intervention’, ‘indirect social contact’, ‘mental health’ and ‘low- and middle-income countries’) were expanded with related subject headings and key words, connected with ‘OR’ within categories and ‘AND’ between categories. The full search strategy for databases used is provided within online Supplementary materials.

Records from MEDLINE, Global Health, EMBASE, PsychINFO, The Cochrane Central Register of Controlled Trials (CENTRAL), Cumulative Index to Nursing and Allied Health Literature (CINAHL) were retrieved on 29 June 2021. In our review protocol we indicated that we could also conduct the search in Scopus; however, due to issues with feasibility and system errors at the time of the searches, Scopus was not used.

In addition to the database search, we performed backward and forward citation checking of included papers and checked reference lists of related systematic reviews (can be accessed in online Supplementary materials). Authors of included studies and other content experts were contacted for paper recommendations.

Study selection

All titles and abstracts were screened for potential relevance by the lead author, and 17% titles and abstracts were independently screened by the second reviewer to establish consistency. Reviewers resolved any disagreements through discussions, and a third person (GT or PCG) was involved as arbitrator when needed. Full-text versions of studies deemed potentially relevant were retrieved and screened against inclusion criteria. The second reviewer independently screened 13% full-text papers. Authors were contacted when full-texts were not available. If authors did not reply, the paper was excluded.

Quality assessment

The methodological quality of the included studies was assessed using the Mixed Methods Appraisal Tool (MMAT) (Hong et al., Reference Hong, Fàbregues, Bartlett, Boardman, Cargo, Dagenais, Gagnon, Griffiths, Nicolau and O'cathain2018). MMAT has two overall screening criteria and five criteria for each study design. One point was awarded for meeting the criteria indicators for each design-specific scoring domain. If papers mentioned some but not all of the criteria indicators 0.5 points were awarded (Gronholm et al., Reference Gronholm, Thornicroft, Laurens and Evans-Lacko2017). The MMAT score was used to determine the quality level of each paper, adapting the approach by Clay et al. (Reference Clay, Eaton, Gronholm, Semrau and Votruba2020). Included studies were assessed for quality by the lead author, 33% of those were assessed by another reviewer to assess for consistency. Studies were not excluded based on methodological quality.

Data extraction and analysis

A worksheet was developed to extract data from included papers (see online Supplementary materials). The classification of stigma by Pescosolido and Martin (Reference Pescosolido and Martin2015) was used for study characteristics. It included courtesy, public, provider-based, structural and self-stigma. Missing data or elaboration on the interventions was requested from original authors.

Ineffective interventions were described alongside effective interventions for the study characteristics section of results; however, studies that did not report an effect on the outcomes were considered separately for the categorisation of ISC interventions. In the comparison of categories section, ineffective interventions were included in the synthesis to compare any differences between categories and effective and ineffective interventions.

The method of synthesising information on ISC interventions was based on thematic synthesis (Thomas and Harden, Reference Thomas and Harden2008). Literal descriptions of how the interventions were conducted and what the process entailed were extracted and coded line-by-line according to the upcoming meanings, content or themes. No pre-existing framework was used; thus, broad themes came from the descriptions provided. Due to the exploratory nature of this review, a general narrative synthesis was used to synthesise and describe the findings.

Results

Search results

Of 7383 screened records, 11 papers (nine studies) were eligible for inclusion (Fig. 1). On two occasions, two papers referred to the same studies but with different follow-up points or different focus of outcome measures. These papers were considered jointly as reflective of one intervention study. Overall, 3630 participants were recruited through nine studies including healthcare workers, community leaders, families and members of the general population.

Fig. 1. PRISMA flow diagram of selection of papers.

Study characteristics

The main characteristics of the included studies are reported in Table 1.

Table 1. Key characteristics of included studies

RCT, randomised controlled trial; HCW, healthcare worker; GP, general population; CL, community leaders; V, video; PSV, problem-solving vignette; CAP, computer-assisted programme; PWLE, people with lived experience; C, contact; E, education; PRCT, pilot randomised controlled trial.

The quality of studies measured using MMAT varied (Table 2), with five high-quality papers fulfilling 80–90% of criteria, three moderate-quality papers fulfilling 60–80% of criteria and one of low quality fulfilling 40–50% of criteria.

Table 2. Summary of the study quality evaluated with MMAT

Five studies (55.6%) had a significant effect on all stigma-related outcomes, four had mixed results with small or medium effects and one randomised controlled trial (RCT) reported alongside a pilot RCT showed no significant effect. Studies included self-reported measures related to stigma that mainly included knowledge, attitudes or behaviour as proxy measures to evaluate changes in mental health-related stigma. These proxy measures were in accordance to the conceptualisation of stigma as issues of knowledge, attitudes and behaviour (Corrigan et al., Reference Corrigan, Morris, Michaels, Rafacz and Rüsch2012; Thornicroft et al., Reference Thornicroft, Mehta, Clement, Evans-Lacko, Doherty, Rose, Koschorke, Shidhaye, O'reilly and Henderson2016).

ISC intervention categorisation

Medium of delivery and points of ISC

All but one intervention (n = 8) used video-based media on its own or as one of the points of ISC. Videos varied greatly in their duration, ranging from 3 to 40 min. The majority of interventions (n = 5) showed the videos only at one point.

Three studies used multiple channels to deliver ISC. The Time to Change Global campaign in Kenya and Ghana (Potts and Henderson, Reference Potts and Henderson2021) used multiple types of ISC by using social media for videos and radio to broadcast interviews with local mental health champions. A campaign in India (Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019) engaged the public with ISC through posters and local theatre play about people with mental health needs. A study in Ghana (Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b) used video-based contact and a problem-solving exercise about a person with mental health needs where participants had to come up with a solution for recovery.

The only intervention that did not include videos as its method of ISC was conducted in Russia (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008) with special education university students. This RCT looked at the effectiveness of the computer-assisted education system that had education and contact strategies. Contact was in the form of stories that would appear in the computer-assisted education system with follow-up questions.

Content and main themes

Only broad themes could be extracted from the information in the papers. Two studies (Ng et al., Reference Ng, Rashid and O'brien2017; Potts and Henderson, Reference Potts and Henderson2021) provided working links where videos could be accessed.

Seven interventions (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008; Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015; Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016; Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019; Ng et al., Reference Ng, Rashid and O'brien2017; Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020b; Potts and Henderson, Reference Potts and Henderson2021) mentioned that during the videos or stories, person with lived experience described their personal experience of mental health needs. These experiences covered either mental health journeys, experiences with stigma or both. Information about caregiver videos mentioned personal experiences and reactions to the news about their family member having mental health problems, but further descriptions of the content were very limited.

Another commonly occurring theme was the use of a recovery story and seeking treatment (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008; Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015; Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016; Ng et al., Reference Ng, Rashid and O'brien2017; Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b; Potts and Henderson, Reference Potts and Henderson2021; Tergesen et al., Reference Tergesen, Gurung, Dhungana, Risal, Basel, Tamrakar, Amatya, Park and Kohrt2021). Recovery was highlighted by people with lived experience, people in contact with them (caregivers or co-workers) or through a problem-solving exercise based on a vignette story. Treatment themes broadly covered the treatment options, the process and results of treatment or encouragement to seek treatment.

The study from Russia (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008) had a different approach of providing a personal story and recovery of a real-life person along historical facts and stories about negative treatment of people with mental health needs.

Another prominent theme on intervention effects was the presence of an emotional or empathetic response. The majority of effective or partly effective studies (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008; Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015; Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019; Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b; Potts and Henderson, Reference Potts and Henderson2021) mentioned that participants reported an emotional response towards the person with lived experience, or that the intervention aimed to elicit emotions from participants through ISC. The intervention conducted in Iran for families of service users (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015) resulted in a discussion after the caregiver video during which people connected to experiences emotionally. In a study conducted in Russia (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008) qualitative data from students indicated that stories were an important part of the intervention. Qualitative results of a campaign in India (Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017) revealed that people felt that they could relate and better understand the challenges faced by service users through theatrical performance and videos.

Combinations of interventions

The majority of studies (n = 7) used psychoeducation and ISC strategies to reduce stigma. The types of psychoeducation alongside ISC included delivery mediums such as presentations (Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b), lectures (Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016), videos (Ng et al., Reference Ng, Rashid and O'brien2017; Gürbüz et al., Reference Gürbüz, Yorulmaz and Durna2020), educational messages (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008), social media advertisements (Potts and Henderson, Reference Potts and Henderson2021) and printed materials such as posters and pamphlets (Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019). One intervention compared the difference between direct social contact and education v. ISC (video) and education (Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016). Only one study in Iran used ISC intervention without combining it with another stigma-reducing strategy; this study compared ISC-only (video) and non-ISC interventions (psychoeducation and control) (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015).

Delivery agent and interaction

In terms of delivery agents, the majority of interventions had people with lived experience as a delivery agent (Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016; Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019; Ng et al., Reference Ng, Rashid and O'brien2017; Gürbüz et al., Reference Gürbüz, Yorulmaz and Durna2020; Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b; Potts and Henderson, Reference Potts and Henderson2021). One intervention (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015) targeting families of patients with schizophrenia had only a caregiver as a delivery agent. Some interventions included people with lived experience and other key stakeholders as delivery agents; namely family members or caregivers (Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016; Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019; Gürbüz et al., Reference Gürbüz, Yorulmaz and Durna2020; Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b), healthcare workers (Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016; Ng et al., Reference Ng, Rashid and O'brien2017) and celebrities known to have a mental health disorder, and a lay person talking about her co-worker with mental healthcare needs (Ng et al., Reference Ng, Rashid and O'brien2017). Two interventions did not have a delivery agent at all or in one of the components of indirect contact (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008; Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b) as the ISC was presented as a story in a computer program or as a vignette with a problem-solving exercise.

Another characteristic of ISC interventions in LMICs related to active and passive interaction with content. Active engagement entailed discussions in groups after watching videos (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015), problem-solving exercises based on a vignette (Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b) or responding to questions (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008). Passive contact occurred when participants would watch a video or listen to a radio programme without subsequently actively engaging with one's attitudes or knowledge either through interactive exercises or group discussions (Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016; Ng et al., Reference Ng, Rashid and O'brien2017; Gürbüz et al., Reference Gürbüz, Yorulmaz and Durna2020; Potts and Henderson, Reference Potts and Henderson2021).

Comparison and effectiveness of interventions with ISC

Content and main themes

The studies explicitly mentioning the cultural relevance of interventions showed that their positive results were sustained after a month (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015), and even after 2 years (Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019). Other effective interventions also had videos that either matched the local language, or that included local people with lived experience in the videos (Ng et al., Reference Ng, Rashid and O'brien2017; Potts and Henderson, Reference Potts and Henderson2021).

The study in Ghana looking at depression and schizophrenia (Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b) produced no significant changes in knowledge related to depression, and only some subscales (attitudes, beliefs) had significant differences at follow-up (Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020b). Notably, the ineffective study (Tergesen et al., Reference Tergesen, Gurung, Dhungana, Risal, Basel, Tamrakar, Amatya, Park and Kohrt2021) also targeted two conditions (depression and psychosis). Authors theorised that different stigma reduction strategies should be developed for different types of mental illnesses, or that more severe mental illnesses should not be paired in interventions with other mental health needs.

Intervention strategy comparison

There was a limited number of interventions that used only ISC. From those that did one found no significant results (Tergesen et al., Reference Tergesen, Gurung, Dhungana, Risal, Basel, Tamrakar, Amatya, Park and Kohrt2021) and another (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015) found significant changes in comparison to the control group for all subscales of Internalised Stigma of Mental Illness Scale (Ritsher et al., Reference Ritsher, Otilingam and Grajales2003). However, when compared to the psychoeducation group, significant changes were only detected for scores on the ‘social withdrawal’ and ‘discrimination experience’ subscales of the Internalised Stigma of Mental Illness Scale. Among the studies that used two strategies of education and contact (n = 7), four had significant effect on all the subscales of the stigma-related outcomes they used (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008; Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016; Ng et al., Reference Ng, Rashid and O'brien2017; Gürbüz et al., Reference Gürbüz, Yorulmaz and Durna2020), and the rest had mixed results (Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017; Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b; Potts and Henderson, Reference Potts and Henderson2021).

As for the only ineffective study (Tergesen et al., Reference Tergesen, Gurung, Dhungana, Risal, Basel, Tamrakar, Amatya, Park and Kohrt2021), no improvements were observed for implicit or explicit attitudes or diagnostic accuracy among medical students between the service user video (where service users with depression or schizophrenia shared their personal experience and recovery story) and a didactic video (healthcare provider talking about the treatment process).

Active and passive interaction

When it comes to the effectiveness of active and passive interaction, of four studies with active engagement two had a significant effect on most scores of knowledge, attitudes and behaviour at a 2-year follow-up (Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019), and one had significant effects on stigma and knowledge scores after 6 months (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008). Two other studies showed partial improvement in attitudes (Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020b), discrimination and social withdrawal (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015).

Regarding studies with passive interaction with ISC, two produced significant positive effects on attitudes (Ng et al., Reference Ng, Rashid and O'brien2017), social distance and help-seeking (Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016). Partial effectiveness was shown for knowledge or attitudes only (Potts and Henderson, Reference Potts and Henderson2021). The ineffective study (Tergesen et al., Reference Tergesen, Gurung, Dhungana, Risal, Basel, Tamrakar, Amatya, Park and Kohrt2021) also involved passive interaction with service user videos.

Discussion

This review aimed to categorise, compare and define ISC interventions to reduce mental health-related stigma in LMICs. Most included studies of ISC interventions were shown to be effective in reducing stigma either on all measures or certain subscales of measures. Currently limited evidence exists on interventions using only ISC to reduce stigma (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015; Tergesen et al., Reference Tergesen, Gurung, Dhungana, Risal, Basel, Tamrakar, Amatya, Park and Kohrt2021); more often ISC is paired with educational strategies (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008; Fernandez et al., Reference Fernandez, Tan, Knaak, Chew and Ghazali2016; Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019; Ng et al., Reference Ng, Rashid and O'brien2017; Arthur et al., Reference Arthur, Boardman, Morgan and Mccann2020a, Reference Arthur, Boardman, Morgan and Mccann2020b; Potts and Henderson, Reference Potts and Henderson2021). Existing evidence of higher effectiveness of combining education and contact strategies (Rüsch et al., Reference Rüsch, Angermeyer and Corrigan2005; Patten et al., Reference Patten, Remillard, Phillips, Modgill, Szeto, Kassam and Gardner2012) was the rationale behind combining ISC with education. The included studies were all relatively recent, indicating a growing interest in this area. This review provides an important contribution through synthesising what is known to date about ISC interventions to reduce mental health-related stigma.

The most popular medium of ISC was videos, and indeed, previous reviews have shown that video-based contact can be effective in reducing stigma (Janoušková et al., Reference Janoušková, Tušková, Weissová, Trančík, Pasz, Evans-Lacko and Winkler2017). Interestingly, there was only one intervention (Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017, Reference Maulik, Devarapalli, Kallakuri, Tripathi, Koschorke and Thornicroft2019) that used a creative outlet such as theatrical performance. Examples of using creative means of ISC from high-income countries (Michalak et al., Reference Michalak, Livingston, Maxwell, Hole, Hawke and Parikh2014; Kosyluk et al., Reference Kosyluk, Marshall, Conner, Macias, Macias, Michelle Beekman and Her2021) show significant changes in stigma which potentially indicates that such an approach can also be effective in LMICs.

As for the active and passive engagement with ISC, active interaction might contribute to more favourable results, and qualitative data found ISC (Maulik et al., Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017) being received as the most effective component of the intervention. However, it is difficult to judge as passive and active interactions produced both significant and mixed results.

Content and culture

Some interventions provided limited details about the content of the ISC intervention (Finkelstein et al., Reference Finkelstein, Lapshin and Wasserman2008). This poses problems for future replicability and development of interventions. The content of ISC interventions is comparable with the content of direct contact interventions, where some of the strategies might include people sharing personal experiences, recovery stories or caregiver experience (Clement et al., Reference Clement, Van Nieuwenhuizen, Kassam, Flach, Lazarus, De Castro, Mccrone, Norman and Thornicroft2012; Gonçalves et al., Reference Gonçalves, Moleiro and Cook2015). Sharing personal and recovery stories and experiences seems to be an important critical active ingredient for ISC in LMICs, as one or both of these themes have occurred in all interventions.

Cultural adaptation is likely to be important to produce effective and appropriate interventions for local communities. Given countries and cultures have differing sources of information that are considered appropriate or reliable (Semrau et al., Reference Semrau, Evans-Lacko, Koschorke, Ashenafi and Thornicroft2015), it is crucial for interventions to adapt how and through whom stigma-reducing messages are translated. For instance, video contact by a peer caregiver in Iran (Vaghee et al., Reference Vaghee, Salarhaji and Vaghei2015) helped to create an environment where other families could safely share their experiences. Authors specified that differences between the individualistic, Western, and collectivist, Eastern, cultures were important considerations, and there was a need to arrange a safe environment for families to discuss and self-expose beliefs and experiences. Another example from the study conducted in India by Maulik et al. (Reference Maulik, Devarapalli, Kallakuri, Tewari, Chilappagari, Koschorke and Thornicroft2017) who purposefully developed a culturally relevant intervention stated that ‘Many participants mentioned that the drama and videos made them realize that they should not desert or abuse persons suffering from psychological problem, rather provide support to them.’ This further emphasises the importance and role of intervention's relevance and acceptability to the local culture.

Defining ISC interventions in LMICs

After analysing the descriptions in the included papers, the following broad themes related to ISC interventions appeared: content, delivery agent, emotional response and effect on participants, cultural relevance or adaptation, interaction, delivery medium and effect on stigma. Given these broad themes we propose the following new definition of ISC in LMICs.

Indirect social contact entails a culturally/locally relevant active or passive interaction with real-life (or based on real-life) stories, narratives, or experiences of people with lived experience or those in contact or close to them (family or practitioners); and, uses online, technological, printed or other forms of traditional or new media for conveying information that elicits positive emotional or empathic responses.

Strengths and limitations of the review

This is the first systematic review examining ISC in LMICs, providing a categorisation of these studies and a novel definition of ICS interventions in LMICs. This is in contrast to previous reviews that have focused on subtypes of ISC (Ando et al., Reference Ando, Clement, Barley and Thornicroft2011; Clement et al., Reference Clement, Lassman, Barley, Evans-Lacko, Williams, Yamaguchi, Slade, Rüsch and Thornicroft2013; Janoušková et al., Reference Janoušková, Tušková, Weissová, Trančík, Pasz, Evans-Lacko and Winkler2017) and included studies from both HICs and LMICs, or considered different types of contact intervention strategies together (Clay et al., Reference Clay, Eaton, Gronholm, Semrau and Votruba2020; Hartog et al., Reference Hartog, Hubbard, Krouwer, Thornicroft, Kohrt and Jordans2020; Kaur et al., Reference Kaur, Kallakuri, Kohrt, Heim, Gronholm, Thornicroft and Maulik2020).

This work does, however, need to be considered in view of some limitations. The included studies varied greatly in the level of detail of intervention descriptions, which could lead to results being more reliant on some papers than others for categorisation and definition. However, to mitigate such impacts authors were contacted for added details and all relevant information was extracted to capture main ideas and themes about ISC of each included study. Also, as is common in much stigma research, nearly all effectiveness measures were self-reported which may increase social desirability bias, and not all studies reported if the measures were validated in the local context.

Implications and recommendations

A broader array of mediums and types of ISC interventions are seen in HICs compared to LMICs (Clement et al., Reference Clement, Lassman, Barley, Evans-Lacko, Williams, Yamaguchi, Slade, Rüsch and Thornicroft2013; Mehta et al., Reference Mehta, Clement, Marcus, Stona, Bezborodovs, Evans-Lacko, Palacios, Docherty, Barley and Rose2015; Thornicroft et al., Reference Thornicroft, Mehta, Clement, Evans-Lacko, Doherty, Rose, Koschorke, Shidhaye, O'reilly and Henderson2016; Janoušková et al., Reference Janoušková, Tušková, Weissová, Trančík, Pasz, Evans-Lacko and Winkler2017; Morgan et al., Reference Morgan, Reavley, Ross, San Too and Jorm2018; Rao et al., Reference Rao, Elshafei, Nguyen, Hatzenbuehler, Frey and Go2019). More studies are needed to explore if these might be appropriate in LMICs while addressing culture and local relevance. Given many difficulties of providing in-person contact it is important to continue investigating the effectiveness of ISC interventions on their own or together with other stigma-reducing strategies.

When reporting on ICS interventions, more details need to be provided on intervention components and content to facilitate further refinement of the ICS definition and categories in LMICs. Such insights will support the development of more effective ICS interventions.

More research evidence is needed from different regions, particularly low-income countries, as the current evidence-base is dominated by a small number of countries. Studies examining the long-term effectiveness of ICS interventions are also lacking.

Conclusions

Based on current evidence from LMICs ISC can be categorised by content, combination of strategies, medium of delivery, delivery agent, condition and active/passive interaction. The most common way of delivering ISC was through video, but alternative ISC strategies were also effective. All interventions included recovery or personal experience, which seems to be an important part of ISC in LMICs.

ISC, specifically when paired with education strategies, is an effective approach for reducing mental health-related stigma in LMICs among the general population, healthcare workers and community leaders. At the moment, interventions with only ISC showed mixed or no significant changes in stigma. Active and passive interaction of participants with ISC needs to be explored further to reach more conclusive evidence. Thus, there is currently no conclusive evidence regarding the association between ICS intervention duration and effectiveness.

Our proposed definition of ISC can be refined further through consistency and clarity of future research.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S2045796022000622.

Data

For access to data supporting this study, please email Akerke Makhmud: or .

Acknowledgements

We would like to thank Jun Angelo Sunglao and Dr Sara Zarti for their support when screening the papers and quality reviewing papers.

Financial support

G. T. is supported by the National Institute for Health Research (NIHR) Applied Research Collaboration South London at King's College London NHS Foundation Trust, by the NIHR Asset Global Health Unit award and the NIHR Hope Global Health Group award. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care. G. T. is also supported by the Guy's and St Thomas' Charity for the On Trac project (EFT151101), and by the UK Medical Research Council (UKRI) in relation to the Emilia (MR/S001255/1) and Indigo Partnership (MR/R023697/1) awards. P. C. G. is supported by the UK Medical Research Council (UKRI) in relation to the Indigo Partnership (MR/R023697/1) award.

Conflict of interest

None.

Ethical standards

Ethics approval was not required for this systematic review.

References

Aliev, A-A, Roberts, T, Magzumova, S, Panteleeva, L, Yeshimbetova, S, Krupchanka, D, Sartorius, N, Thornicroft, G and Winkler, P (2021) Widespread collapse, glimpses of revival: a scoping review of mental health policy and service development in Central Asia. Social Psychiatry and Psychiatric Epidemiology 56(2), 112.CrossRefGoogle ScholarPubMed
Ando, S, Clement, S, Barley, EA and Thornicroft, G (2011) The simulation of hallucinations to reduce the stigma of schizophrenia: a systematic review. Schizophrenia Research 133, 816.CrossRefGoogle ScholarPubMed
Arthur, YA, Boardman, GH, Morgan, AJ and Mccann, TV (2020 a) Cluster randomised controlled trial of a problem-solving, story-bridge mental health literacy programme for improving Ghanaian community leaders’ knowledge of depression. Journal of Mental Health, 19. doi: 10.1080/09638237.2020.1793122CrossRefGoogle ScholarPubMed
Arthur, YA, Boardman, GH, Morgan, AJ and Mccann, TV (2020 b) Effectiveness of a problem-solving, story-bridge mental health literacy programme in improving Ghanaian community leaders’ attitudes towards people with mental illness: a cluster randomised controlled trial. Issues in Mental Health Nursing 42(4), 114.Google ScholarPubMed
Clay, J, Eaton, J, Gronholm, P, Semrau, M and Votruba, N (2020) Core components of mental health stigma reduction interventions in low-and middle-income countries: a systematic review. Epidemiology and Psychiatric Sciences 29, e164.CrossRefGoogle ScholarPubMed
Clement, S, Brohan, E, Sayce, L, Pool, J and Thornicroft, G (2011) Disability hate crime and targeted violence and hostility: a Mental Health and Discrimination Perspective. Journal of Mental Health 20(3), 219225.CrossRefGoogle ScholarPubMed
Clement, S, Van Nieuwenhuizen, A, Kassam, A, Flach, C, Lazarus, A, De Castro, M, Mccrone, P, Norman, I and Thornicroft, G (2012) Filmed v. live social contact interventions to reduce stigma: randomised controlled trial. The British Journal of Psychiatry: The Journal of Mental Science 201, 57.CrossRefGoogle ScholarPubMed
Clement, S, Lassman, F, Barley, E, Evans-Lacko, S, Williams, P, Yamaguchi, S, Slade, M, Rüsch, N and Thornicroft, G (2013) Mass media interventions for reducing mental health-related stigma. Cochrane Database of Systematic Reviews.7), Article number: CD009453.CrossRefGoogle ScholarPubMed
Clement, S, Schauman, O, Graham, T, Maggioni, F, Evans-Lacko, S, Bezborodovs, N, Morgan, C, Rüsch, N, Brown, JS and Thornicroft, G (2015) What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychological Medicine 45, 1127.CrossRefGoogle ScholarPubMed
Corrigan, PW, River, LP, Lundin, RK, Penn, DL, Uphoff-Wasowski, K, Campion, J, Mathisen, J, Gagnon, C, Bergman, M and Goldstein, H (2001) Three strategies for changing attributions about severe mental illness. Schizophrenia Bulletin 27, 187195.CrossRefGoogle ScholarPubMed
Corrigan, PW, Watson, AC and Barr, L (2006) The self-stigma of mental illness: implications for self-esteem and self-efficacy. Journal of Social and Clinical Psychology 25, 875884.CrossRefGoogle Scholar
Corrigan, PW, Morris, SB, Michaels, PJ, Rafacz, JD and Rüsch, N (2012) Challenging the public stigma of mental illness: a meta-analysis of outcome studies. Psychiatric Services 63, 963973.CrossRefGoogle ScholarPubMed
De Sousa, A, Mohandas, E and Javed, A (2020) Psychological interventions during COVID-19: challenges for low and middle income countries. Asian Journal of Psychiatry 51, 102128.CrossRefGoogle ScholarPubMed
Evans-Lacko, S, Little, K, Meltzer, H, Rose, D, Rhydderch, D, Henderson, C and Thornicroft, G (2010) Development and psychometric properties of the mental health knowledge schedule. The Canadian Journal of Psychiatry 55, 440448.CrossRefGoogle ScholarPubMed
Evans-Lacko, S, Rose, D, Little, K, Flach, C, Rhydderch, D, Henderson, C and Thornicroft, G (2011) Development and psychometric properties of the reported and intended behaviour scale (RIBS): a stigma-related behaviour measure. Epidemiology and Psychiatric Sciences 20, 263271.CrossRefGoogle ScholarPubMed
Fernandez, A, Tan, K-A, Knaak, S, Chew, BH and Ghazali, SS (2016) Effects of brief psychoeducational program on stigma in Malaysian pre-clinical medical students: a randomized controlled trial. Academic Psychiatry 40, 905911.CrossRefGoogle ScholarPubMed
Finkelstein, J, Lapshin, O and Wasserman, E (2008) Randomized study of different anti-stigma media. Patient Education and Counseling 71, 204214.CrossRefGoogle ScholarPubMed
Gonçalves, M, Moleiro, C and Cook, B (2015) The use of a video to reduce mental health stigma among adolescents. Adolescent Psychiatry 5, 204211.CrossRefGoogle Scholar
Gonsalves, PP, Hodgson, ES, Michelson, D, Pal, S, Naslund, J, Sharma, R and Patel, V (2019) What are young Indians saying about mental health? A content analysis of blogs on the It's Ok To Talk website. BMJ Open 9, e028244.CrossRefGoogle ScholarPubMed
Gronholm, PC, Thornicroft, G, Laurens, KR and Evans-Lacko, S (2017) Mental health-related stigma and pathways to care for people at risk of psychotic disorders or experiencing first-episode psychosis: a systematic review. Psychological Medicine 47, 18671879.CrossRefGoogle ScholarPubMed
Gürbüz, AA, Yorulmaz, O and Durna, G (2020) Reducing the social stigma associated with obsessive compulsive disorder: a controlled trial of an intervention program in a Turkish community sample. Journal of Evidence-Based Psychotherapies 20, 101120.CrossRefGoogle Scholar
Hartog, K, Hubbard, CD, Krouwer, AF, Thornicroft, G, Kohrt, BA and Jordans, MJ (2020) Stigma reduction interventions for children and adolescents in low-and middle-income countries: systematic review of intervention strategies. Social Science & Medicine 246, 112749.CrossRefGoogle ScholarPubMed
Heim, E, Kohrt, B, Koschorke, M, Milenova, M and Thornicroft, G (2020) Reducing mental health-related stigma in primary health care settings in low-and middle-income countries: a systematic review. Epidemiology and Psychiatric Sciences 29, e42.CrossRefGoogle Scholar
Hong, QN, Fàbregues, S, Bartlett, G, Boardman, F, Cargo, M, Dagenais, P, Gagnon, M-P, Griffiths, F, Nicolau, B and O'cathain, A (2018) The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Education for Information 34, 285291.CrossRefGoogle Scholar
Janoušková, M, Tušková, E, Weissová, A, Trančík, P, Pasz, J, Evans-Lacko, S and Winkler, P (2017) Can video interventions be used to effectively destigmatize mental illness among young people? A systematic review. European Psychiatry 41, 19.CrossRefGoogle ScholarPubMed
Kaur, A, Kallakuri, S, Kohrt, BA, Heim, E, Gronholm, PC, Thornicroft, G and Maulik, PK (2020) Systematic review of interventions to reduce mental health stigma in India. Asian Journal of Psychiatry 55, 102466.CrossRefGoogle ScholarPubMed
Koschorke, M, Evans-Lacko, S, Sartorius, N and Thornicroft, G (2017) Stigma in Different Cultures. The Stigma of Mental Illness-End of the Story?. Springer, pp. 6782.CrossRefGoogle Scholar
Kosyluk, K, Marshall, J, Conner, K, Macias, DR, Macias, S, Michelle Beekman, B and Her, J (2021) Challenging the stigma of mental illness through creative storytelling: a randomized controlled trial of this is my brave. Community Mental Health Journal 57, 144152.CrossRefGoogle ScholarPubMed
London, J and Evans-Lacko, SE (2010) Challenging mental health-related stigma through social contact. European Journal of Public Health 20, 130131.CrossRefGoogle ScholarPubMed
Maulik, PK, Devarapalli, S, Kallakuri, S, Tewari, A, Chilappagari, S, Koschorke, M and Thornicroft, G (2017) Evaluation of an anti-stigma campaign related to common mental disorders in rural India: a mixed methods approach. Psychological Medicine 47, 565575.CrossRefGoogle ScholarPubMed
Maulik, PK, Devarapalli, S, Kallakuri, S, Tripathi, AP, Koschorke, M and Thornicroft, G (2019) Longitudinal assessment of an anti-stigma campaign related to common mental disorders in rural India. The British Journal of Psychiatry 214, 9095.CrossRefGoogle ScholarPubMed
Maunder, RD and White, FA (2019) Intergroup contact and mental health stigma: a comparative effectiveness meta-analysis. Clinical Psychology Review 72, 101749.CrossRefGoogle ScholarPubMed
Mehta, N, Clement, S, Marcus, E, Stona, A-C, Bezborodovs, N, Evans-Lacko, S, Palacios, J, Docherty, M, Barley, E and Rose, D (2015) Evidence for effective interventions to reduce mental health-related stigma and discrimination in the medium and long term: systematic review. The British Journal of Psychiatry 207, 377384.CrossRefGoogle ScholarPubMed
Michalak, E, Livingston, J, Maxwell, V, Hole, R, Hawke, L and Parikh, S (2014) Using theatre to address mental illness stigma: a knowledge translation study in bipolar disorder. International Journal of Bipolar Disorders 2, 112.CrossRefGoogle ScholarPubMed
Moreno, C, Wykes, T, Galderisi, S, Nordentoft, M, Crossley, N, Jones, N, Cannon, M, Correll, CU, Byrne, L and Carr, S (2020) How mental health care should change as a consequence of the COVID-19 pandemic. The Lancet Psychiatry 7(9), 813824.CrossRefGoogle ScholarPubMed
Morgan, AJ, Reavley, NJ, Ross, A, San Too, L and Jorm, AF (2018) Interventions to reduce stigma towards people with severe mental illness: systematic review and meta-analysis. Journal of Psychiatric Research 103, 120133.CrossRefGoogle ScholarPubMed
Naslund, JA and Deng, D (2021) Addressing mental health stigma in low-income and middle-income countries: a new frontier for digital mental health. Ethics, Medicine and Public Health 19, 100719.CrossRefGoogle ScholarPubMed
Ng, YP, Rashid, A and O'brien, F (2017) Determining the effectiveness of a video-based contact intervention in improving attitudes of Penang primary care nurses towards people with mental illness. PLoS ONE 12, e0187861.CrossRefGoogle ScholarPubMed
Paolini, S, White, FA, Tropp, LR, Turner, RN, Page-Gould, E, Barlow, FK, Gomez, A, Borinca, I, Vezzali, L, Reynolds, KJ, Blomster Lyshol, JK, Verrelli, S and Falomir-Pichastor, JM (2021) Beyond direct contact: the theoretical and societal relevance of indirect contact for improving intergroup relations. (Report). Journal of Social Issues 77, 132.Google Scholar
Patten, SB, Remillard, A, Phillips, L, Modgill, G, Szeto, AC, Kassam, A and Gardner, DM (2012) Effectiveness of contact-based education for reducing mental illness-related stigma in pharmacy students. BMC Medical Education 12, 19.CrossRefGoogle ScholarPubMed
Pescosolido, BA and Martin, JK (2015) The stigma complex. Annual Review of Sociology 41, 87116.CrossRefGoogle ScholarPubMed
Potts, LC and Henderson, C (2021) Evaluation of anti-stigma social marketing campaigns in Ghana and Kenya: Time to Change Global. BMC Public Health 21, 114.CrossRefGoogle ScholarPubMed
Rao, D, Elshafei, A, Nguyen, M, Hatzenbuehler, ML, Frey, S and Go, VF (2019) A systematic review of multi-level stigma interventions: state of the science and future directions. BMC Medicine 17, 111.CrossRefGoogle ScholarPubMed
Ritsher, JB, Otilingam, PG and Grajales, M (2003) Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Research 121, 3149.CrossRefGoogle ScholarPubMed
Rüsch, N, Angermeyer, MC and Corrigan, PW (2005) Mental illness stigma: concepts, consequences, and initiatives to reduce stigma. European Psychiatry 20, 529539.CrossRefGoogle ScholarPubMed
Saraceno, B, Van Ommeren, M, Batniji, R, Cohen, A, Gureje, O, Mahoney, J, Sridhar, D and Underhill, C (2007) Barriers to improvement of mental health services in low-income and middle-income countries. The Lancet 370, 11641174.CrossRefGoogle ScholarPubMed
Semrau, M, Evans-Lacko, S, Koschorke, M, Ashenafi, L and Thornicroft, G (2015) Stigma and discrimination related to mental illness in low- and middle-income countries. Epidemiology and Psychiatric Sciences 24, 382394.CrossRefGoogle ScholarPubMed
Sharac, J, Mccrone, P, Clement, S and Thornicroft, G (2010) The economic impact of mental health stigma and discrimination: a systematic review. Epidemiology and Psychiatric Sciences 19, 223232.CrossRefGoogle ScholarPubMed
Tergesen, CL, Gurung, D, Dhungana, S, Risal, A, Basel, P, Tamrakar, D, Amatya, A, Park, LP and Kohrt, BA (2021) Impact of service user video presentations on explicit and implicit stigma toward mental illness among medical students in Nepal: a randomized controlled trial. International Journal of Environmental Research and Public Health 18, 2143.CrossRefGoogle ScholarPubMed
Thomas, J and Harden, A (2008) Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Medical Research Methodology 8, 110.CrossRefGoogle ScholarPubMed
Thornicroft, G, Rose, D, Kassam, A and Sartorius, N (2007) Stigma: ignorance, prejudice or discrimination? The British Journal of Psychiatry 190, 192193.CrossRefGoogle ScholarPubMed
Thornicroft, G, Brohan, E, Rose, D, Sartorius, N, Leese, M and Group IS (2009) Global pattern of experienced and anticipated discrimination against people with schizophrenia: a cross-sectional survey. The Lancet 373, 408415.CrossRefGoogle ScholarPubMed
Thornicroft, G, Mehta, N, Clement, S, Evans-Lacko, S, Doherty, M, Rose, D, Koschorke, M, Shidhaye, R, O'reilly, C and Henderson, C (2016) Evidence for effective interventions to reduce mental-health-related stigma and discrimination. The Lancet 387, 11231132.CrossRefGoogle ScholarPubMed
Vaghee, S, Salarhaji, A and Vaghei, N (2015) Comparing the effect of in our own voice-family with psychoeducation on stigma in families of schizophrenia patients. Nursing Practice Today 2, 139151.Google Scholar
Vigo, D, Thornicroft, G and Gureje, O (2020) The differential outcomes of coronavirus disease 2019 in low-and middle-income countries vs high-income countries. JAMA Psychiatry 77, 12071208.CrossRefGoogle ScholarPubMed
Winkler, P, Krupchanka, D, Roberts, T, Kondratova, L, Machů, V, Höschl, C, Sartorius, N, Van Voren, R, Aizberg, O and Bitter, I (2017) A blind spot on the global mental health map: a scoping review of 25 years’ development of mental health care for people with severe mental illnesses in central and eastern Europe. The Lancet Psychiatry 4, 634642.CrossRefGoogle ScholarPubMed
Wolff, G, Pathare, S, Craig, T and Leff, J (1996) Community attitudes to mental illness. The British Journal of Psychiatry 168, 183190.CrossRefGoogle ScholarPubMed
Yang, LH, Kleinman, A, Link, BG, Phelan, JC, Lee, S and Good, B (2007) Culture and stigma: adding moral experience to stigma theory. Social Science & Medicine 64, 15241535.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. PRISMA flow diagram of selection of papers.

Figure 1

Table 1. Key characteristics of included studies

Figure 2

Table 2. Summary of the study quality evaluated with MMAT

Supplementary material: File

Makhmud et al. supplementary material

Makhmud et al. supplementary material

Download Makhmud et al. supplementary material(File)
File 71 KB