Since the vaccine roll out, research has focused on vaccine safety and efficacy, with large clinical trials confirming that vaccines are generally effective against symptomatic COVID-19 infection. However, breakthrough infections can still occur, and the effectiveness of vaccines against transmission from infected vaccinated people to susceptible contacts is unclear.

Health Technology Wales (HTW) collaborated with the Wales COVID-19 Evidence Centre to identify and examine evidence on the transmission risk of SARS-CoV-2 from vaccinated people to unvaccinated or vaccinated people.

We conducted a systematic literature search for evidence on vaccinated people exposed to SARS-CoV-2 in any setting. Outcome measures included transmission rate, cycle threshold (Ct) values and viral load. We identified a rapid review by the University of Calgary that was the main source of our outcome data. Nine studies published following the rapid review were also identified and included.

In total, 35 studies were included in this review: one randomized controlled trial (RCT), one post-hoc analysis of an RCT, 13 prospective cohort studies, 16 retrospective cohort studies and four case control studies.

All studies reported a reduction in transmission of the B.1.1.7 (Alpha) variant from partial and fully vaccinated individuals. More recent evidence is uncertain on the effects of vaccination on transmission of the B.1.617.2 (Delta) variant. Overall, vaccine effectiveness in reducing transmission appears to increase with full vaccination, compared with partial vaccination. Most of the direct evidence is limited to transmission in household settings therefore, there is a gap in the evidence on risk of transmission in other settings. One UK study found protection against onward transmission waned within 3 months post second vaccination.

Early findings that focused on the alpha variant, showed a reduction in transmission from vaccinated people. There is limited evidence on the effectiveness of vaccination on transmission of the Delta variant, therefore alternative preventative measures to reduce transmission may still be required.

At various stages of the COVID-19 pandemic, face coverings have been recommended and encouraged as one of the interventions to reduce transmission of the SARS-CoV-2 virus. However, in the earlier stages of the pandemic, decisions on face coverings relied primarily on evidence based on other viral respiratory infections. More direct evidence on the use of face coverings with COVID-19 developed in tandem with the pandemic.

Health Technology Wales undertook an ultra-rapid review to inform national guidelines, the work assessed the evidence on the effectiveness of face coverings to reduce SARS-CoV-2 transmission. We also reviewed evidence on the efficacy of different types of face coverings.

We conducted a systematic literature search for evidence to address (i) the effectiveness of face coverings to reduce the spread of COVID-19 in the community, and (ii) the efficacy of different types of face coverings designed for use in community settings. We identified a rapid review in 2021 by Public Health England that closely aligned with our review questions. This provided the main source for identifying relevant studies, supplemented by a search for publications following their search date.

We identified two evidence reviews (including the Public Health England review) that examined the effectiveness of face coverings on reducing transmission of SARS-CoV-2; reporting on 31 and 39 studies, respectively. Two further primary studies were published after the two evidence review searches were included. Overall, the evidence suggested that face coverings may provide benefits in preventing SARS-CoV-2 transmission, although the higher-quality studies suggested that these benefits may be modest. Medical masks appeared to have higher efficacy than fabric masks, although the evidence was mixed.

At the time of this review, evidence on the effectiveness of face coverings remains limited and conclusions rely on low-quality sources of evidence with high risk of bias, although higher-quality evidence points to some benefit. Face coverings may play a role in preventing transmission of SARS-CoV-2, particularly as part of a bundle of other preventative measures.

The COVID-19 pandemic has had a dramatic impact on the health and social care landscape, both in terms of service provision and citizen need. Responsive, evidence-based research is essential to develop and implement appropriate policies and practices that manage both the pandemic itself, and the impact COVID-19 has on other health and social care issues.

To address this, the Wales COVID-19 Evidence Centre (WCEC) was launched in 2021 with the aim of providing the best available, up-to-date, and relevant evidence to inform health and care decision making across Wales.

Funded by the Welsh Government, the WCEC comprises of a core team and several collaborating partner organizations, including Health Technology Wales, Wales Centre for Evidence-Based Care, Specialist Unit for Review Evidence Centre, SAIL Databank, Public Health Wales, Bangor Institute for Health & Medical Research in conjunction with Health and Care Economics Cymru, and the Public Health Wales Observatory. Over the last year, WCEC has developed its rapid review processes and methodology informed by best international practice and aims to provide around 50 reviews each year. WCEC works alongside various stakeholder groups from health and social care across Wales, and they form an integral part of the review process, from scoping to knowledge mobilization.

To date, the WCEC has produced reviews on a diverse range of COVID-19 topics, including transmission, vaccination uptake (barriers, facilitators and interventions), mental health and wellbeing, as well as face coverings and other preventative interventions. The topics have also covered a wide range of populations, from general public, to healthcare workers, to children. These reviews have been used to inform policy and decision-making, including the Welsh Government’s Chief Medical Officer 21-day COVID-19 reviews.

The WCEC has brought together multiple specialist centers with a diverse range of skills to produce timely reviews of the most up-to-date research to support decision makers across health and social care. These reviews have informed policy and decision-making across Wales.

Evaluating the impact of health technology assessment (HTA) is vital to measure its contribution to health and social care decision-making and improving citizen outcomes. Health Technology Wales (HTW) is a HTA body committed to evaluating the impact of our work. Here we present HTW’s impact evaluation approach with a case study for autologous hematopoietic stem cell transplantation (AHSCT) for highly active relapsing remitting multiple sclerosis (RRMS).

Using an outcomes-focused approach based on contribution analysis, HTW has worked with an external evaluation organization to develop a framework to measure the impact of our work. Data on impact was collected from both qualitative and quantitative sources, including social media metrics, surveys, and informal feedback from stakeholders. We engaged with various stakeholders, including clinicians, academics, patient organizations and other HTA bodies.

The technology appraisal and guidance were published in July 2020, recommending AHSCT for routine adoption to treat highly active RRMS. Patient groups welcomed the appraisal findings as an important step forward in recognising the needs of people with RRMS and felt that “people living with MS were listened to throughout the process”. Following publication online, the guidance has had approximately 500 views, and featured on the MS Trust website and in several news articles. The Welsh Health Specialist Services Committee, a commissioning body in Wales, recommended AHSCT for RRMS as a ‘high priority’ for funding in the WHSSC Integrated Commissioning Plan 2021-22.

Since its publication, we have been able to prospectively capture the impact of this guidance through various stakeholders groups and sources. Overall, responses have been positive and the guidance has supported decision makers in Wales. Ongoing evidence capture, including through HTW’s adoption audit processes, will add further understanding to the potential impact of our work.

Health Technology Wales (HTW) is committed to evaluating the impact of our work. In March 2020, HTW directed efforts to support Welsh Government and health and social care providers in response to the COVID-19 pandemic. We adapted the HTW evaluation framework to specifically capture the impact of our additional COVID-19 work. Here we analyze data collected since the framework was implemented.

Both formal and informal feedback was analyzed. Formal feedback was obtained through the HTW Impact Questionnaire, which was developed to support more formalized data capture for all HTW workstreams and to facilitate feedback from all stakeholder groups. It was piloted with a targeted list of individuals and responses were received for COVID-19 work. Informal feedback included feedback received via email or through word of mouth.

HTW COVID-19 products to date include Topic Exploration Reports, rapid evidence summaries and an Evidence Appraisal Report (EAR) on COVID-19 diagnostic tests (molecular and antibody tests). Stakeholders were positive about these outputs, describing them as valuable and informative. Reported impacts included informing policy and decision making, reducing duplication of efforts and helping to target development. The EAR received national and international focus, leading to HTW involvement in the European Network for Health Technology Assessment (EUnetHTA) COVID-19 reviews. Survey participants who gave feedback on COVID-19 activities included two members of Health Technology Assessment organizations, a health board representative and an industry representative; all agreed that HTW's COVID-19 work was useful, that the methods were reliable and robust and that HTW is responsive. All participants also felt that HTW's COVID-19 work had a positive impact in the wider health and social care context.

HTW was able to respond rapidly to the COVID-19 pandemic and adapt current evaluation practices to capture the impact of COVID-19 work. We will continue to evaluate our COVID-19 activities. Future work will involve following up on the developing impact of our COVID-19 work and expanding our methods for data capture, for example conducting stakeholder interviews.

Wales has ambitious health, wealth, and innovation policies and a clear goal to use the economic muscle of the Welsh National Health Service (NHS) to support its strong life sciences sector. Health Technology Wales (HTW) has a clear remit to appraise technologies over the span of their lifecycle from innovation to obsolescence. HTW is collaborating with the Bevan Commission through their national Health Technology Exemplars (HTEs), which partners NHS and industry stakeholders to strengthen innovation within the Welsh health system.

Health technology assessment (HTA) methods were used to produce topic exploration reports for assessing the evidence underpinning applicant innovations. A “Dragons’ Den” expert panel was convened to select the successful HTEs.

Fourteen Bevan HTEs were awarded funds, which were matched by industry partners. Application of HTA methods resulted in more critical consideration of technology value propositions, including: developing pull models of innovation focused on delivering health technology solutions for current problems facing NHS Wales; supporting early dialogue between the NHS and industry partners around demonstrating evidence of improved patient outcomes; and focusing on transformative rather than incremental innovation. The most promising innovations will progress to rapid HTA, where the evidence generated will be used to develop guidance for NHS Wales.

HTA methods were productively deployed at the innovation phase of the technology lifecycle to support evidence-informed allocation of scarce innovation resources. In this way, HTW is working with key stakeholders to identify and offer early support to the most promising innovations, with the aim of expediting their adoption and realizing health benefits for patients as quickly as possible. The Bevan Commission has partnered with HTW to routinely build in HTA and evidence considerations in its future innovation calls and competitions. Thus, HTW has established a “feeder” pipeline for assessing bottom-up service-led innovations and encouraging evidence consideration throughout the lifecycle of innovative technologies.

Health Technology Wales (HTW) is a relatively new Health Technology Assessment (HTA) agency which focuses on non-medicines. In common with other HTA organizations, it identifies and appraises a range of technologies. However, HTW is also looking beyond the publication of guidance, to assess the adoption of advice and its eventual impact.

HTW commissioned development of an Evaluation Plan from independent experts (Matter of Focus). A literature review was carried out to inform an options appraisal of methods for assessing impact. The selected approach was Contribution Analysis, which estimates the counterfactual through engagement of stakeholders.

Whilst it is too early to report the full impact of HTW's guidance, a number of activities have taken place to prepare for evaluation. The core HTW team developed a series of logic models to describe the anticipated impact, the mechanisms by which it would be achieved, and key assumptions. Stakeholders were consulted for insight from a range of perspectives, and to manage expectations. This was achieved through individual interviews, presentation and discussion at committee meetings, and the sharing of written materials for feedback. This information was collated to populate bespoke software (OutNav). The collection of data relating to processes, outputs and outcomes is already an ongoing routine task of researchers and support staff.

HTW has an opportunity to build impact evaluation into its culture from the beginning. This will facilitate the future reporting of HTW's influence using a well-designed, evidence-based approach. Furthermore, this pioneering work will clearly demonstrate the value of HTA to funders, commissioners, governments, and other decision-making bodies.

Effective communication is vital for engaging stakeholders in health technology assessment (HTA), as well as the successful dissemination and adoption of HTA research and guidance. As a relatively new organization, Health Technology Wales (HTW) has an ideal opportunity to take an effective, strategic approach to communication and stakeholder engagement from the outset.

HTW commissioned Pagoda Public Relations to develop an informed communications strategy and delivery framework. The strategy used OASIS methodology for public relations planning: Objectives, Audience insight, Strategy, Implementation, and Scoring (evaluation). Initial objectives were developed with input from the HTW team and members of the HTW Assessment Group and Appraisal Panel. Stakeholder insights were collected through an online survey and telephone interviews. These insights were used to inform the communications strategy and framework, outlining key audiences, key messages, communication objectives, methods, tactics, and evaluations.

Seven key objectives were identified, each of which were supported by recommended actions. These were underpinned by the key aims and messages reflecting how we will achieve these objectives. National Health Service boards, government, clinicians, the technology and research sector, patients, and the general public were identified as priority audiences. Various different communication channels and activities were identified, aimed at various audiences. These included the website, social media, traditional media, and exhibitions or workshops, as well as targeted e-mail dissemination of guidance. Evaluation of HTW communications will be aligned with the wider HTW evaluation strategy, and evidence will be recorded through OutNav software (Matter of Focus Ltd).

HTW is committed to a strategic, effective approach to communication and engagement. We now have an audience-informed communications strategy and plan that outlines our key objectives, and how to achieve and evaluate these objectives. Successful implementation will raise awareness of and value in profile and outputs of HTW, both in Wales and internationally.