Hostname: page-component-8448b6f56d-42gr6 Total loading time: 0 Render date: 2024-04-20T04:28:57.244Z Has data issue: false hasContentIssue false

The long-term effectiveness of coronavirus disease 2019 (COVID-19) vaccines: A systematic literature review and meta-analysis

Published online by Cambridge University Press:  14 February 2022

Alexandre R. Marra*
Affiliation:
Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa, United States Instituto Israelita de Ensino e Pesquisa Albert Einstein, Hospital Israelita Albert Einstein, São Paulo, Brazil Center for Access & Delivery Research & Evaluation (CADRE), Iowa City Veterans’ Affairs Health Care System, Iowa City, Iowa, United States
Takaaki Kobayashi
Affiliation:
Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa, United States
Hiroyuki Suzuki
Affiliation:
Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa, United States Center for Access & Delivery Research & Evaluation (CADRE), Iowa City Veterans’ Affairs Health Care System, Iowa City, Iowa, United States
Mohammed Alsuhaibani
Affiliation:
Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa, United States Department of Pediatrics, College of Medicine, Qassim University, Qassim, Saudi Arabia
Marin L. Schweizer
Affiliation:
Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa, United States Center for Access & Delivery Research & Evaluation (CADRE), Iowa City Veterans’ Affairs Health Care System, Iowa City, Iowa, United States
Daniel J. Diekema
Affiliation:
Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa, United States
Bruna Marques Tofaneto
Affiliation:
Albert Einstein Medical College, São Paulo, Brazil
Luigi Makowski Bariani
Affiliation:
Albert Einstein Medical College, São Paulo, Brazil
Mariana de Amorim Auler
Affiliation:
Albert Einstein Medical College, São Paulo, Brazil
Jorge L. Salinas
Affiliation:
Stanford University, Stanford, California, United States
Michael B. Edmond
Affiliation:
West Virginia University School of Medicine, Morgantown, West Virginia, United States
João Renato Rebello Pinho
Affiliation:
Research and Development Sector, Clinical Laboratory, Hospital Israelita Albert Einstein, São Paulo, Brazil
Luiz Vicente Rizzo
Affiliation:
Instituto Israelita de Ensino e Pesquisa Albert Einstein, Hospital Israelita Albert Einstein, São Paulo, Brazil
*
Author for correspondence: Alexandre R. Marra, MD, University of Iowa Hospitals and Clinics, C51 GH, 200 Hawkins Drive, Iowa City, IA52242. E-mail: alexandre-rodriguesmarra@uiowa.edu

Abstract

Background:

Although multiple studies revealed high vaccine effectiveness of coronavirus disease 2019 (COVID-19) vaccines within 3 months after the completion of vaccines, long-term vaccine effectiveness has not been well established, especially after the δ (delta) variant became prominent. We performed a systematic literature review and meta-analysis of long-term vaccine effectiveness.

Methods:

We searched PubMed, CINAHL, EMBASE, Cochrane Central Register of Controlled Trials, Scopus, and Web of Science from December 2019 to November 15, 2021, for studies evaluating the long-term vaccine effectiveness against laboratory-confirmed COVID-19 or COVID-19 hospitalization among individuals who received 2 doses of Pfizer/BioNTech, Moderna, or AstraZeneca vaccines, or 1 dose of the Janssen vaccine. Long-term was defined as >5 months after the last dose. We calculated the pooled diagnostic odds ratio (DOR) with 95% confidence interval for COVID-19 between vaccinated and unvaccinated individuals. Vaccine effectiveness was estimated as 100% × (1 − DOR).

Results:

In total, 16 studies including 17,939,172 individuals evaluated long-term vaccine effectiveness and were included in the meta-analysis. The pooled DOR for COVID-19 was 0.158 (95% CI: 0.157-0.160) with an estimated vaccine effectiveness of 84.2% (95% CI, 84.0- 84.3%). Estimated vaccine effectiveness against COVID-19 hospitalization was 88.7% (95% CI, 55.8%–97.1%). Vaccine effectiveness against COVID-19 during the δ variant period was 61.2% (95% CI, 59.0%–63.3%).

Conclusions:

COVID-19 vaccines are effective in preventing COVID-19 and COVID-19 hospitalization across a long-term period for the circulating variants during the study period. More observational studies are needed to evaluate the vaccine effectiveness of third dose of a COVID-19 vaccine, the vaccine effectiveness of mixing COVID-19 vaccines, COVID-19 breakthrough infection, and vaccine effectiveness against newly emerging variants.

Type
Review
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America

The first coronavirus disease 2019 (COVID-19) vaccine was authorized for emergency use by the US Food and Drug Administration on December 11, 2020. Reference Polack, Thomas and Kitchin1 Over the past several months, research studies have yielded substantial data on short-term (≤ 3 months) vaccine effectiveness Reference Dagan, Barda and Kepten2Reference Marra, Kobayashi and Suzuki4 against symptomatic COVID-19. For example, the short-term vaccine effectiveness is known to be very high at 95% for the Pfizer/BioNTech COVID-19 vaccine, 94.1% for the Moderna vaccine, 70.4% for the AstraZeneca vaccine, and 66.3% for the Janssen COVID-19 vaccine. Reference Polack, Thomas and Kitchin1,Reference Voysey, Clemens and Madhi5Reference Sadoff, Gray and Vandebosch7

In the third year of the pandemic, individuals are still at risk of acquiring COVID-19 even with vaccines available. Reference Brown, Vostok and Johnson8,Reference Glatman-Freedman, Hershkovitz, Kaufman, Dichtiar, Keinan-Boker and Bromberg9 Infection and hospitalization rates among unvaccinated individuals are 5 times and 11–29 times higher than those in vaccinated individuals, respectively. Reference Griffin, Haddix and Danza10,11 Also, the authorized COVID-19 vaccines protect against the δ variant, Reference Lopez Bernal, Andrews and Gower12 even with increased community transmission. Reference Griffin, Haddix and Danza10,Reference Lopez Bernal, Andrews and Gower13

Although these vaccines are effective for a wide range of COVID-19–related outcomes, Reference Polack, Thomas and Kitchin1,Reference Baden, El Sahly and Essink6,Reference Tenforde, Patel and Ginde14,Reference Pilishvili, Gierke and Fleming-Dutra15 the duration of the immune protection following the COVID-19 vaccination is still not well defined, Reference Rossi, Lanuti and Cicalini16Reference Bayart, Douxfils and Gillot18 and few studies have assessed the long-term vaccine effectiveness of COVID-19 vaccines.

We reviewed the literature on the long-term vaccine effectiveness of COVID-19 vaccines for COVID-19 and COVID-19 hospitalizations. Pooling the results of published studies allows for more precise estimates of the long-term vaccine effectiveness. The information provided from subset analyses during the δ variant period is significantly important given the ongoing pandemic with this variant.

Methods

Systematic literature review and inclusion and exclusion criteria

This review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement Reference Moher, Liberati, Tetzlaff and Altman19 and the Meta-analysis of Observational Studies in Epidemiology (MOOSE) guidelines, Reference Stroup, Berlin and Morton20 and it was registered on Prospero (https://www.crd.york.ac.uk/PROSPERO/) on September 13, 2021 (registration no. CRD42021278162). The approval of our institutional review board was not required.

The inclusion criteria for studies in this systematic review were as follows: original research manuscripts; published in peer-reviewed scientific journals; involved vaccinated and unvaccinated individuals; evaluated the long-term effectiveness of COVID-19 vaccine; and observational study design. Long-term was defined as >5 months after the second dose for mRNA (Pfizer/BioNTech or Moderna) or AstraZeneca COVID-19 vaccine, or 1 dose of Janssen COVID-19 vaccine. The literature search was limited to December 2019 to November 15, 2021. Editorials, commentaries, and published studies from non–peer-reviewed sources (eg, MedRxiv) were excluded. Studies without comparison between vaccinated and unvaccinated individuals (or other vaccinated control group), and studies without vaccine effectiveness data were also excluded.

Search strategy

We performed literature searches in PubMed, Cumulative Index to Nursing and Allied Health (CINAHL), Embase (Elsevier Platform), Cochrane Central Register of Controlled Trials, Scopus (which includes EMBASE abstracts), and Web of Science. The entire search strategy is described in Supplementary Appendix 1. We reviewed the reference lists of retrieved articles to identify studies that were not identified from the preliminary literature searches. After applying exclusion criteria, we reviewed 55 papers, 17 of which met the inclusion criteria and were included in the systematic literature review (Fig. 1).

Fig. 1. Literature search for articles on the long-term COVID-19 vaccine effectiveness among general population.

Data abstraction and quality assessment

Titles and abstracts of all articles were screened to assess whether they met inclusion criteria. The reviewers (A.R.M., B.M.T., H.S., L.M.B., M.A., M.A.A., and T.K.) abstracted data for each article. Reviewers resolved disagreements by consensus.

The reviewers abstracted data on study design, population and location, study period (months) and the calendar time, demographic and characteristics of participants, types of COVID-19 vaccine, and the date of whole-genome sequencing if available. Laboratory-confirmed COVID-19 was considered the primary outcome to calculate vaccine effectiveness after 2 doses of a COVID-19 vaccine. COVID-19 hospitalization was considered as a secondary outcome. We collected the hazard ratio (HR), the relative risk (RR), the odds ratio (OR), and vaccine effectiveness with 95% confidence intervals (CIs). We have also described the statistical analysis performed per each study to describe the estimated COVID-19 vaccine effectiveness. Risk of bias was assessed using the Downs and Black scale. Reference Downs and Black21 Reviewers followed all questions from this scale as written except for question 27 (a single item on the power subscale scored 0–5), which was changed to a yes or no. Two authors performed component quality analyses independently, reviewed all inconsistent assessments, and resolved disagreements by consensus. Reference Alderson22

Statistical analysis

To meta-analyze the extracted data, we calculated the pooled diagnostic odds ratio (DOR) for COVID-19 or COVID-19 hospitalization between vaccinated and unvaccinated individuals. Vaccine effectiveness was estimated as 100% × (1 − DOR). We performed stratified analyses by vaccine type (eg, PfizerBioNTech COVID-19 vaccine [2 doses], Janssen COVID-19 vaccine [1 dose]), by COVID-19 status (ie, COVID-19 or COVID-19 hospitalization), and by the δ variant period. Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33 We performed statistical analysis using R version 4.1.0 with mada package version 0.5.4. Reference Doebler and Holling34 Analogous to the meta-analysis of the odds ratio methods for the DOR, an estimator of random-effects model following the approach of DerSimonian and Laird is provided by the mada package. Reference Doebler and Holling34 For our meta-analysis of estimates of COVID-19 vaccine effectiveness, we used a bivariate random effects model, adopting a similar concept of performing the diagnostic accuracy, which enables simultaneous pooling of sensitivity and specificity with mixed-effect linear modeling while allowing for the trade-off between them. Reference Reitsma, Glas, Rutjes, Scholten, Bossuyt and Zwinderman35,Reference Goto, Ohl, Schweizer and Perencevich36 Heterogeneity between studies was evaluated with I2 estimation and the Cochran Q statistic test.

Results

Characteristics of included studies

In total, 17 studies met the inclusion criteria Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33,Reference Braeye, Cornelissen and Catteau37Reference Thompson, Stenehjem and Grannis42 and were included in the final review (Table 1). Almost all of these studies were nonrandomized (16 studies), and of these, 12 were retrospective cohort studies. Reference Bajema, Dahl and Prill23,Reference Bozio, Grannis and Naleway24,Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26Reference Embi, Levy and Naleway28,Reference Nanduri, Pilishvili and Derado30Reference Tartof, Slezak and Fischer33,Reference Braeye, Cornelissen and Catteau37,Reference Self, Tenforde and Rhoads39,Reference Tande, Pollock, Shah, Binnicker and Berbari40 Also, 1 study was a prospective cohort study Reference Fowlkes, Gaglani, Groover, Thiese, Tyner and Ellingson29 and 3 studies were case–control studies. Reference Chemaitelly, Tang and Hasan25,Reference Kissling, Hooiveld and Sandonis Martín38,Reference Thompson, Stenehjem and Grannis42 Only 1 study was a randomized clinical trial. Reference Thomas, Moreira and Kitchin41 All but 1 of these studies evaluated the Pfizer/BioNTech vaccine (16 studies). Reference Bajema, Dahl and Prill23Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Embi, Levy and Naleway28Reference Tartof, Slezak and Fischer33,Reference Braeye, Cornelissen and Catteau37,Reference Self, Tenforde and Rhoads39Reference Thompson, Stenehjem and Grannis42 Of these studies, 13 analyzed the Moderna vaccine Reference Bajema, Dahl and Prill23,Reference Bozio, Grannis and Naleway24,Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Embi, Levy and Naleway28Reference Nunes, Rodrigues and Kislaya32,Reference Braeye, Cornelissen and Catteau37,Reference Self, Tenforde and Rhoads39,Reference Tande, Pollock, Shah, Binnicker and Berbari40,Reference Thompson, Stenehjem and Grannis42 ; 7 studies analyzed the Janssen vaccine, Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Corchado-Garcia, Zemmour and Hughes27,Reference Fowlkes, Gaglani, Groover, Thiese, Tyner and Ellingson29,Reference Braeye, Cornelissen and Catteau37Reference Self, Tenforde and Rhoads39,Reference Thompson, Stenehjem and Grannis42 1 of which evaluated only the Janssen vaccine Reference Corchado-Garcia, Zemmour and Hughes27 ; and 3 studies analyzed the AstraZeneca vaccine, Reference Nordström, Ballin and Nordström31,Reference Braeye, Cornelissen and Catteau37,Reference Kissling, Hooiveld and Sandonis Martín38 1 of which evaluated mixing COVID-19 vaccines. Reference Nordström, Ballin and Nordström31

Table 1. Summary of Characteristics of Studies Included in the Systematic Literature Review

Note. A, asymptomatic; S, symptomatic; SD, standard deviation; IQR, interquartile range; IRR, incidence rate ratio; HR, hazard ratio [HR]; RR’, relative risk; OR, odds ratio; 95% CI, 95% confidence interval; VE, vaccine effectiveness; NR, not reported; N, number reported; RCT, randomized controlled trial.

Table 2. Subset Analyses Evaluating Long-Term COVID-19 Vaccine Effectiveness Among Fully Vaccinated Individuals

Note. CI, confidence interval; mRNA, Pfizer/BioNTech and Moderna; viral vector, AstraZeneca, and Janssen.

a Vaccine effectiveness was estimated as 100% × (1 − DOR).

Fully vaccinated is defined as receiving 2 doses of Pfizer/BioNTech, Moderna, or AstraZeneca vaccine, or 1 dose of Janssen vaccine.

Most of the studies included in our review were conducted in the United States (12 studies) Reference Bajema, Dahl and Prill23,Reference Bozio, Grannis and Naleway24,Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26Reference Nanduri, Pilishvili and Derado30,Reference Tartof, Slezak and Fischer33,Reference Self, Tenforde and Rhoads39Reference Thompson, Stenehjem and Grannis42 ; 1 study was a multicenter study performed in Europe (assembling data from England, France, Ireland, Netherlands, Portugal, Scotland, Spain, and Sweden) Reference Kissling, Hooiveld and Sandonis Martín38 ; and 1 study was performed in each of these countries: Belgium, Reference Braeye, Cornelissen and Catteau37 Qatar, Reference Chemaitelly, Tang and Hasan25 Sweden, Reference Nordström, Ballin and Nordström31 and Portugal. Reference Nunes, Rodrigues and Kislaya32 All studies were performed between December 2020 and October 2021. Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33,Reference Braeye, Cornelissen and Catteau37Reference Thompson, Stenehjem and Grannis42

Moreover, 10 studies evaluated long-term vaccine effectiveness for COVID-19, Reference Chemaitelly, Tang and Hasan25Reference Corchado-Garcia, Zemmour and Hughes27,Reference Fowlkes, Gaglani, Groover, Thiese, Tyner and Ellingson29Reference Nordström, Ballin and Nordström31,Reference Tartof, Slezak and Fischer33,Reference Kissling, Hooiveld and Sandonis Martín38,Reference Tande, Pollock, Shah, Binnicker and Berbari40,Reference Thomas, Moreira and Kitchin41 8 studies evaluated long-term vaccine effectiveness for COVID-19 hospitalizations, Reference Bajema, Dahl and Prill23Reference Chemaitelly, Tang and Hasan25,Reference Embi, Levy and Naleway28,Reference Nordström, Ballin and Nordström31,Reference Nunes, Rodrigues and Kislaya32,Reference Self, Tenforde and Rhoads39,Reference Thompson, Stenehjem and Grannis42 with 2 studies overlapping. Reference Chemaitelly, Tang and Hasan25,Reference Nordström, Ballin and Nordström31 The study duration varied from 5 to 14 months. Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33,Reference Braeye, Cornelissen and Catteau37Reference Thompson, Stenehjem and Grannis42

Furthermore, 13 studies reported genomic surveillance data. Reference Bajema, Dahl and Prill23Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Embi, Levy and Naleway28Reference Tartof, Slezak and Fischer33,Reference Braeye, Cornelissen and Catteau37,Reference Kissling, Hooiveld and Sandonis Martín38 Also, 11 studies reported detecting the new SARS-CoV-2 B.1.617.2 δ (delta) variant Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33 ; 7 studies reported only δ variant during the long-term vaccine effectiveness evaluation Reference Bajema, Dahl and Prill23,Reference Bozio, Grannis and Naleway24,Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Embi, Levy and Naleway28Reference Nordström, Ballin and Nordström31 ; 2 studies reported the B.1.1.7 α (alpha) variant and δ variant Reference Corchado-Garcia, Zemmour and Hughes27,Reference Nunes, Rodrigues and Kislaya32 ; 1 study reported the B.1.351 β (beta) variant and δ variant, Reference Chemaitelly, Tang and Hasan25 and 1 study reported α, β, γ (gamma or P.1), and δ variants. Reference Chemaitelly, Tang and Hasan25

Studies varied with regards to the type of statistical analysis performed. Nine studies used logistic regression Reference Bajema, Dahl and Prill23Reference Chemaitelly, Tang and Hasan25,Reference Embi, Levy and Naleway28,Reference Braeye, Cornelissen and Catteau37Reference Self, Tenforde and Rhoads39,Reference Thomas, Moreira and Kitchin41,Reference Thompson, Stenehjem and Grannis42 ; 5 studies used Cox proportional hazard analysis Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Fowlkes, Gaglani, Groover, Thiese, Tyner and Ellingson29,Reference Nordström, Ballin and Nordström31Reference Tartof, Slezak and Fischer33 ; 1 study used propensity matched scoring Reference Corchado-Garcia, Zemmour and Hughes27 ; 1 study used Poisson distribution for adjusted logistic regression Reference Nanduri, Pilishvili and Derado30 ; and 1 study used mixed-effects modeling. Reference Tande, Pollock, Shah, Binnicker and Berbari40

Regarding the quality assessment scores of the 17 included studies, >75% of the studies (13 studies) were considered good quality (ie, 19–23 of 28 possible points) per the Downs and Black quality tool. Reference Bajema, Dahl and Prill23,Reference Chemaitelly, Tang and Hasan25Reference Fowlkes, Gaglani, Groover, Thiese, Tyner and Ellingson29,Reference Nordström, Ballin and Nordström31Reference Tartof, Slezak and Fischer33,Reference Kissling, Hooiveld and Sandonis Martín38Reference Tande, Pollock, Shah, Binnicker and Berbari40,Reference Thompson, Stenehjem and Grannis42 Also, 3 studies were considered fair quality (ie, 14–18 points) Reference Bozio, Grannis and Naleway24,Reference Nanduri, Pilishvili and Derado30,Reference Braeye, Cornelissen and Catteau37 and 1 study was considered high quality (ie, >24 points). Reference Thomas, Moreira and Kitchin41

Results pooled by COVID-19 vaccine type and COVID-19 outcome

Overall, we included 17,939,172 individuals from 16 studies in the meta-analysis. Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33,Reference Kissling, Hooiveld and Sandonis Martín38Reference Thompson, Stenehjem and Grannis42 Among them, 10 studies evaluated the long-term vaccine effectiveness of mRNA or viral vector vaccines (ie, AstraZeneca or Janssen). Reference Chemaitelly, Tang and Hasan25Reference Corchado-Garcia, Zemmour and Hughes27,Reference Fowlkes, Gaglani, Groover, Thiese, Tyner and Ellingson29Reference Nordström, Ballin and Nordström31,Reference Tartof, Slezak and Fischer33,Reference Kissling, Hooiveld and Sandonis Martín38,Reference Tande, Pollock, Shah, Binnicker and Berbari40,Reference Thomas, Moreira and Kitchin41 The estimated long-term vaccine effectiveness for COVID-19 was 84.2% (95% CI, 84.0%–84.3%). Also, 5 studies evaluated the long-term vaccine effectiveness of the Pfizer/BioNTech vaccine, Reference Chemaitelly, Tang and Hasan25,Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Nanduri, Pilishvili and Derado30,Reference Tartof, Slezak and Fischer33,Reference Thomas, Moreira and Kitchin41 and 2 studies evaluated the Moderna vaccine. Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Nanduri, Pilishvili and Derado30 The estimated long-term vaccine effectiveness against COVID-19 of the Pfizer/BioNTech COVID-19 vaccine was 81.5% (95% CI, 81.3%–81.6%). Furthermore, 4 studies evaluated vaccine effectiveness of the mRNA or viral vector vaccines during the δ variant period Reference Chemaitelly, Tang and Hasan25,Reference Fowlkes, Gaglani, Groover, Thiese, Tyner and Ellingson29,Reference Nanduri, Pilishvili and Derado30,Reference Tande, Pollock, Shah, Binnicker and Berbari40 ; 2 studies evaluated vaccine effectiveness of the Pfizer/BioNTech COVID-19 vaccine only Reference Chemaitelly, Tang and Hasan25,Reference Nanduri, Pilishvili and Derado30 , and 2 studies reported vaccine effectiveness of the Moderna COVID-19 vaccine only. Reference Chemaitelly, Tang and Hasan25,Reference Nanduri, Pilishvili and Derado30 The estimated long-term vaccine effectiveness for COVID-19 with mRNA or viral vector vaccines during the δ variant–dominant period was 61.2% (95% CI, 59.0%–63.3%).

Among the 16 studies, 8 studies evaluated the long-term vaccine effectiveness of mRNA or viral vector vaccines for COVID-19 hospitalization. Reference Bajema, Dahl and Prill23Reference Chemaitelly, Tang and Hasan25,Reference Embi, Levy and Naleway28,Reference Nordström, Ballin and Nordström31,Reference Nunes, Rodrigues and Kislaya32,Reference Self, Tenforde and Rhoads39,Reference Thompson, Stenehjem and Grannis42 The estimated long-term vaccine effectiveness against COVID-19 was 88.7% (95% CI, 55.8%–97.1%). In stratified analyses, 6 studies evaluated long-term vaccine effectiveness for COVID-19 hospitalization with the Pfizer/BioNTech vaccine, Reference Bajema, Dahl and Prill23Reference Chemaitelly, Tang and Hasan25,Reference Embi, Levy and Naleway28,Reference Self, Tenforde and Rhoads39,Reference Thompson, Stenehjem and Grannis42 and 5 studies with the Moderna vaccine. Reference Bajema, Dahl and Prill23,Reference Bozio, Grannis and Naleway24,Reference Embi, Levy and Naleway28,Reference Self, Tenforde and Rhoads39,Reference Thompson, Stenehjem and Grannis42 The estimated long-term vaccine effectiveness for COVID-19 hospitalization with the Pfizer/BioNTech vaccine was 85.4% (95% CI, 84.8%–86.0%). The estimated long-term vaccine effectiveness for COVID-19 hospitalization with the Moderna vaccine was 89.8% (95% CI, 89.2%–90.4%). Only 1 study evaluated COVID-19 hospitalization during the δ variant period with mRNA vaccines. Reference Bozio, Grannis and Naleway24 This study did not report the COVID-19 vaccine effectiveness but reported that the adjusted odds of COVID-19 was higher among unvaccinated and previously infected patients compared with fully vaccinated individuals (adjusted odds ratio, 5.49; 95% CI, 2.75–10.99). Reference Bozio, Grannis and Naleway24

The results of meta-analyses were homogeneous for COVID-19 with mRNA or viral vector vaccines (heterogeneity P = .76; I2 = 0%); studies evaluating individuals vaccinated with the Pfizer/BioNTech vaccine alone (heterogeneity P = .55; I2 = 0%); and studies evaluating individuals vaccinated with mRNA or viral vector vaccines during the δ variant period (heterogeneity P = .50; I2 = 0%).

Meta-analysis results were also homogeneous for COVID-19 hospitalization (studies evaluating individuals vaccinated with mRNA or viral vector vaccines (heterogeneity P = .67; I2 = 0%); and studies evaluating individuals vaccinated with the Moderna vaccine alone (heterogeneity P = .28; I2 = 20%). However, results were not homogenous for studies of COVID-19 hospitalization only evaluating individuals vaccinated with the Pfizer/BioNTech vaccine alone (heterogeneity P = .07; I2 = 51%) or for studies of COVID-19 hospitalization only evaluating individuals vaccinated with the Moderna vaccine alone (heterogeneity P = .21; I2 = 32%).

Discussion

This systematic literature review and meta-analysis showed that the long-term of vaccine effectiveness with COVID-19 vaccines (primarily the mRNA vaccines) for COVID-19 and COVID-19 hospitalization were high at 84.2% and 88.7%, respectively. However, the long-term vaccine effectiveness against COVID-19 during the δ-variant–dominant period was lower at 61.2%. These results suggest that 2 doses of the COVID-19 vaccine may lose effectiveness after a few months, and more prospective studies are needed to investigate the short- and long-term vaccine effectiveness after the third dose of the COVID-19 vaccines.

A growing body of early global research shows that the authorized COVID-19 vaccines remain highly protective against the disease’s worst outcomes over time with some exceptions among older and immunocompromised people. Reference Chodick, Tene and Rotem43,Reference Del Rio, Malani and Omer44 In our systematic literature review, we analyzed only the estimated pooled vaccine effectiveness for the mRNA COVID-19 vaccines and the viral vector COVID-19 vaccines. These are the first COVID-19 vaccines authorized by the FDA and around the world, 4548 and they prevent COVID-19 and COVID-19 hospitalization. Reference Dagan, Barda and Kepten2,Reference Marra, Kobayashi and Suzuki4,Reference Griffin, Haddix and Danza10,Reference Lopez Bernal, Andrews and Gower12,Reference Pilishvili, Gierke and Fleming-Dutra15,Reference Tenforde, Patel and Ginde49 The long duration of the studies (from 5 to 14 months, as shown in Table 1) included in our systematic literature review helps to better elucidate the long-term vaccine effectiveness in the context of a global pandemic with new SARS-CoV-2 variants Reference Lopez Bernal, Andrews and Gower12,Reference Lopez Bernal, Andrews and Gower13 and to better understand that the decrease of vaccine effectiveness is associated with a waning of humoral immune response after a few months. Reference Lopez Bernal, Andrews and Gower13,Reference Levin, Lustig and Cohen17 Although the overall long-term vaccine effectiveness against COVID-19 and COVID-19 hospitalization were moderately high (∼80%), a number of published studies demonstrated significantly lower vaccine effectiveness (∼60%) during the δ-variant period. Reference Chemaitelly, Tang and Hasan25,Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Fowlkes, Gaglani, Groover, Thiese, Tyner and Ellingson29,Reference Nanduri, Pilishvili and Derado30,Reference Self, Tenforde and Rhoads39,Reference Thomas, Moreira and Kitchin41

Our systematic review included 11 studies evaluating the widespread circulation of the δ variant contributing to the majority of recent COVID-19 and COVID-19 hospitalizations. Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33 The studies in this systematic review antedate the emergence of the B.1.1.529 (omicron) variant announced by the World Health Organization (WHO) on November 26, 2021. 50 We need more studies on the SARS-CoV-2 variants of concerns (VOC) that have multiple spike-protein changes and that may be more infectious or cause more severe disease than other circulating variants. Reference Challen, Brooks-Pollock, Read, Dyson, Tsaneva-Atanasova and Danon51 Some deletions in the spike-protein gene can alter the shape of the spike and may help it evade antibodies. Reference Wang, Nair and Liu52 No COVID-19 vaccine is 100% effective against SARS-CoV-2 infection, as demonstrated by breakthrough infections, Reference Brown, Vostok and Johnson8,Reference Hacisuleyman, Hale and Saito53 but they are highly effective at preventing severe disease and death. Reference Chemaitelly, Tang and Hasan25 Although the long-term vaccine effectiveness was not as high as the short-term vaccine effectiveness, it is not clear whether the waning of immunity is due to the passage of time or the coincident spread of the δ variant (from June to September 2021). Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33

Our study had several limitations. Most of the studies included in the meta-analysis were observational studies, which are subject to multiple biases. Reference Harris, Lautenbach and Perencevich54 However, this is the most common study design in the infection prevention literature. Reference Harris, Lautenbach and Perencevich54 None of the included studies reported possible adverse events after vaccine administration. We could not perform further analyses stratified by immunocompromised status due to the limited number of studies. Only 1 study compared immunocompromised individuals to immunocompetent individuals and reported that the effectiveness of mRNA vaccination against COVID-19 hospitalization was lower (77%) among immunocompromised individuals than among immunocompetent individuals (90%). Reference Embi, Levy and Naleway28 Because our study focused on the long-term vaccine effectiveness after the second dose, we could not evaluate the impact of a third dose. Because of the low number of included studies of viral vector vaccines, it was not possible to perform a stratified analysis for these. It was not possible to evaluate the long-term vaccine effectiveness of the Moderna vaccine against COVID-19 because there were not enough studies. Reference Cohn, Cirillo, Murphy, Krigbaum and Wallace26,Reference Nanduri, Pilishvili and Derado30 There are not enough studies comparing each 1 of the 2 mRNA vaccines to draw conclusions about the vaccine effectiveness for COVID-19 during the δ variant dominant period. Reference Chemaitelly, Tang and Hasan25,Reference Nanduri, Pilishvili and Derado30 Also, it was not possible to evaluate the COVID-19 hospitalization vaccine effectiveness during the δ-variant–dominant period. It was not possible to make any conclusions about the long-term vaccine effectiveness of mixing vaccines because just 1 study assessed this. Reference Nordström, Ballin and Nordström31 From that study, mixing COVID-19 vaccines (first dose with the AstraZeneca vaccine adding a mRNA prime-boost showed a higher vaccine effectiveness (68%) than that of 2 doses of AstraZeneca vaccine (50%). Reference Nordström, Ballin and Nordström31 Lastly, each study used a different approach to report the incidence of COVID-19 (eg, incidence rate per person years). Therefore, we decided to perform our meta-analysis and stratified analysis with a bivariate approach to preserve the 2-dimensional nature of the original data from the selected studies. Reference Bajema, Dahl and Prill23Reference Tartof, Slezak and Fischer33,Reference Kissling, Hooiveld and Sandonis Martín38Reference Thompson, Stenehjem and Grannis42

In conclusion, COVID-19 vaccines can effectively prevent COVID-19 and COVID-19 hospitalization for a relatively long period. These vaccines are also effective in preventing COVID-19 during the δ-variant period, though vaccines were less effective. These data are very important to help motivate individuals to seek vaccination. More observational studies are needed to evaluate other types of COVID-19 vaccine (eg, viral vector or inactivated virus) effectiveness, vaccine effectiveness of a third dose, vaccine effectiveness of mixing COVID-19 vaccines, COVID-19 breakthrough infection after vaccination, and genomic surveillance for better understanding vaccine effectiveness against the new viral variants.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/ash.2021.261

Acknowledgments

We thank Jennifer Deberg, MLS, from the Hardin Library for the Health Sciences, University of Iowa Libraries, for assistance with the search methods.

Financial support

No financial support was provided relevant to this article.

Conflicts of interest

All authors report no conflicts of interest relevant to this article.

References

Polack, FP, Thomas, SJ, Kitchin, N, et al. Safety and efficacy of the BNT162b2 mRNA COVID-19 vaccine. N Engl J Med 2020;383:26032615.CrossRefGoogle ScholarPubMed
Dagan, N, Barda, N, Kepten, E, et al. BNT162b2 mRNA COVID-19 vaccine in a nationwide mass vaccination setting. N Engl J Med 2021;384:14121423.CrossRefGoogle Scholar
Tenforde, MW, Olson, SM, Self, WH, et al. Effectiveness of Pfizer-BioNTech and moderna vaccines against COVID-19 among hospitalized adults aged ≥65 years—United States, January–March 2021. Morb Mortal Wkly Rep 2021;70:674679.CrossRefGoogle Scholar
Marra, AR, Kobayashi, T, Suzuki, H, et al. The short-term effectiveness of coronavirus disease 2019 (COVID-19) vaccines among healthcare workers: a systematic literature review and meta-analysis. Antimicrob Steward & Healthc Epidemiol 2021;1(1):e33.Google Scholar
Voysey, M, Clemens, SAC, Madhi, SA, et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. Lancet 2021;397:99111.CrossRefGoogle ScholarPubMed
Baden, LR, El Sahly, HM, Essink, B, et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 Vaccine. N Engl J Med 2021;384:403416.CrossRefGoogle ScholarPubMed
Sadoff, J, Gray, G, Vandebosch, A, et al. Safety and efficacy of single-dose Ad26.COV2.S vaccine against COVID-19. N Engl J Med 2021;384:21872201.CrossRefGoogle ScholarPubMed
Brown, CM, Vostok, J, Johnson, H, et al. Outbreak of SARS-CoV-2 infections, including COVID-19 vaccine breakthrough infections, associated with large public gatherings—Barnstable County, Massachusetts, July 2021. Morb Mortal Wkly Rep 2021;70:10591062.CrossRefGoogle Scholar
Glatman-Freedman, A, Hershkovitz, Y, Kaufman, Z, Dichtiar, R, Keinan-Boker, L, Bromberg, M. Effectiveness of BNT162b2 vaccine in adolescents during outbreak of SARS-CoV-2 delta variant infection, Israel, 2021. Emerg Infect Dis 2021;27:29192922.CrossRefGoogle Scholar
Griffin, JB, Haddix, M, Danza, P, et al. SARS-CoV-2 infections and hospitalizations among persons aged ≥16 years, by vaccination status—Los Angeles County, California, May 1–July 25, 2021. Morb Mortal Wkly Rep 2021;70:11701176.CrossRefGoogle Scholar
COVID data tracker. COVID-19 vaccine effectiveness. Centers for Disease Control and Prevention website. https://covid.cdc.gov/covid-data-tracker/#vaccine-effectiveness. Published 2021. Accessed December 14, 2021.Google Scholar
Lopez Bernal, J, Andrews, N, Gower, C, et al. Effectiveness of the Pfizer-BioNTech and Oxford-AstraZeneca vaccines on COVID-19–elated symptoms, hospital admissions, and mortality in older adults in England: test negative case-control study. BMJ (Clin Res) 2021;373:n1088.Google ScholarPubMed
Lopez Bernal, J, Andrews, N, Gower, C, et al. Effectiveness of COVID-19 vaccines against the B.1.617.2 (delta) variant. N Engl J Med 2021;385:585594.CrossRefGoogle ScholarPubMed
Tenforde, MW, Patel, MM, Ginde, AA, et al. Effectiveness of severe acute respiratory syndrome coronavirus 2 messenger RNA vaccines for preventing coronavirus disease 2019 hospitalizations in the United States. Clin Infect Dis 2021. doi: 10.1093/cid/ciab687.CrossRefGoogle ScholarPubMed
Pilishvili, T, Gierke, R, Fleming-Dutra, KE, et al. Effectiveness of mRNA COVID-19 vaccine among US healthcare personnel. N Engl J Med 2021;385:e90.CrossRefGoogle Scholar
Rossi, C, Lanuti, P, Cicalini, I, et al. BNT162b2 mRNA vaccination leads to long-term protection from COVID-19 disease. Vaccines 2021;9:1164.CrossRefGoogle ScholarPubMed
Levin, EG, Lustig, Y, Cohen, C, et al. Waning immune humoral response to BNT162b2 COVID-19 vaccine over 6 months. N Engl J Med 2021;385(24):e84.CrossRefGoogle ScholarPubMed
Bayart, JL, Douxfils, J, Gillot, C, et al. Waning of IgG, total and neutralizing antibodies 6 months postvaccination with BNT162b2 in healthcare workers. Vaccines 2021;9:1092.CrossRefGoogle Scholar
Moher, D, Liberati, A, Tetzlaff, J, Altman, DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6:e1000097.CrossRefGoogle ScholarPubMed
Stroup, DF, Berlin, JA, Morton, SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000;283:20082012.CrossRefGoogle ScholarPubMed
Downs, SH, Black, N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and nonrandomised studies of healthcare interventions. J Epidemiol Commun Health 1998;52:377384.CrossRefGoogle Scholar
Alderson, PGS HJ, editors. Assessment of study quality. In: Cochrane Reviewers’ Handbook 4.2.3. Chichester, UK: John Wiley & Sons; 2004.Google Scholar
Bajema, KL, Dahl, RM, Prill, MM, et al. Effectiveness of COVID-19 mRNA vaccines against COVID-19–associated hospitalization—five Veterans’ Affairs medical centers, United States, February 1–August 6, 2021. Morb Mortal Wkly Rep 2021;70:12941299.CrossRefGoogle Scholar
Bozio, CH, Grannis, SJ, Naleway, AL, et al. Laboratory-confirmed COVID-19 among adults hospitalized with COVID-19–like illness with infection-induced or mRNA vaccine-induced SARS-CoV-2 immunity—nine states, January–September 2021. Morb Mortal Wkly Rep 2021;70:15391544.CrossRefGoogle ScholarPubMed
Chemaitelly, H, Tang, P, Hasan, MR, et al. Waning of BNT162b2 vaccine protection against SARS-CoV-2 infection in Qatar. N Engl J Med 2021;385:e83.CrossRefGoogle ScholarPubMed
Cohn, BA, Cirillo, PM, Murphy, CC, Krigbaum, NY, Wallace, AW. SARS-CoV-2 vaccine protection and deaths among US veterans during 2021. Science 2021. doi: 10.1126/science.abm0620.CrossRefGoogle Scholar
Corchado-Garcia, J, Zemmour, D, Hughes, T, et al. Analysis of the effectiveness of the Ad26.COV2.S adenoviral vector vaccine for preventing COVID-19. JAMA Netw Open 2021;4:e2132540.CrossRefGoogle ScholarPubMed
Embi, PJ, Levy, ME, Naleway, AL, et al. Effectiveness of 2-dose vaccination with mRNA COVID-19 vaccines against COVID-19–associated hospitalizations among immunocompromised adults— nine states, January–September 2021. Morb Mortal Wkly Rep 2021;70:15531559.CrossRefGoogle ScholarPubMed
Fowlkes, A, Gaglani, M, Groover, K, Thiese, MS, Tyner, H, Ellingson, K. Effectiveness of COVID-19 vaccines in preventing SARS-CoV-2 Infection among frontline workers before and during B.1.617.2 (delta) variant predominance—eight US locations, December 2020–August 2021. Morb Mortal Wkly Rep 2021;70:11671169.CrossRefGoogle Scholar
Nanduri, S, Pilishvili, T, Derado, G, et al. Effectiveness of Pfizer-BioNTech and Moderna vaccines in preventing SARS-CoV-2 infection among nursing home residents before and during widespread circulation of the SARS-CoV-2 B.1.617.2 (delta) variant—National Healthcare Safety Network, March 1–August 1, 2021. Morb Mortal Wkly Rep 2021;70:11631166.CrossRefGoogle ScholarPubMed
Nordström, P, Ballin, M, Nordström, A. Effectiveness of heterologous ChAdOx1 nCoV-19 and mRNA prime-boost vaccination against symptomatic COVID-19 infection in Sweden: a nationwide cohort study. Lancet Reg Health Eur 2021;11:100249.CrossRefGoogle ScholarPubMed
Nunes, B, Rodrigues, AP, Kislaya, I, et al. mRNA vaccine effectiveness against COVID-19–related hospitalisations and deaths in older adults: a cohort study based on data linkage of national health registries in Portugal, February to August 2021. Euro Surveill 2021;26:2100833.CrossRefGoogle ScholarPubMed
Tartof, SY, Slezak, JM, Fischer, H, et al. Effectiveness of mRNA BNT162b2 COVID-19 vaccine up to 6 months in a large integrated health system in the USA: a retrospective cohort study. Lancet 2021;398:14071416.CrossRefGoogle Scholar
Doebler, P, Holling, H. Meta-analysis of diagnostic accuracy with mada. R package version 0.5.8. Vienna, Austria: R Foundation for Statistical Computing; 2017.Google Scholar
Reitsma, JB, Glas, AS, Rutjes, AW, Scholten, RJ, Bossuyt, PM, Zwinderman, AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol 2005;58:982990.CrossRefGoogle ScholarPubMed
Goto, M, Ohl, ME, Schweizer, ML, Perencevich, EN. Accuracy of administrative code data for the surveillance of healthcare-associated infections: a systematic review and meta-analysis. Clin Infect Dis 2014;58:688696.CrossRefGoogle ScholarPubMed
Braeye, T, Cornelissen, L, Catteau, L, et al. Vaccine effectiveness against infection and onwards transmission of COVID-19: analysis of Belgian contact tracing data, January–June 2021. Vaccine 2021;39:54565460.CrossRefGoogle Scholar
Kissling, E, Hooiveld, M, Sandonis Martín, V, et al. Vaccine effectiveness against symptomatic SARS-CoV-2 infection in adults aged 65 years and older in primary care: I-MOVE-COVID-19 project, Europe, December 2020 to May 2021. Euro Surveill 2021;26.CrossRefGoogle Scholar
Self, WH, Tenforde, MW, Rhoads, JP, et al. Comparative effectiveness of Moderna, Pfizer-BioNTech, and Janssen (Johnson & Johnson) vaccines in preventing COVID-19 hospitalizations among adults without immunocompromising conditions—United States, March–August 2021. Morb Mortal Wkly Rep 2021;70:13371343.CrossRefGoogle ScholarPubMed
Tande, AJ, Pollock, BD, Shah, ND, Binnicker, M, Berbari, EF. mRNA Vaccine effectiveness against asymptomatic SARS-CoV-2 infection over a seven-month period. Infect Control Hosp Epidemiol 2021. doi: 10.1017/ice.2021.399.CrossRefGoogle Scholar
Thomas, SJ, Moreira, ED Jr, Kitchin, N, et al. Safety and efficacy of the BNT162b2 mRNA COVID-19 vaccine through 6 months. N Engl J Med 2021;385:17611773.CrossRefGoogle ScholarPubMed
Thompson, MG, Stenehjem, E, Grannis, S, et al. Effectiveness of COVID-19 vaccines in ambulatory and inpatient care settings. N Engl J Med 2021;385:13551371.CrossRefGoogle ScholarPubMed
Chodick, G, Tene, L, Rotem, RS, et al. The effectiveness of the two-dose BNT162b2 vaccine: analysis of real-world data. Clin Infect Dis 2021. doi: 10.1093/cid/ciab438.CrossRefGoogle Scholar
Del Rio, C, Malani, PN, Omer, SB. Confronting the delta variant of SARS-CoV-2, summer 2021. JAMA 2021;326:10011002.CrossRefGoogle Scholar
Pfizer/BioNTech COVID-19 vaccine. Centers for Disease Control and Prevention website. https://www.cdc.gov/coronavirus/2019-ncov/vaccines/different-vaccines/Pfizer-BioNTech.html. Accessed January 18, 2022.Google Scholar
Moderna COVID-19 vaccine. US Food and Drug Administration website. https://www.fda.gov/emergency-preparedness-and-response/coronavirus-disease-2019-covid-19/moderna-covid-19-vaccine Published 2021. Accessed December 14, 2021.Google Scholar
AstraZeneca COVID-19 vaccine. European Medicines Agency website. https://www.ema.europa.eu/en/medicines/human/EPAR/vaxzevria-previously-covid-19-vaccine-astrazeneca. Published 2021.Accessed December 14, 2021.Google Scholar
Janssen COVID-19 vaccine. US Food and Drug Administration website. https://www.fda.gov/emergency-preparedness-and-response/coronavirus-disease-2019-covid-19/janssen-covid-19-vaccine. Published 2021. Accessed December 14, 2021.Google Scholar
Tenforde, MW, Patel, MM, Ginde, AA, et al. Effectiveness of SARS-CoV-2 mRNA vaccines for preventing COVID-19 hospitalizations in the United States. Clin Infect Dis 2021.Google Scholar
CDC Statement on B.1.1.529 (omicron variant) media statement. Centers for Disease Control and Prevention website. https://www.cdc.gov/media/releases/2021/s1126-B11-529-omicron.html. Published 2021. Accessed December 14, 2021.Google Scholar
Challen, R, Brooks-Pollock, E, Read, JM, Dyson, L, Tsaneva-Atanasova, K, Danon, L. Risk of mortality in patients infected with SARS-CoV-2 variant of concern 202012/1: matched cohort study. BMJ (Clin Res) 2021;372:n579.Google ScholarPubMed
Wang, P, Nair, MS, Liu, L, et al. Antibody resistance of SARS-CoV-2 variants B.1.351 and B.1.1.7. Nature 2021;593:130135.CrossRefGoogle ScholarPubMed
Hacisuleyman, E, Hale, C, Saito, Y, et al. Vaccine breakthrough infections with SARS-CoV-2 Variants. N Engl J Med 2021;384:22122218.CrossRefGoogle ScholarPubMed
Harris, AD, Lautenbach, E, Perencevich, E. A systematic review of quasi-experimental study designs in the fields of infection control and antibiotic resistance. Clin Infect Dis 2005;41:7782.Google ScholarPubMed
Figure 0

Fig. 1. Literature search for articles on the long-term COVID-19 vaccine effectiveness among general population.

Figure 1

Table 1. Summary of Characteristics of Studies Included in the Systematic Literature Review

Figure 2

Table 2. Subset Analyses Evaluating Long-Term COVID-19 Vaccine Effectiveness Among Fully Vaccinated Individuals

Supplementary material: File

Marra et al. supplementary material

Marra et al. supplementary material

Download Marra et al. supplementary material(File)
File 261.5 KB