Hostname: page-component-76fb5796d-x4r87 Total loading time: 0 Render date: 2024-04-25T17:27:43.730Z Has data issue: false hasContentIssue false

Best practice assessment of disease modelling for infectious disease outbreaks

Published online by Cambridge University Press:  08 May 2018

Z. F. Dembek*
Affiliation:
Battelle Connecticut Operations, 50 Woodbridge Drive, Suffield, CT 06078-1200, USA
T. Chekol
Affiliation:
Battelle, Defense Threat Reduction Agency, Technical Reachback, 8725 John J. Kingman Road, Stop 6201, Fort Belvoir, VA 22060-6201, USA
A. Wu
Affiliation:
Defense Threat Reduction Agency, Technical Reachback, 8725 John J. Kingman Road, Stop 6201, Fort Belvoir, VA 22060-6201, USA
*
Author for correspondence: Z. F. Dembek, dembek@battelle.org
Rights & Permissions [Opens in a new window]

Abstract

During emerging disease outbreaks, public health, emergency management officials and decision-makers increasingly rely on epidemiological models to forecast outbreak progression and determine the best response to health crisis needs. Outbreak response strategies derived from such modelling may include pharmaceutical distribution, immunisation campaigns, social distancing, prophylactic pharmaceuticals, medical care, bed surge, security and other requirements. Infectious disease modelling estimates are unavoidably subject to multiple interpretations, and full understanding of a model's limitations may be lost when provided from the disease modeller to public health practitioner to government policymaker. We review epidemiological models created for diseases which are of greatest concern for public health protection. Such diseases, whether transmitted from person-to-person (Ebola, influenza, smallpox), via direct exposure (anthrax), or food and waterborne exposure (cholera, typhoid) may cause severe illness and death in a large population. We examine disease-specific models to determine best practices characterising infectious disease outbreaks and facilitating emergency response and implementation of public health policy and disease control measures.

Type
Review
Copyright
Copyright © Cambridge University Press 2018 

Introduction

Epidemiological modelling of disease outbreaks has become a crucial tool in public health practice. Information to mitigate impending epidemics is often estimated by post-event modelling from prior outbreaks. Comprehensive predictive models include components representing the ‘epidemiologic triad’ of disease agent, host and environment [Reference Scholthof1]. Critical model input information may include the latent, incubation and infectious periods (the ‘natural history’ of infection), disease surveillance data delineating infection distribution and spread, infection transmission dynamics and medical countermeasures. Population demographics, geographic networks and host movement information are also useful. Other factors not attributable to either disease agent or host within an environment may be appropriate for model inclusion, such as hygiene, cultural/religious practices, climate and reservoirs [Reference Woolhouse2]. We review current epidemiological models for diseases which potentially affect large populations. These include human-to-human disease transmission (Ebola, influenza, smallpox), via aerosol exposure (anthrax), food and waterborne exposure (cholera, typhoid) and co-infections.

Ebola

The 2014–2016 West African Ebola virus disease (EVD) outbreak had greater geographic spread, duration and magnitude than previous outbreaks [Reference Hampton3], which permitted applications from disease modelling for planning purposes [Reference Wong4]. It became evident that absent additional control measures, the outbreak would dramatically increase [5]. As initial African EVD cases emerged, endemic disease ‘background noise’ (e.g., cholera, Lassa fever, malaria) impeded patient diagnosis, rendering early outbreak identification difficult [6]. Unlike previous outbreaks, the early patient diagnosis was strongly reliant upon patient isolation [Reference Chowell7]. Community cultural practices increased disease spread, hindering mitigation measure effectiveness [Reference Lee-Kwan8]. Information derived from direct medical care best practice [9], helped terminate community transmission. Control measures for EVD eventually included effective measures for contact tracing, case isolation and management, burial guidance, community involvement, enforced sanitary measures [Reference Out10], establishing field hospitals [Reference Lamb11] and laboratories [Reference Logue12], increasing medical supply dissemination [Reference Sun and Eilperin13], enforcement of border controls [14] and international support [5].

Information was required early in the outbreak to determine optimal response. Disease models were designed to predict spatiotemporal spread and magnitude and to estimate best mitigation strategies to end the outbreak. A September 2014 Centers for Disease Control and Prevention (CDC) SEIR (susceptible, exposed, infectious, recovered) model predicted the EVD outbreak would cease if 70% of patients received direct medical care [Reference Meltzer15]. An October 2014 World Health Organization (WHO) model [Reference Fraser16] determined that, in the absence of enhanced contact tracing, adequate case isolation, increased clinical management, safe burials and greater community and international engagement, Guinea, Liberia and Sierra Leone would experience thousands more cases and deaths weekly [5].

Ebola outbreak interventions were unequally effective, due to implementation capacity, timing, compliance or extent of completion. Multiple interventions may have unforeseen synergistic effects. Partial implementation of an intervention also may evince different – or no – outbreak amelioration. Non-conventional humanitarian interventions were implemented and included expanded access (compassionate use protocols), novel drugs to treat infected patients (http://www.fda.gov/NewsEvents/PublicHealthFocus/ExpandedAccessCompassionateUse/default.htm) humanitarian military intervention and the use of non-conventional sheltering and food aid resources [Reference Tambo17]. Healthcare workers were essential in controlling the EVD epidemic and suffered proportionately (898 cases, 518 deaths) [1822].

Travel restrictions implemented during the outbreak became controversial, with claims that West African travel bans were unsupported by public health science [Reference Fidler23] and non-compliant with WHO International Health Regulations (IHR) [24]. Some models indicated travel restrictions were insufficient to prevent the global spread of Ebola, delaying it a few weeks at best [Reference Poletto25,Reference Otsuki and Nishiura26]. One model estimated that, during November 2014, with existing flight restrictions and airport screening guidelines, an average of 2.8 Ebola-infected air travellers per month departed from Guinea, Liberia and Sierra Leone [Reference Boguch27]. Later analyses determined that between 4% and 10% of newly-infected Ebola cases migrated to another district within their country, and ⩽23% of this group left their country. Due to underreporting, country differences in cross-border transmission in West Africa was undetermined [Reference Backer and Wallinga28].

Ebola model findings

Inherent to outbreak model development is that the most accurate model to describe real-world events can be best developed after the outbreak [Reference Shoman, Karafillakis and Rawaf29Reference Sharareh, Sayama and MacDonald31]. For example, in Sierra Leone, positive associations were found between Ebola transmission and population density, proximity to Ebola treatment centres, cropland coverage and atmospheric temperature. Interventions which interrupted household transmission were discovered to be particularly crucial for EVD transmission cessation [Reference Fang32].

Modelling aided the public health response by analysing potential disease spread and directing interventions. Introduction of burial practices and climatology into agent-based SEIR modelling assisted placement of Ebola treatment centres [Reference Dembek33]. Optimal modelling occurred with behavioural factor inclusion [Reference Sharareh, Sayama and MacDonald31]. While social and cultural disease determinants were integral to controlling this Ebola outbreak, these factors may not always be considered for outbreak model inclusion but should be where feasible. A CDC SEIR model encouraged increased contact tracing, and improved infection control, reducing new EVD cases [Reference Rivers34]. Rapidly reporting newly diagnosed cases and publicising best practices to healthcare providers, health officials and disease modellers enabled contact tracing, calculating transmission dynamics and enhanced disease spread forecasting. Other than known disproportionate healthcare worker disease burden, the level of medical care provided throughout this outbreak cannot be determined to fully support the 2014 CDC model's findings.

When estimating outbreak occurrence in the early stages of disease emergence in a large population, a simpler SEIR model may be best applied [Reference Earn35]. Initial stochastic disease models described transmission dynamics, determined origin and spread, and projected the reproduction number (R 0) to inform disease control [5,Reference Meltzer15]. Early EVD models identified disease dynamics comparable with previous outbreaks [5], and postulated rapid spread due to the populations affected and inadequate control measures. As control measures increased, earlier predictions became irrelevant [Reference Kupferschmidt36]. Because some models overestimated outbreak growth or underestimated Ebola treatment unit admissions, predicting an earlier peak than had occurred [Reference Merler37], the practicality of disease models was questioned [Reference Chowell38]. Later in this outbreak, more detailed mechanistic models included depletion of susceptibles, and specific transmission routes and settings, to help fine-tune public health interventions [Reference Heesterbeek39]. These models should be run weekly based on real-time data for best-result forecasting. Travel and border health measures might have prevented EBV spread in West Africa through travel deterrence of symptomatic or exposed individuals and educating travellers about self-protection [Reference Cohen40].

Malaria co-infections: influences on outbreak intervention and an Ebola modelling confounder

In tropical countries, malaria and typhoid are endemic leading public health concerns. False diagnoses due to similar signs and symptoms and false positive test results are major disease management challenges. Modified SEIR models [including carriers (C)] describe co-infection dynamics of malaria and typhoid [Reference Mutua, Wang and Vaidya41]. A decision tree model analysed a year's preventive malaria treatment costs for patient contacts with EVD in West Africa. Cost per treatment unit admission averted and contact age was calculated. Sensitivity analyses assessed how results varied with malaria parasite prevalence, the daily cost of treatment stay and preventive malaria treatment compliance and effectiveness [Reference Carias42].

Malaria co-infection model findings

An efficient simultaneous prevention programme will reduce co-infections such that R 0 <1, thereby eradicating the disease. Both malaria and typhoid must be simultaneously managed for successful control of co-epidemics [Reference Mutua, Wang and Vaidya41]. Preventive malaria treatment for contacts of EVD patients was cost-saving. The model indicated that providing preventive malaria treatment to contacts of EVD patients should be considered during EVD outbreaks where high levels of malaria transmission occur, to reduce non-critical healthcare admissions [Reference Carias42].

Influenza

Influenza is a major public health threat. Beyond seasonal impact, the probability of an influenza pandemic remains among the greatest biological threats to humans. Influenza pandemics could occur by novel virus introduction from reservoir species, coupled with the sustained human-to-human transmission in a susceptible population [Reference Kilbourne43]. During influenza outbreaks, secondary bacterial infections are a leading cause of illness and death [Reference Smith and McCullers44]. There appears to be lethal synergism between influenza and certain bacteria [Reference Cauley and Vella45], including Streptococcus pneumoniae [Reference Smith46] and Group A Streptococcus infection [Reference Kilbourne and Loge47].

An age- and risk-stratified stochastic SEIR model with Markov Chain Monte Carlo (MCMC) analysis including vaccination data reproduced influenza effects over 14 seasons in the UK. When comparing existing reduction in infections and deaths to no vaccination, vaccination prevented 0.39 infections per vaccine dose and 1.74 deaths per 1000 doses. Targeting 5–16-year-old children increases immunisation effectiveness among influenza transmitters, and increases immunisation efficiency, resulting in overall reduction of 0.70 infections per dose and 1.95 deaths per 1000 doses [Reference Baguelin48].

Extensive travel restrictions may delay, not prevent, novel influenza virus spread. One review found internal travel and international border restrictions delayed influenza epidemic transmission by 1 week and 2 months, respectively [Reference Mateus49]. International travel restrictions delayed the epidemic spread and peak between a few days and 4 months. Travel restrictions can reduce the incidence of new cases by <3%. Travel restriction effectiveness was reduced when implemented >6 weeks after epidemic notification, or with high transmissibility levels. Travel restrictions minimally affect cities with dense populations and travel networks and did not contain influenza within a defined geographical area [Reference Mateus49].

As individuals increasingly describe their illness on social media before seeking medical care, Web-based data sources are used for public health surveillance. A 2016 study collected publicly available, de-identified data from the CDC, Google Flu Trends, HealthTweets and Wikipedia for the previous three influenza seasons. Bayesian change point analysis with MCMC detected seasonal changes in each data source. Among Web-based sources, Google had the best sensitivity and PPV (positive predictive value) in detecting a change in influenza-related data. While change points [Reference Takeuchi and Yamanishi50] in Google, Twitter and Wikipedia data occasionally aligned well with those captured in CDC influenza-like illness (ILI) data, they did not detect all changes in CDC data [Reference Sharpe51].

Influenza model findings

Modelling affirmed that targeting children and older adults are the most efficient vaccine use to reduce overall influenza morbidity and mortality [Reference Baguelin48]. Travel restrictions have limited specificity for influenza containment during novel virus emergence [Reference Mateus49]. While social media data mining demonstrates alignment with CDC ILI data, the CDC data are more comprehensive. Accurate influenza modelling to predict synergistic effects between viral secondary bacterial infections in a susceptible population has yet to be accomplished [Reference Boianelli52].

Smallpox

As smallpox was declared eradicated in 1980 [53], smallpox transmission through deliberate virus release should be considered, along with the potential for accidental exposure to unrecognised live virus, as the discovery of unknown viable smallpox virus stored at the US National Institutes of Health (NIH) demonstrated [54]. Contact tracing and case isolation are among initial interventions for a smallpox event. As their effectiveness in a vaccinated population is unknown, evaluation with a multi-type stochastic model (an SIR model with some vaccinated designated fully immune) may assess partially vaccinated populations [Reference Mizumoto55].

The 1967 Abakaliki, Nigeria, smallpox outbreak afforded well-documented data for epidemic modelling. When this outbreak occurred, ~89% of the population was vaccinated. A religious group had refused vaccination, and one smallpox case initiated an outbreak that infected 30 people [Reference Eichner and Dietz56]. An SEIR model variant (susceptible, exposed, with fever, with rash, quarantined or removed) was used to model this outbreak, with Bayesian analysis with MCMC [Reference Stockdale, Kypraios and O'Neill57]. It suggested the outbreak resulted from population interactions, and that control measures themselves did not end the epidemic. Control measures (case isolation upon detection) introduced during the outbreak reduced the rash period from 16 to 2 days, abating new infections. As with other natural smallpox outbreaks [Reference Henderson and Yekpe58], this outbreak ended when susceptible individuals in prolonged and intimate contact with cases became exhausted.

An SEIR-like CDC model estimated smallpox spread following deliberate virus release [Reference Meltzer59]. Using MCMC, the analysis assumed 100 persons initially infected, each infecting three others. This model estimated combined vaccination and quarantine combined could stop an outbreak with a daily 25% quarantine rate, and sufficient vaccination to reduce smallpox transmission by >33%. Though quarantine itself could halt smallpox transmission, its success requires 50% of symptomatic cases be removed daily. Vaccination alone could reduce population susceptibility, and halt the outbreak within 365 days, after 4200 cases. Historical data provides a median of 2155 smallpox vaccine doses per case will terminate outbreaks.

Smallpox model findings

Unsurprisingly, modelling demonstrates past vaccination significantly influences outcomes, as does case movement identification. Intervention delays greatly increase total cases. Further recommendations from modelling include assessing delays in case detection and frequency of case contacts among unvaccinated and previously vaccinated populations [54]. Post-release intervention should combine quarantine and vaccination. A ~40 million dose vaccine stockpile should halt a smallpox outbreak in the USA [Reference Meltzer59].

Anthrax

The spores of Bacillus anthracis, the causative organism of anthrax disease, can be used as a weapon through aerosol dissemination. Such an aerosol release is often modelled using the Hazard Prediction and Assessment Capability (HPAC) or similar programme [60]. An MCMC algorithm to simulate anthrax release demonstrated that early targeted prophylactic treatment minimised overall mortality, based on estimates from the initial five cases [Reference Legrand61]. A CDC model combines inhalational anthrax caseload, effects of variable post-exposure prophylaxis (PEP), and healthcare facility surge capacity to project hospitalisations and casualties. This model confirmed the value of PEP initiation, predicting that deaths peak 5 days post-exposure, hospital treatment volume will peak 15 days post-exposure and recovery peaks 23 days post-exposure [Reference Rainisch62].

Anthrax model findings

Modelling illustrated the possibility of early estimates derived from initial anthrax cases to characterise location and geographic spread of an outbreak [60]. Delays in detection and response to a large-scale anthrax aerosol release in a large city nullify a mass prophylaxis campaign to prevent a surge in hospitalisations [Reference Hupert63]. The CDC model's publicly-available software (Anthrax Assist) enables health officials to examine predictive scale and consequences of alternative responses to an anthrax event, and uses disease surveillance data, allowing available data input. It demonstrates realistic benefits of public health countermeasures and inherent value of PEP [Reference Legrand61].

Cholera

Cholera, a bacterial disease caused by Vibrio cholerae, causes severe diarrhoea and subsequent dehydration. It is preventable with clean drinking water access and vaccination. Interventions and treatments include water sanitation, antibiotics, oral rehydration therapy and supportive care. Cholera is endemic in some countries and imported in others. In October 2010, imported cholera caused the first modern outbreak in Haiti. Cholera outbreaks have recently occurred in Afghanistan, Bangladesh, Dominican Republic, Democratic Republic of Congo, Iraq, Kenya, Malawi, Mozambique, Nigeria, Somalia, South Sudan, Tanzania, Yemen and Zimbabwe [64Reference Ndaba66].

A cholera SEIR model can include data for potential interventions, population demographics, surveillance data, timescale evaluations [Reference Chao, Longini and Morris67], and Vibrio characteristics, including dose and viability [Reference Grad, Miller and Lipsitch68]. Cholera modelling parameters may differentiate seasonal endemic cholera outbreaks from epidemics exacerbated by natural or man-made disasters. An outbreak model for a non-endemic region's population could include minimal population immunity, a high attack rate, similar attack rates among age groups and high symptomatic groups. Some models approximate drinking water bacterial concentration [Reference Kirpich69]. A comprehensive extended compartmental model for Haitian cholera transmission specified rapid human-to-human transmission and slower human-to-environment and environment-to-human transmission [Reference Grad, Miller and Lipsitch68] while incorporating cholera incidence and remote sensing data. Notably, the environmental compartment source of V. cholerae exposure was modelled separately, and incorporated environmental considerations of bacterial pathogenesis. Unsurprisingly, this model indicated that cholera outbreaks will likely continue. The uncertainties inherent in cholera modelling are such that errors in a single parameter can eliminate model predictive value [Reference Ndaba66].

Limited vaccine models were used to assess strategies for cholera outbreak control in Haiti [Reference Chao, Halloran and Longini70]. Targeting 1 000 000 doses of vaccine (enough for two doses for 5% of the population) could reduce total cases by 11%. Vaccine available for 30% of the population, coupled with hygienic improvements, could reduce cases by 55% [Reference Ndaba66]. A static cholera model was used to estimate the potential number of cholera cases averted through improvements in water, sanitation and hygiene (WASH), oral cholera vaccine (OCV), or both. Cholera incidence over 20 years was estimated using Malawian data [71]. Over the next two decades, scalable WASH interventions could avert 57 949–78 567 cholera cases, OCV could avert 38 569–77 636 cases and combined WASH and OCV interventions could avert 71 586–88 974 cases [Reference Fung72].

Recently, immunisation against cholera has improved. While studies have evaluated two-dose regimens (i.e., Dukoral and Shanchol) for cholera vaccination [Reference Mogasale73], a single-dose [Reference Jackson and Chen74] licensed cholera vaccine (Vaxchora) [75] now exists [Reference Chen76,Reference Levine77]. A consideration for Vaxchora, which warrants model forecasts, may be its prohibitive cost [78] for resource-poor nations, compared with two-dose vaccines [Reference Fung72]. Further, studies estimating cholera vaccination cost-effectiveness may neglect disease transmission predictions [Reference Schaetti79,Reference Reyburn80]. During large, prolonged outbreaks, transmission dynamics among most susceptible populations are crucial for modelling and enable a better estimate of interventions, including vaccination [Reference Azman and Lesser81].

Cholera model findings

Modelling cholera transmission provides cost–benefit evaluation for potential interventions [Reference Hutubessy82,Reference Jeuland83]. Cholera models should include contaminated water ingestion. Modelling cholera infections is difficult due to relationships between human hosts and environmental components, requiring a combined human–environment epidemiological model [Reference Wang and Liao84]. In a country with an increased susceptible population, the presence of V. cholerae in the environment, and absence of drinking water, sanitation and infrastructure improvement, cholera will likely continue. Vaccine distribution in high-risk areas is maximally efficient. Multiple modelling efforts have predicted that increased hygienic improvements, coupled with a limited vaccination campaign, may have synergistic cholera reduction effect. Sensitivity analyses of cholera models may help refine model prediction.

Typhoid

Multi-year epidemics of Salmonella enterica serovar Typhi have recently been reported from eastern and southern African nations, and a large outbreak occurred in Malawi in 2014 [Reference Reardon85]. This increase in typhoid cases may be linked to the emergence of the H58 haplotype, which often exhibits multiple drug resistance (MDR). An SIR model fitted to culture-confirmed Salmonella typhi infections at a Malawian hospital showed an increase in typhoid transmissibility due to the emergence of drug resistance associated with the H58 haplotype may help to explain the typhoid outbreaks [Reference Pitzer86]. The model included compartments for carriers and environmental reservoir, to account for regional transmission dynamics.

Typhoid model findings

Modelling supported the hypothesis that Malawian outbreaks were caused by the emergence of multiple drug resistance and recent African introduction of the H58 haplotype [Reference Reardon85], rather than urbanisation [Reference Steele87], overcrowding [Reference Karkey88] or changing immunological susceptibility [Reference Crump and Mintz89].

Discussion

Current disease models optimally build upon previous work, allowing a greater understanding and inclusion of significant factors affecting disease transmission. Existing efforts differ for each disease. Bernoulli's model of smallpox transmission was published in 1766 [Reference Dietz and Heesterbeek90], while comprehensive cholera outbreak models are recent developments [Reference Lipp, Hug and Colwell91]. Initial models constructed during the EVD outbreak included values derived from earlier outbreaks [Reference Meltzer15]. Co-infection models build upon knowledge from separate modelling for each disease [Reference Mutua, Wang and Vaidya41].

During the evolving EVD epidemic, it was difficult for modellers to rapidly determine effective outbreak cessation measures. While epidemiologic models have demonstrated utility in post-intervention evaluation [Reference Delgleize92], the inability to control the EVD epidemic brought an immediacy for disease modelling to provide solutions. Partially because of the extended nature of the outbreak, and subsequent direct discovery of sustainable successful interventions, modelling could provide vetting of proposed interventions prior to implementation. Timely modelling informed specific EVD outbreak intervention through confirming effective intervention with increased patient management capacity, surveillance and contact tracing [Reference Lukuge93]. During this epidemic, behavioural patterns in affected areas were difficult to assess. One solution was the inclusion of stochastic agent-based modelling, incorporating behavioural, demographic and movement interactions in a synthetic population with notional households, distributed according to census data. This was used by US government modellers to provide assessments to policy makers and others [Reference Dembek33]. Once initiated and sustained, behavioural change significantly impacted disease spread [Reference Gelfand94].

In future large-scale epidemics, public health authorities may not have the liberty of extensive time from outbreak initiation and spread to implement model-based interventions. Predictive models are reliable as the parameters used for their construction, and essential information may be lacking early in an outbreak. Model development for subsequent intervention proposals during a novel rapidly occurring future pandemic [Reference Shaikh95] is especially challenging, in the absence of historic outbreak data. Further, decision makers may value uncomplicated models which can be more readily modified upon request and easier to understand. This is particularly relevant as the primary purpose of disease modelling has been to inform the decision-making process.

The contemporary outbreak models are assessed in Table 1 regarding disease transmission, data sources used for the model, and benefit and lessons learned from modelling, with future model optimisation goals described. Further suggested model improvements based upon this review include:

  • In a post-EVD outbreak and influenza pandemic world, models should include potential local, regional and global health resource infrastructure effects [Reference Tatem, Rogers and Hay96,Reference Hay97].

  • Include social, geographic, behavioural and cultural disease determinants as appropriate.

  • Evaluate the effect of co-infections on endemic diseases when modelling a susceptible population. Widespread co-infections potentially impact interventions in resource-poor nations [Reference Cooper98Reference Biraro100].

  • Re-examine existing disease models when new therapies and interventions have been developed.

  • Consider model design for scenarios other than anticipated and previously modelled. One example is to model natural anthrax transmission in an endemic area [Reference Kracalik101], as most anthrax models consider deliberate epidemics [Reference Hupert63,Reference Hamilton102].

  • As available and practicable, include relevant disease agent genomic input, which may inform models with more precise pathogenicity estimation [Reference Chen103,Reference Vergnaud104].

  • Modelling should allow for scenarios where at least initial interventions become partially or wholly ineffective, i.e. ‘good’, ‘bad, and ‘ugly’ estimates. Potential causes may include decreased global antibiotic effectiveness [Reference Goff105], diminished public health [106] or financial resources [Reference Ngcamphalala and Ataguba107] and others.

Table 1. Contemporary outbreak modelling characteristics

a Although all of the diseases listed may be contracted in a laboratory accident, the 2014 discovery of viable smallpox stored unrecorded for over 60 years in an unauthorised repository laboratory demonstrates this possibility.

b Meselson et al.[Reference Meselson115]

As demonstrated during the EBV epidemic, it is exceedingly difficult for modelling to rapidly determine effective outbreak cessation measures. There are multiple inherent inaccuracies in data assessments used in disease modelling. Particularly in the early stages of an epidemic, imperfect knowledge as to which parameters are most useful for inclusion may facilitate imperfect model results [Reference Christley108]. In this regard, optimal disease models are best constructed upon conclusion of an epidemic. Useful prerequisites for modelling accuracy include:

  • Access to best available disease surveillance data, necessarily dependent upon sensitivity and specificity of the diagnostic test used, data collection methods, and assessment of underreporting [Reference Woolhouse2].

  • Interactions between risk factors (synergy) may increase disease probability and should be incorporated into a model when known. Conversely, interventions may also have synergistic effects.

  • Climate and temperature effect vector transmission [Reference Moore109].

  • Appreciate that certain behaviours are powerful risk factors for disease transmission [Reference Brainard110].

  • Knowledge of intrinsic characteristics, including herd susceptibility and population immunity.

  • Knowledge that model assumption of early exponential growth can overestimate epidemic size when early disease transmission is slowed [Reference Chowell111].

  • Knowledge that highly detailed data input required for a complex model may not necessarily generate more accurate predictive results than a simplified model [Reference Blower and Go112].

  • A simplified model is not simplistic; this design may be used to model more inclusive and comprehensive concepts [Reference Hoffman113].

  • Understand that frequent model validation is required [Reference Myers114].

Conclusion

Predictive disease models constructed for past and ongoing epidemics have demonstrated value formulating the public health response. Disease models permit effects estimation for various transmission modalities, interactions between populations, and mitigating applications of antimicrobials, vaccines and other public health measures. Public health intervention planning models for some diseases should be regularly examined in consideration of currently available pharmaceutical and non-pharmaceutical interventions. Diseases considered for modelling as deliberate releases should be more extensively modelled as natural outbreaks. Increasing demands will likely be made that future modelling for emerging diseases provide more rapid results and greater utility to achieve a successful outbreak response.

Acknowledgements

This work was funded by DTRA, contract: HDTRA 1-09-D-0009. The authors would like to thank Dr Martin Meltzer of the U.S. Centers for Disease Control and Prevention, Dr Dana Meranus of Battelle, and Dr Kierstyn Schwartz of ARA, for their helpful comments. The authors also thank the anonymous reviewers whose feedback was especially beneficial.

References

1.Scholthof, KB (2007) The disease triangle: pathogens, the environment and society. Nature Reviews Microbiology 5(2), 152156.CrossRefGoogle ScholarPubMed
2.Woolhouse, M (2011) How to make predictions about future infectious disease risks. Philosophical Transactions of the Royal Society B 366, 20452054.CrossRefGoogle ScholarPubMed
3.Hampton, T. Largest-ever outbreak of Ebola virus disease thrusts experimental therapies, vaccines into spotlight. September 20, 2014. The JAMA Network. https://jamanetwork.com/journals/jama/fullarticle/1900785.CrossRefGoogle Scholar
4.Wong, ZS, et al. (2017) A systematic review of early modeling studies of Ebola virus disease in West Africa. Epidemiology & Infection 145(6), 10691094.Google Scholar
5.WHO Ebola Response Team (2014) Ebola virus disease in West Africa – the first 9 months of the epidemic and forward projections. The New England Journal of Medicine 371(16), 14811495.Google Scholar
6.World Health Organization (2015) Factors that contributed to undetected spread of the Ebola virus and impeded rapid containment. One year into the Ebola epidemic. http://www.who.int/csr/disease/ebola/one-year-report/factors/en/.Google Scholar
7.Chowell, D et al. (2015) Modeling the effect of early detection of Ebola. The Lancet Infectious Diseases 15, 148149.CrossRefGoogle Scholar
8.Lee-Kwan, SH et al. (2017) Facilitators and barriers to community acceptance of safe, dignified medical burials in the context of an Ebola epidemic, Sierra Leone, 2014. Journal of Health Communications 22(Suppl. 1), 2430.Google Scholar
9.Centers for Disease Control and Prevention. Infection prevention and control recommendations for hospitalized patients under investigation (PUIs) for Ebola virus disease (EVD) in U.S. hospitals. September 3, 2015. https://www.cdc.gov/vhf/ebola/healthcare-us/hospitals/infection-control.html.Google Scholar
10.Out, A et al. (2017) An account of the Ebola virus disease outbreak in Nigeria: implications and lessons learnt. BMC Public Health 18, 3.Google Scholar
11.Lamb, LE et al. (2017) Formulating and improving care while mitigating risk in a military Ebola virus disease treatment unit. Journal of the Royal Army Medical Corps 163(1), 26.Google Scholar
12.Logue, CH et al. (2017) Case study: design and implementation of training for scientists deploying to Ebola diagnostic field laboratories in Sierra Leone: October 2014 to February 2016. Philosophical Transactions of the Royal Society B 372, 20160299.CrossRefGoogle ScholarPubMed
13.Sun, LH and Eilperin, J. Obama: US military to provide equipment, resources to battle Ebola epidemic in Africa. September 7, 2014. The Washington Post. https://www.washingtonpost.com/world/national-security/obama-us-military-to-provide-equipment-resources-to-battle-ebola-epidemic-in-africa/2014/09/07/e0d8dc26-369a-11e4-9c9f-ebb47272e40e_story.html?utm_term=.6f0c2483cc3b.Google Scholar
14.Centers for Disease Control and Prevention. The Road to Zero. CDC's Response to the 2014 Ebola Epidemic. July 9, 2015. https://www.cdc.gov/about/ebola/protecting-borders.html.Google Scholar
15.Meltzer, M et al. (2014) Estimating the future number of cases in the Ebola epidemic — Liberia and Sierra Leone, 2014–2015. Morbidity and Mortality Weekly Report Supplement 63(3), 114.Google Scholar
16.Fraser, C (2007) Estimating individual and household reproduction numbers in an emerging epidemic. PLoS ONE 8, e758.Google Scholar
17.Tambo, E (2014) Non-conventional humanitarian interventions on Ebola outbreak crisis in West Africa: health, ethics and legal implications. Infectious Diseases of Poverty 3, 42. http://www.idpjournal.com/content/3/1/42.CrossRefGoogle ScholarPubMed
18.Statista (2017) Ebola cases and deaths among health care workers due to the outbreaks in West African countries as of November 4, 2015. https://www.statista.com/statistics/325347/west-africa-ebola-cases-and-deaths-among-health-care-workers/.Google Scholar
19.Nyarko, Y et al. (2015) Preparing for Ebola virus disease in West African countries not yet affected: perspectives from Ghanian health professionals. Globalization and Health 11, 7.Google Scholar
20.Ebola in Africa: the end of a tragedy? Daily chart. The Economist. 14 January 2016. http://www.economist.com/blogs/graphicdetail/2016/01/daily-chart-12.Google Scholar
21.The World Bank. Physicians (per 1,000 people). http://data.worldbank.org/indicator/SH.MED.PHYS.ZS.Google Scholar
22.World Health Organization. Health worker Ebola Infections in Guinea, Liberia and Sierra Leone. A Preliminary Report. 21 May 2015. http://www.who.int/hrh/documents/21may2015_web_final.pdf.Google Scholar
23.Fidler, DP (2015) Epic failure of Ebola and global health security. Brown Journal of World Affairs 21(2), 179198. https://www.brown.edu/initiatives/journal-world-affairs/sites/brown.edu.initiatives.journal-world-affairs/files/private/articles/Fidler.pdf.Google Scholar
24.International Health Regulations (IHR). World Health Organization. http://www.who.int/topics/international_health_regulations/en/.Google Scholar
25.Poletto, C et al. (2014) Assessing the impact of travel restrictions on international spread of the 2014 West African Ebola epidemic. Euro Surveillance 19(42), 20936.Google ScholarPubMed
26.Otsuki, S and Nishiura, H (2016) Reduced risk of importing Ebola virus disease because of travel restrictions in 2014: a retrospective epidemiological modeling study. PLoS ONE 11(9), e0163418.CrossRefGoogle ScholarPubMed
27.Boguch, II et al. (2015) Assessment of the potential for international dissemination of Ebola virus via commercial air travel during the 2014 west African outbreak. The Lancet 385(9962), 2935.Google Scholar
28.Backer, JA and Wallinga, J (2016) Spatiotemporal analysis of the 2014 Ebola epidemic in West Africa. PLoS Computational Biology 12(12), e1005210.Google Scholar
29.Shoman, H, Karafillakis, E and Rawaf, S (2017) The link between the West African Ebola outbreak and health systems in Guinea, Liberia and Sierra Leone: a systematic review. Globalization and Health 13, 1.Google Scholar
30.Fielding, J. Report of the independent panel on the U.S. Department of Health and Human Services (HHS) Ebola response. June 2016. https://www.phe.gov/preparedness/responders/ebola/ebolaresponsereport/documents/ebola-panel.pdf.Google Scholar
31.Sharareh, NS, Sayama, H and MacDonald, R (2016) The Ebola crisis and the corresponding public behavior: a systems LOS dynamics approach. PLoS Currents Outbreaks. Edition 1. doi: 10.1371/currents.outbreaks.23badd9821870a002fa86bef6893c01d.Google Scholar
32.Fang, l-Q et al. (2016) Transmission dynamics of Ebola virus disease and intervention effectiveness in Sierra Leone. Proceedings of the National Academy of Sciences of the United States of America 113(16), 44884493.Google Scholar
33.Dembek, ZF et al. (2017) Operational perspective of lessons learned from the Ebola crisis. Military Medicine 182(1), e1507e1513.Google Scholar
34.Rivers, CM et al. (2014) Modeling the impact of interventions on an epidemic of Ebola in Sierra Leone and Liberia. PLoS Currents 6. doi: 10.1371/currents.outbreaks.4d41fe5d6c05e9df30ddce33c66d084c.Google Scholar
35.Earn, DJD et al. (2000) A simple model for complex dynamical transitions in epidemics. Science 287(5453), 667670.CrossRefGoogle ScholarPubMed
36.Kupferschmidt, K. Disease modelers predict a rapidly rising toll from Ebola. Science. August 31, 2004. http://www.sciencemag.org/news/2014/08/disease-modelers-project-rapidly-rising-toll-ebola.Google Scholar
37.Merler, S et al. (2015) Spatiotemporal spread of the 2014 outbreak of Ebola virus disease in Liberia and the effectiveness of non-pharmaceutical interventions: a computational modelling analysis. The Lancet Infectious Diseases 15(2), 204211.Google Scholar
38.Chowell, G et al. (2017) Perspectives on model forecasts of the 2014-2015 Ebola epidemic in West Africa: lessons and the way forward. BMC Medicine 15(1), 42.Google Scholar
39.Heesterbeek, H et al. (2015) Modeling infectious disease dynamics in the complex landscape of global health. Science 347(6227), aaa4339.Google Scholar
40.Cohen, NJ et al. (2016) Travel and border health measures to prevent the international spread of Ebola. Morbidity and Mortality Weekly Review Supplement 65(3), 5767.Google Scholar
41.Mutua, JM, Wang, F-B and Vaidya, NK (2015) Modeling malaria and typhoid fever co-infection dynamics. Mathematical Biosciences 264, 128144.Google Scholar
42.Carias, C et al. (2016) Preventive malaria treatment for contacts of patients with Ebola virus disease in the context of west Africa 2014–15 Ebola virus disease response: an economic analysis. The Lancet Infectious Diseases 16, 449458.Google Scholar
43.Kilbourne, ED (1973) An explanation of the interpandemic antigenic mutability of influenza viruses. The Journal of Infectious Diseases 128(5), 668670.Google Scholar
44.Smith, AM and McCullers, JA (2014) Secondary bacterial infections in influenza virus infection pathogenesis. Current Topics in Microbiology and Immunology 385, 327356.Google ScholarPubMed
45.Cauley, LS and Vella, AT (2015) Why is co-infection with influenza virus and bacteria so difficult to control? Discovery Medicine 19(102), 3340.Google Scholar
46.Smith, AM, et al. (2013) Kinetics of coinfection with influenza A virus and Streptococcus pneumoniae. PLoS Pathogens 9(3), e1003238.Google Scholar
47.Kilbourne, ED and Loge, JP (1950) Influenza A prime: a clinical study of an epidemic caused by a new strain of virus. Annals of Internal Medicine 33, 371379.Google Scholar
48.Baguelin, M et al. (2013) Assessing optimal target populations for influenza vaccine programs: an evidence synthesis and modeling study. PLoS Medicine 10(10), e1001527.Google Scholar
49.Mateus, ALP et al. (2014) Effectiveness of travel restrictions in the rapid containment of human influenza: a systemic review. Bulletin of the World Health Organization 92(12), 868880D.Google Scholar
50.Takeuchi, J and Yamanishi, K (2006) A unifying framework for detecting outliers and change points from time series. IEEE Transactions on Knowledge and Data Engineering 18(4), 482492.Google Scholar
51.Sharpe, JD et al. (2016) Evaluating Google, Twitter, and Wikipedia as tools for influenza surveillance using Bayesian change point analysis: a comparative analysis. JMIR Public Health and Surveillance 2(2), e161.Google Scholar
52.Boianelli, A et al. (2015) Modeling influenza virus infection: a roadmap for influenza research. Viruses 7, 52745304.CrossRefGoogle ScholarPubMed
53.World Health Organization. The smallpox eradication programme – SEP (1966-1980). May 2010. http://www.who.int/features/2010/smallpox/en/.Google Scholar
54.Centers for Disease Control and Prevention. CDC Media Statement on Newly Discovered Smallpox Specimens. July 8, 2014. https://www.cdc.gov/media/releases/2014/s0708-NIH.html.Google Scholar
55.Mizumoto, K et al. (2013) Vaccination and clinical severity: is the effectiveness of contact tracing and case isolation hampered by past vaccination? International Journal of Environmental Research and Public Health 10, 816829.Google Scholar
56.Eichner, M and Dietz, K (2003) Transmission potential of smallpox: estimates based on detailed data from an outbreak. American Journal of Epidemiology 158(2), 110117.Google Scholar
57.Stockdale, JE, Kypraios, T and O'Neill, PD (2017) Modeling and Bayesian analysis of the Abakaliki smallpox outbreak. Epidemics 19, 1323.CrossRefGoogle Scholar
58.Henderson, RH and Yekpe, M (1969) Smallpox transmission in Southern Dahomey. A study of a village outbreak. American Journal of Epidemiology 90(5), 423428.Google Scholar
59.Meltzer, M et al. (2001) Modelling potential responses to smallpox as a bioterrorist weapon. Emerging Infectious Diseases 7(6), 959969.Google Scholar
60.DTRA Technical Reachback Overview. Research and Development Directorate (J9). Information Sciences and Application Department. Technical Reachback Division. http://proceedings.esri.com/library/userconf/nss15/papers/nss_05.pdf.Google Scholar
61.Legrand, J et al. (2009) Estimating the location and spatial extent of a covert anthrax release. PLoS Computational Biology 5(1), e1000356.Google Scholar
62.Rainisch, G et al. (2017) Modeling tool for decision support during early days of an anthrax event. Emerging Infectious Diseases 23(1), 4655.Google Scholar
63.Hupert, N et al. (2009) Predicting hospital surge after a large-scale anthrax attack: a model-based analysis of CDC's cities readiness initiative prophylaxis recommendations. Medical Decision Making 29(4), 424437.Google Scholar
64.World Health Organization. Areas affected by cholera epidemics. http://www.who.int/gho/epidemic_diseases/cholera/epidemics_text/en/.Google Scholar
66.Ndaba, N. Cholera outbreak stalks Zimbabwe. Times LIVE. 11 January 2017. https://www.timeslive.co.za/news/south-africa/2017-01-11-cholera-outbreak-stalks-zimbabwe/.Google Scholar
67.Chao, DL, Longini, IM and Morris, JG (2014) Modeling cholera outbreaks. Current Topics in Microbial Immunology 379, 195209.Google Scholar
68.Grad, YH, Miller, JC and Lipsitch, M (2012) Cholera modeling: challenges to quantitative analysis and predicting the impact of interventions. Epidemiology 23(4), 523530.Google Scholar
69.Kirpich, A et al. (2015) Cholera transmission in Ouest department of Haiti: dynamic modeling and the future of the epidemic. PLoS Neglected Tropical Diseases 9(10), e0004153.CrossRefGoogle ScholarPubMed
70.Chao, DL, Halloran, ME and Longini, IM (2011) Vaccination strategies for epidemic cholera in Haiti with implications for the developing world. Proceedings of the National Academy of Sciences of the United States of America 108(17), 70817085.Google Scholar
71.World Health Organization (2013) Global Health Observatory. Number of Reported Cholera Cases. http://www.who.int/gho/epidemic_diseases/cholera/cases/en/index.html.Google Scholar
72.Fung, IC-H et al. (2013) Modeling the effect of water, sanitation, and hygiene and oral cholera vaccine implementation in Haiti. American Journal of Tropical Medicine 89(4), 633640.Google Scholar
73.Mogasale, V et al. (2016) Oral cholera vaccine delivery cost in mow- and middle-income countries: an analysis based on systematic review. PLoS Neglected Tropical Diseases 10(12), e0005124.CrossRefGoogle Scholar
74.Jackson, SS and Chen, WH (2015) Evidence for CVD 103-HgR as an effective single-dose oral cholera vaccine. Future Microbiology 10(8), 12711281.Google Scholar
76.Chen, WH et al. (2016) Single-dose live oral cholera vaccine CVD 103-HgR protects against human experimental infection with Vibrio cholerae O1 El Tor. Clinical Infectious Diseases 62(11), 13291335.Google Scholar
77.Levine, MM et al. (2017) Paxvax CVD 103-HgR single-dose live oral cholera vaccine. Expert Review of Vaccines 16(3), 197213.Google Scholar
79.Schaetti, C, et al. (2012) Costs of illness due to cholera, costs of immunization and cost-effectiveness of mass vaccination campaign in Zanzibar. PLoS Neglected Tropical Diseases 6(10), e1844.CrossRefGoogle ScholarPubMed
80.Reyburn, R et al. (2011) The case for reactive mass oral cholera vaccinations. PLoS Neglected Tropical Diseases 5(1), e952.CrossRefGoogle ScholarPubMed
81.Azman, AS and Lesser, J (2015) Reactive vaccination in the presence of disease hotspots. Proceedings of the Royal Society B 282, 20141341.Google Scholar
82.Hutubessy, R et al. (2011) Results from evaluation of models and cost-effectiveness tools to support introduction decisions for new vaccines need critical appraisal. BMC Medicine 9, 55.Google Scholar
83.Jeuland, M et al. (2009) A cost-benefit analysis of cholera vaccination programs in Beira, Mozambique. The World Bank Economic Review 23(2), 235267.Google Scholar
84.Wang, J and Liao, S (2012) A generalized cholera model and epidemic-endemic analysis. Journal of Biological Dynamics 6(2), 568589.Google Scholar
85.Reardon, S (2015) Hidden African typhoid epidemic traced to drug-resistant bacteria. Nature. http://www.nature.com/news/hidden-african-typhoid-epidemic-traced-to-drug-resistant-bacteria-1.17514.Google Scholar
86.Pitzer, VE et al. (2015) Mathematical modeling to assess the drivers of the recent emergence of typhoid fever in Blantyre, Malawi. Clinical Infectious Diseases 61 (Suppl. 4), S251–S258.Google Scholar
87.Steele, ADD et al. (2016) Challenges and opportunities for typhoid fever control: a call for coordinated action. Clinical Infectious Diseases 62(Suppl. 1), S4S8.Google Scholar
88.Karkey, A, et al. (2010) The burden and characteristics of enteric fever at a healthcare facility in a densely populated area of Kathmandu. PLoS ONE 5(11), e13988.Google Scholar
89.Crump, JA and Mintz, ED (2010) Global trends in typhoid and paratyphoid fever. Clinical Infectious Diseases 50(2), 241246.Google Scholar
90.Dietz, K and Heesterbeek, JAP (2002) Daniel Bernoulli's epidemiological model revisited. Mathematical Biosciences 180, 121.Google Scholar
91.Lipp, EK, Hug, A and Colwell, RR (2002) Effects of global climate on infectious disease: the cholera model. Clinical Microbiology Reviews 15(4), 757770.Google Scholar
92.Delgleize, E et al. (2016) Cost-effectiveness analysis of routine pneumococcal vaccination in the UK: a comparison of the PHiD-CV vaccine and the PCV-13 vaccine using a Markov model. BMJ Open 6, e010776.CrossRefGoogle Scholar
93.Lukuge, K et al. (2016) Successful control of Ebola virus disease: analysis of service based data from rural Sierra Leone. PLoS Neglected Tropical Diseases 10(3), e0004498.Google Scholar
94.Gelfand, A (2016) Going viral: modeling Ebola. Biomedical Computation Review. http://biomedicalcomputationreview.org/content/going-viral-modeling-ebola.Google Scholar
95.Shaikh, A (2018) The World Health Organization wants you to worry about “disease X”. UN Dispatch. https://www.undispatch.com/world-health-organization-wants-worry-disease-x/.Google Scholar
96.Tatem, AJ, Rogers, DJ and Hay, SI (2006) Global transport networks and infectious disease spread. Advances in Parasitology 62, 293343.Google Scholar
97.Hay, SI et al. (2013) Global mapping of infectious disease. Philosophical Transactions of the Royal Society B 368(1614), 2012050.Google Scholar
98.Cooper, PJ et al. (2001) Human infection with Ascaris lumbricoides is associated with suppression of the interleukin-2 response to recombinant cholera toxin B subunit following vaccination with the live oral cholera B vaccine CVD 103-HgR. Infection and Immunity 69(3), 15741580.Google Scholar
99.Yang, T et al. (2018) High prevalence of syphilis, HBV, and HCV co-infection, and low rate of effective vaccination against hepatitis B in HIV-infected patients in West China hospital. Journal of Medical Virology 90, 101108.Google Scholar
100.Biraro, IA et al. (2014) Impact of co-infections and BCG immunisation on immune responses among household contacts of tuberculosis patients in an Ugandan cohort. PLoS ONE 9(11), e111517.Google Scholar
101.Kracalik, IT et al. (2017) Modeling the environmental suitability of anthrax in Ghana and estimating populations at risk: implications for vaccination and control. PLoS Neglected Tropical Diseases 11(10), e0005885.Google Scholar
102.Hamilton, MA, et al. (2017) Risk-based decision making for reoccupation of contaminated areas following a wide-area anthrax release. Risk Analysis. 35(7), 13481363.Google Scholar
103.Chen, W-J et al. (2016) Mapping the distribution of anthrax in mainland China, 2005-2013. PLoS Neglected Diseases 10(4), e0004637.Google Scholar
104.Vergnaud, G et al. (2016) Comparison of French and worldwide Bacillus anthracis strains favors a recent, post-Columbian origin of the predominant North-American clade. PLoS ONE 11(2), e0146216.Google Scholar
105.Goff, DA et al. (2017) A global call from five countries to collaborate in antibiotic stewardship: united we succeed, divided we might fail. Lancet Infectious Diseases 17, e56e63.Google Scholar
106.Editorial (2004) The catastrophic failures of public health. Lancet 363, 745.Google Scholar
107.Ngcamphalala, C and Ataguba, JE (2018) An assessment of financial catastrophe and impoverishment from out-of-pocket health care payments in Swaziland. Global Health Action 11, 1428473.Google Scholar
108.Christley, RM et al. (2013) “Wrong, but useful”: negotiating uncertainty in infectious disease modelling. PLoS ONE 8(10), e76277.Google Scholar
109.Moore, SM et al. (2012) Improvement of disease prediction and modeling through the use of meteorological ensembles: human plague in Uganda. PLoS ONE 7(9), e44431.Google Scholar
110.Brainard, J et al. (2016) Risk factors for transmission of Ebola of Marburg viral disease: a systematic review and meta-analysis. International Journal of Epidemiology 45(1), 102116.Google Scholar
111.Chowell, G et al. (2016) Mathematical models to characterize early growth: a review. Physics for the Life Sciences 18, 6697.Google Scholar
112.Blower, S and Go, M-H (2011) The importance of including dynamic social networks when modeling epidemics of airborne infections: does increasing complexity increase accuracy? BMC Medicine 9, 88.Google Scholar
113.Hoffman, B (2005) Simplified models of the relationship between health and disease. Theoretical Medicine and Bioethics 26, 355377.CrossRefGoogle Scholar
114.Myers, MF et al. (2000) Forecasting disease risk for increased epidemic preparedness in public health. Advances in Parasitology 47, 309330.Google Scholar
115.Meselson, M, et al. (1994) The Sverdlovsk anthrax outbreak of 1979. Science 266(5188), 12021208.Google Scholar
Figure 0

Table 1. Contemporary outbreak modelling characteristics