Hostname: page-component-78c5997874-fbnjt Total loading time: 0 Render date: 2024-11-02T17:35:17.118Z Has data issue: false hasContentIssue false

Modeling clinical trajectory status of critically ill COVID-19 patients over time: A method for analyzing discrete longitudinal and ordinal outcomes

Published online by Cambridge University Press:  25 April 2022

Michael J. Ward*
Affiliation:
Vanderbilt University Medical Center, Nashville, Tennessee, USA
David J. Douin
Affiliation:
University of Colorado School of Medicine, Aurora, Colorado, USA
Wu Gong
Affiliation:
Vanderbilt University Medical Center, Nashville, Tennessee, USA
Adit A. Ginde
Affiliation:
University of Colorado School of Medicine, Aurora, Colorado, USA
Catherine L. Hough
Affiliation:
Oregon Health & Science University Hospital, Portland, Oregon, USA
Matthew C. Exline
Affiliation:
Ohio State University Wexner Medical Center, Columbus, Ohio, USA
Mark W. Tenforde
Affiliation:
CDC COVID-19 Response Team, Atlanta, Georgia, USA
William B. Stubblefield
Affiliation:
Vanderbilt University Medical Center, Nashville, Tennessee, USA
Jay S. Steingrub
Affiliation:
Baystate Medical Center, Springfield, Massachusetts, USA
Matthew E. Prekker
Affiliation:
Hennepin County Medical Center, Minneapolis, Minnesota, USA
Akram Khan
Affiliation:
Oregon Health & Science University Hospital, Portland, Oregon, USA
D. Clark Files
Affiliation:
Wake Forest University Baptist Medical Center, Winston-Salem, North Carolina, USA
Kevin W. Gibbs
Affiliation:
Wake Forest University Baptist Medical Center, Winston-Salem, North Carolina, USA
Todd W. Rice
Affiliation:
Vanderbilt University Medical Center, Nashville, Tennessee, USA
Jonathan D. Casey
Affiliation:
Vanderbilt University Medical Center, Nashville, Tennessee, USA
Daniel J. Henning
Affiliation:
University of Washington School of Medicine, Seattle, Washington, USA
Jennifer G. Wilson
Affiliation:
Stanford University School of Medicine, Palo Alto, California, USA
Samuel M. Brown
Affiliation:
Intermountain Medical Center and University of Utah, Salt Lake City, Utah, USA
Manish M. Patel
Affiliation:
CDC COVID-19 Response Team, Atlanta, Georgia, USA
Wesley H. Self
Affiliation:
Vanderbilt University Medical Center, Nashville, Tennessee, USA
Christopher J. Lindsell
Affiliation:
Vanderbilt University Medical Center, Nashville, Tennessee, USA
*
Address for correspondence: M.J. Ward, MD, PhD, 1313 21st Ave South; Oxford House 312; Nashville, TN 37232, USA. Email: michael.j.ward@vumc.org
Rights & Permissions [Opens in a new window]

Abstract

Early in the COVID-19 pandemic, the World Health Organization stressed the importance of daily clinical assessments of infected patients, yet current approaches frequently consider cross-sectional timepoints, cumulative summary measures, or time-to-event analyses. Statistical methods are available that make use of the rich information content of longitudinal assessments. We demonstrate the use of a multistate transition model to assess the dynamic nature of COVID-19-associated critical illness using daily evaluations of COVID-19 patients from 9 academic hospitals. We describe the accessibility and utility of methods that consider the clinical trajectory of critically ill COVID-19 patients.

Type
Brief Report
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of The Association for Clinical and Translational Science

Introduction

The COVID-19 pandemic spurred rapid investigation to understand and predict the severity of disease among infected patients. Given the major gap in understanding of the clinical course and subsequent disease progression, the World Health Organization (WHO) emphasized daily clinical assessments of patients with COVID-19 [1]. Understanding the trajectory of rapidly progressing diseases might inform the timing of intervention, scientifically relevant endpoints for clinical trials, and help with resource capacity management such as hospital and intensive care unit (ICU) bed capacity [Reference Douin, Ward and Lindsell2].

Despite the potential advantages of full information on clinical trajectories, most trials have compared treatment groups at cross-sectional timepoints, e.g., 14 or 30 days after randomization, have used ordered summary measures like ventilator-free days, or time-to-event analyses (e.g., time to recovery). Such approaches do not consider the rich information content arising from the dynamic nature of disease. Statistical methods that model dynamic outcomes have been available for some time [Reference Peña3], and the current pandemic offers the opportunity to demonstrate their real-world application.

Here, we describe the use of a state transition model to evaluate the daily course of critically ill COVID-19 patients. Widely used as a modeling approach in decision analyses and economic evaluations, state transition models conceptualize a series of potential health states and the transitions that occur between them over time [Reference Siebert, Alagoz and Bayoumi4]. Such a transition model can be simplified in the four states (Fig. 1): one starting state, two transitional states, and one absorbing state. An absorbing state is one from which patients cannot subsequently transition. A sample trajectory could be represented as a critically ill patient requiring mechanical ventilation entering the model (Starting state). On Day 1, they recover and are placed on noninvasive ventilation (State 1). On Day 2, they remain in the same state, and on Day 3, they recover and no longer require noninvasive ventilation. On Day 4, they no longer require critical care and are discharged from the ICU (absorbing state). The multistate model assumes that there is an instantaneous risk of moving between states, as represented, respectively, in the transition intensities matrix Q (Fig. 1).

Fig. 1. Simplified representation of a Markov transition model. Four states are represented: 1) starting state; 2) two transitional states; and 3) absorbing state. Arrows represent the direction of a transition. Circular arrows represent a transition to the same state. In the transition matrix (Q), the intensity reflects the frequency with which the specific transition is observed. For example, q12 represents the transition intensity (hazard) from state 1 to state 2 and covariates in the model change the magnitudes (hazard ratios) of these intensities (hazards).

Using this approach, we demonstrate how baseline demographic and clinical characteristics contribute to the trajectory of disease. We propose that such modeling approaches increase the efficiency with which information is derived from clinical research by better capturing dynamic changes in patient condition.

Methods

We collected data in real time through surveillance of patients with COVID-19 admitted to nine ICUs across the United States between March and July 2020 that were part of the CDC-funded Influenza and Other Viruses in the Acutely Ill (IVY) network [Reference Douin, Ward and Lindsell2,Reference Self, Tenforde and Stubblefield5,Reference Lytle, Collins and Feldstein6]. Patients were included if they tested positive for SARS-CoV-2 and were admitted to an ICU at any time during their index hospitalization. Through chart abstraction using standardized case report forms, baseline demographics and comorbidities were obtained, and a clinical status scale was assessed daily from ICU admission until either discharge from the ICU, death, or 28 days in the ICU. The five-level scale included 1) discharged alive from the ICU, 2) no supplemental oxygen but still in the ICU, or supplemental oxygen therapy by standard mask or nasal cannula but still in the ICU, 3) high-flow nasal cannula or noninvasive ventilation (continuous positive airway pressure or bilevel positive airway pressure ), 4) invasive mechanical ventilation or extracorporeal membrane oxygenation (ECMO) and 5) death. Patients were classified each calendar day based on the highest level reached for that day. A state transition was defined as movement on the five-level clinical scale from one day to the next consecutive day during the ICU admission. We excluded patients for whom ICU data were not available or who had an ICU length of stay of one day or less as no state transition could occur.

Statistical model

We constructed a multistate Markov transition model to describe the individual patient’s process of transition through the 5 ordinal states over a single ICU stay. Readmissions were treated as new ICU stays [Reference Jackson7]. Discharge from the ICU and death were considered absorbing states. For patients not in absorbing states there are three types of transitions: 1) disease progression, in which their daily status worsens (e.g., conventional supplemental oxygen to ECMO), 2) disease recovery, when a patient’s daily status improves (e.g., mechanical ventilation to supplemental oxygen), or 3) unchanged, when a patient’s clinical status is unchanged from the prior day. Throughout an ICU stay, multiple daily transitions were possible.

From chart review, we included the following covariates: sex, age group (18–49, 50–64, 65+ years), race-ethnicity group (non-Hispanic White, non-Hispanic Black, Hispanic, and Other), and presence of any of 10 comorbidities (asthma, chronic obstructive pulmonary disease, stroke, coronary artery disease, diabetes mellitus, obesity, hypertension, chronic kidney disease, heart failure, or immunosuppression). Each comorbidity was treated as a binary variable for the historical presence or absence of that condition prior to admission. To reduce the number of covariates in the multistate transition model, we applied a restrained proportional hazard model. While there was a unique base transition intensity for every transition between two states, we assume all covariates have the same effects (hazard ratios) on all progressive and recovery transitions. In other words, our model estimated one average hazard ratio for each covariate effect on either all progressive transitions or all recovery transitions. This parsimonious model would be most indicative of clinical decision-making about potential transition status (progression vs. recovery) for the next day. All analyses were conducted in R version 4.0.3 [Reference Team8], and the multistate model was applied using the msm package [Reference Jackson9]. This activity was reviewed by CDC and was conducted consistent with applicable federal law and CDC policy (see e.g., 45 C.F.R. part 46.102(l)(2), 21 C.F.R. part 56; 42 U.S.C. Sect. 241(d); 5 U.S.C. Sect. 552a; 44 U.S.C. Sect. 3501 et seq.).

Results

We included 514 patients representing 516 ICU admissions from March to July 2020. The two repeat ICU admissions were considered as independent events in the demonstration analysis; the lack of systematic capture of states after ICU discharge precluded inclusion of return to the ICU as a meaningful transition. The cohort is described in Table 1. There were between 1 and 152 cases at each of the nine sites. Participants had a median age of 61.7 (interquartile range [IQR] 50.2–71.3) years, 210 (41%) were aged 65 years or older, 166 (32%) were women, 169 (33%) were non-Hispanic White, 133 (26%) were non-Hispanic Black, and 158 (31%) were Hispanic of any race. Among the 516 admissions, 338 (66%) received mechanical ventilation and/or ECMO at some point during their ICU stay. Overall, 134 (26%) died during their ICU stay. The median ICU length of stay was 8 (IQR 3–17) days. We observed a total of 5,607 transitions. Among the three potential statuses for each transition (disease progression, disease recovery, and unchanged), there were 292 (5.2%) disease progressions from 222 unique patients, 469 (8.4%) recoveries from 351 unique patients, and the remainder were unchanged.

Table 1. Demographics of the COVID-19 intensive care unit (ICU) stay cohort in nine participating hospitals, March–July 2020

* Categories presented are mutually exclusive and represent the most severe clinical state on 1 or more days during ICU admission, e.g., if patient died in the ICU but received invasive mechanical ventilation before death they are classified as “Death.”

Transition states add up to > 100% as a patient could experience both recovery and progression transitions during ICU admission.

Proportional hazards for recovery or progression on any given day are shown in Fig. 2. In the multistate transition model, males and older persons had lower probabilities of recovery transition on any given day: (hazard ratio [HR] for males 0.78, 95% CI 0.63, 0.95); HR 0.68 (95% CI 0.54, 0.87) for the 50–64 years age group and HR 0.70 (95% CI 0.53, 0.91) in the ≥65 age group (reference group: 18- to 49-year-olds). Moreover, those in the oldest age group (65+ years) were more likely to progress (HR 1.97 95% CI 1.35, 2.86) than recover. Among the studied comorbidities, patients with COPD were more likely to progress on any given day compared with patients without COPD (HR 1.44 95% CI 1.00, 2.06). Extensions to this modeling strategy would allow the transition probabilities to vary over time within subgroups and for the introduction of intercurrent events that might even inform state transitions, such as the use of concomitant therapy.

Fig. 2. Adjusted hazard ratios of progression and recovery from COVID-19 using a multistate transition model in ptients admitted to the intensive care units (ICUs) in nine participating hospitals, March–July 2020. Note: Adjusting variables included all of the following: sex, age group (18–49, 50–64, 65+ years), race-ethnicity group (non-Hispanic White, non-Hispanic Black, Hispanic, and Other), or the presence of any of 10 comorbidities (asthma, chronic obstructive pulmonary disease, stroke, coronary artery disease, diabetes mellitus, obesity, hypertension, chronic kidney disease, heart failure, or immunosuppression).

Discussion

This multisite analysis of data from nine academic ICUs models daily clinical trajectory for critically ill COVID-19 patients early in the pandemic. Our findings are consistent with prior research, showing that male sex [Reference Peckham, de Gruijter and Raine10] and older age [Reference Rosenthal, Cao, Gundrum, Sianis and Safo11] are risk factors for poor prognosis in critically ill patients with COVID-19. By showing how the probability of progressing or recovering on any given day depends on baseline covariates, we demonstrate that a multistate transition model based on daily assessments of an ordinal clinical state can offer additional information beyond studies that consider single times or events. This method could prove useful in understanding how therapies affect disease trajectory and may complement traditional clinical trials.

Through this report, we demonstrate how modeling daily assessments could improve our ability to understand the clinical course of critically ill patients with COVID. In the 516 admissions analyzed, we identified over 6,000 daily states reflecting over 5,600 possible state changes. State changes occurred frequently, underscoring the dynamic nature of critical illness in COVID-19. Incorporating temporal information could help to improve our understanding of factors that affect the need for respiratory support in the critical care setting for future pandemics. Further, evaluation of subgroups (e.g., patient demographics or clinical characteristics) is possible and could be pursued to elucidate potential implications for specific patient populations.

This report is intended as a demonstration that the use of transition state modeling provides utility in evaluating the transition of patients between different states of health during critical illness. As such, we have offered a reasonably simplistic treatment of the data. A more thorough treatment of these data would involve exploring the proportionality assumption, accounting for the within-subject and within-site correlation for the repeat admissions, allowing the effects of baseline covariates or treatments to differ depending on the level of the outcome (i.e., level on the clinical scale), to include time-varying covariates (e.g., clinical severity), including differential effects of each covariate, and to explore time by treatment interaction effects. The focus of this work is also restricted to events that occurred in the ICU; states that occurred during the remainder of hospitalizations were not included. A more systematic evaluation of health state after ICU discharge may have allowed us to model the risk of return to the ICU, or return of symptoms and would be recommended. Recognizing that worsening can occur after an improvement is a strength of longitudinal modeling strategies over methods that evaluate time to recovery.

We caution readers not to overinterpret our report; whether the current clinical trajectory of patients in ICUs remains similar is unknown as management practices have changed and additional therapeutic options have become available [Reference Beigel, Tomashek and Dodd12,13]. Such a phenomenon could be explored by considering the period of the pandemic as a covariate in the model We also note that our outcome scale is restricted to a subset of the WHO’s 11-point Clinical Progression Scale [1], which covers the entire spectrum of COVID-19 from undetectable viral levels through death. Given the challenge of obtaining daily observational surveillance data subsequent to ICU discharge, our outcome scale is only comparable to the WHO Clinical Progression Scale for inpatients. Finally, our simplifying assumption allows for the demonstration of this transition model. Removing this assumption could allow for a more thorough understanding of the relationship each covariate has on clinical progression or recovery. Despite the limitations in both the interpretation and scope of our demonstration model, we posit that this approach would be similarly informative if routine assessments were available in any patient setting and for any ordered scale that is reflective of patients’ experience. Indeed, the approach that we describe here is applicable to other diseases, specific subgroups within our current population, to future COVID-19 surges, and to future epidemics and pandemics.

Conclusions

Using a multistate model of daily assessments, we have demonstrated a method of modeling the dynamic nature of critical illness in COVID-19 patients as it relates to baseline covariates. Future use of methods such as these for modeling change over time could improve our understanding of how therapies and other interventions influence the clinical trajectory of all patients, not just critically ill patients with COVID-19.

Acknowledgments

Primary funding for this work was provided by the Centers for Disease Control and Prevention (contract 75D30120C07637). The data tools used in the study were supported by Clinical and Translational Science Award No. UL1 TR002243 from the National Center for Advancing Translational Sciences.

Disclaimer

The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Disclosures

All authors have completed and submitted the International Committee of Medical Journal Editors form for disclosure of potential conflicts of interest. Dr Ginde reports grants from CDC, during the conduct of the study; grants from NIH, grants from Department of Defense, grants from AbbVie, grants from Faron Pharmaceuticals, outside the submitted work. Matthew C. Exline reports talks on nutrition in COVID pneumonia at APEN conference sponsored by Abbott Labs. Akram Khan reports grants from United Therapeutics, Johnson & Johnson, 4D Medical, Lung LLC, and Reata Pharmaceuticals. D. Clark Files reports consultant fees from Cytovale and membership on a Medpace Data Safety Monitoring Board (DSMB). Dr Rice reports grants from Centers for Disease Control (CDC), during the conduct of the study; personal fees from Cumberland Pharmaceuticals, Inc., personal fees from Cytovale, Inc., personal fees from Sanofi, Inc., outside the submitted work. Jonathan D. Casey reports a grant (N23HL153584) from the National Institutes of Health (NIH). Daniel J. Henning reports consulting fees from Cytovale and Opticyte. Samuel M. Brown reports fees from Hamilton for chairing a DSMB, and institutional fees from Faron, Sedana, and Janssen; grants from Sedana, Janssen, NIH, and the Department of Defense (DoD); book royalties from Oxford University and Brigham Young University; and personal fees from New York University for service on a DSMB. Wesley H. Self reports grant funding from CDC for this work; grants and consultant fees from Merck outside this work and consultant fees from Aerpio Pharmaceuticals outside this work. Christopher J. Lindsell reports grants from NIH, DoD, and the Marcus Foundation; organizational contract fees from bioMerieux, Endpoint LLC, and Entegrion, Inc.; and a patent issued to Cincinnati Children’s Hospital Medical Center for risk stratification in sepsis and septic shock. No other potential conflicts of interest were disclosed.

References

W. H. O. Working Group on the Clinical Characterisation Management of Covid-infection. A minimal common outcome measure set for COVID-19 clinical research. The Lancet Infectious Diseases 2020; 20(8): e192e197.CrossRefGoogle Scholar
Douin, DJ, Ward, MJ, Lindsell, CJ, et al. ICU bed utilization during the coronavirus disease 2019 pandemic in a multistate analysis—March to June 2020. Critical Care Explorations 2021; 3(3): e0361.CrossRefGoogle Scholar
Peña, EA. Dynamic modelling and statistical analysis of event times. Stat Sci 2006 Nov; 21(4): 126. DOI 10.1214/088342306000000349.CrossRefGoogle Scholar
Siebert, U, Alagoz, O, Bayoumi, AM, et al. State-transition modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-3. Medical Decision Making 2012; 32(5): 690700.CrossRefGoogle ScholarPubMed
Self, WH, Tenforde, MW, Stubblefield, WB, et al. Seroprevalence of SARS-CoV-2 among frontline health care personnel in a multistate hospital network - 13 academic medical centers, April-June 2020. MMWR. Morbidity and Mortality Weekly Report 2020; 69(35): 12211226.CrossRefGoogle Scholar
Lytle, KL, Collins, SP, Feldstein, LR, et al. Influenza vaccine acceptance and hesitancy among adults hospitalized with severe acute respiratory illnesses, United States 2019-2020. Vaccine. 2021; 39(37): 52715276.CrossRefGoogle Scholar
Jackson, C. Multi-state Modelling with R: The msm Package. Cambridge, UK, 2007:, 153.Google Scholar
Team, RC. R: a language and environment for statistical computing. Published 2021. Accessed. Available at: https://www.R-project.org/.Google Scholar
Jackson, CH. Multi-State models for panel data: the msm package for R. Journal of Statistical Software. 2011; 38(8): 128.CrossRefGoogle Scholar
Peckham, H, de Gruijter, NM, Raine, C, et al. Male sex identified by global COVID-19 meta-analysis as a risk factor for death and ITU admission. Nature Communications 2020; 11(1): 6317.CrossRefGoogle ScholarPubMed
Rosenthal, N, Cao, Z, Gundrum, J, Sianis, J, Safo, S. Risk factors associated with in-hospital mortality in a US national sample of patients with COVID-19. JAMA Network Open 2020; 3(12): e2029058.CrossRefGoogle Scholar
Beigel, JH, Tomashek, KM, Dodd, LE, et al. Remdesivir for the treatment of Covid-19 - final report. New England Journal of Medicine 2020 Nov 5; 383(19): 18131826. DOI 10.1056/NEJMoa2007764.CrossRefGoogle Scholar
RECOVERY Collaborative Group. Dexamethasone in hospitalized patients with Covid-19. New England Journal of Medicine 2021 Feb 25; 384(8): 693704. DOI 10.1056/NEJMoa2021436.CrossRefGoogle Scholar
Figure 0

Fig. 1. Simplified representation of a Markov transition model. Four states are represented: 1) starting state; 2) two transitional states; and 3) absorbing state. Arrows represent the direction of a transition. Circular arrows represent a transition to the same state. In the transition matrix (Q), the intensity reflects the frequency with which the specific transition is observed. For example, q12 represents the transition intensity (hazard) from state 1 to state 2 and covariates in the model change the magnitudes (hazard ratios) of these intensities (hazards).

Figure 1

Table 1. Demographics of the COVID-19 intensive care unit (ICU) stay cohort in nine participating hospitals, March–July 2020

Figure 2

Fig. 2. Adjusted hazard ratios of progression and recovery from COVID-19 using a multistate transition model in ptients admitted to the intensive care units (ICUs) in nine participating hospitals, March–July 2020. Note: Adjusting variables included all of the following: sex, age group (18–49, 50–64, 65+ years), race-ethnicity group (non-Hispanic White, non-Hispanic Black, Hispanic, and Other), or the presence of any of 10 comorbidities (asthma, chronic obstructive pulmonary disease, stroke, coronary artery disease, diabetes mellitus, obesity, hypertension, chronic kidney disease, heart failure, or immunosuppression).