Hostname: page-component-76fb5796d-zzh7m Total loading time: 0 Render date: 2024-04-27T19:31:55.979Z Has data issue: false hasContentIssue false
  • English
  • Français

Development, implementation, and dissemination of operational innovations across the trial innovation network

Published online by Cambridge University Press:  20 October 2023

Marisha E. Palm Open the ORCID record for Marisha E. Palm [Opens in a new window] ,
Terri L. Edwards ,
Cortney Wieber ,
Marie T. Kay ,
Eve Marion Open the ORCID record for Eve Marion [Opens in a new window] ,
Leslie Boone ,
Angeline Nanni ,
Michelle Jones ,
Eilene Pham  and
Meghan Hildreth
...Show all authors
Marisha E. Palm*
Affiliation:
Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA, USA Tufts Clinical and Translational Science Institute, Tufts University, Boston, MA, USA
Terri L. Edwards
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Cortney Wieber
Affiliation:
Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA, USA Tufts Clinical and Translational Science Institute, Tufts University, Boston, MA, USA
Marie T. Kay
Affiliation:
University of Utah Health, Salt Lake City, UT, USA
Eve Marion
Affiliation:
Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA
Leslie Boone
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Angeline Nanni
Affiliation:
Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
Michelle Jones
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Eilene Pham
Affiliation:
Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA
Meghan Hildreth
Affiliation:
Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
Karen Lane
Affiliation:
Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA Institute for Clinical and Translational Research, Johns Hopkins University School of Medicine, Baltimore, MD, USA
Nichol McBee
Affiliation:
Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
Daniel K. Benjamin Jr
Affiliation:
Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA Duke University School of Medicine, Durham, NC, USA
Gordon R. Bernard
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA
J. Michael Dean
Affiliation:
University of Utah Health, Salt Lake City, UT, USA
Jamie P. Dwyer
Affiliation:
University of Utah Health, Salt Lake City, UT, USA Utah Clinical and Translational Sciences Institute, Salt Lake City, UT, USA
Daniel E. Ford
Affiliation:
Institute for Clinical and Translational Research, Johns Hopkins University School of Medicine, Baltimore, MD, USA
Daniel F. Hanley
Affiliation:
Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA Institute for Clinical and Translational Research, Johns Hopkins University School of Medicine, Baltimore, MD, USA
Paul A. Harris
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA Department of Biomedical Informatics, Biostatistics, and Biomedical Engineering, Vanderbilt University Medical Center, Nashville, TN, USA
Consuelo H. Wilkins
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA Department of Internal Medicine, Meharry Medical College, Nashville, Tennessee, USA
Harry P. Selker
Affiliation:
Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA, USA Tufts Clinical and Translational Science Institute, Tufts University, Boston, MA, USA
*
Corresponding author: M. E. Palm, PhD; Email: marisha.palm@tuftsmedicine.org
Rights & Permissions [Opens in a new window]

Abstract

Improving the quality and conduct of multi-center clinical trials is essential to the generation of generalizable knowledge about the safety and efficacy of healthcare treatments. Despite significant effort and expense, many clinical trials are unsuccessful. The National Center for Advancing Translational Science launched the Trial Innovation Network to address critical roadblocks in multi-center trials by leveraging existing infrastructure and developing operational innovations. We provide an overview of the roadblocks that led to opportunities for operational innovation, our work to develop, define, and map innovations across the network, and how we implemented and disseminated mature innovations.

Keywords

Trial innovation networkCTSAclinical trialsclinical trial roadblocksinnovation
Type
Brief Report
Information
Journal of Clinical and Translational Science , Volume 7 , Issue 1 , 2023 , e251
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided that no alterations are made and the original article is properly cited. The written permission of Cambridge University Press must be obtained prior to any commercial use and/or adaptation of the article.
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of The Association for Clinical and Translational Science

Introduction

In 2015, the National Center for Advancing Translational Science (NCATS) released a funding opportunity for Innovation Centers that would leverage the strength of the existing Clinical and Translational Science Award (CTSA) Program to support the efficient and effective conduct of multi-center clinical research [1,Reference Shah, Culp and Gersing2]. The Trial Innovation Network (TIN), launched in 2016, was the latest in a series of CTSA program initiatives to support multi-center clinical research [Reference Bernard, Harris and Pulley3]. In addition to building national clinical trial infrastructure and harmonizing processes, central to the TIN is the goal of creating a national laboratory to study, understand, and innovate. Three Trial Innovation Centers (TICs) and a Recruitment Innovation Center (RIC) were established as expert hubs where innovations could be developed and tested at scale.

Clinical trials are essential for developing and testing healthcare treatments, and multi-center clinical trials allow for larger, more accurate, and generalizable assessment of efficacy and effectiveness [Reference Das4]. Adequately powered randomized controlled trials are the gold standard for testing treatments and practice patterns, but there remain significant roadblocks to trial design and conduct [Reference Crook, Pierre and Arrieta5–Reference Kasenda, von Elm and You7]. Delays in trial implementation and failure to meet recruitment and retention targets are costly wasted opportunities [Reference Fogel8,Reference Hay, Thomas, Craighead, Economides and Rosenthal9]. Additionally, poorly designed or underpowered trials can fail to be informative [Reference Khan, Fahl Mar and Brown10,Reference Zarin, Goodman and Kimmelman11]. These roadblocks and failures in trial design and implementation indicate that innovations are needed to improve the quality and conduct of clinical trials. We frame the roadblocks as opportunities for TIN activity and innovation in Fig. 1.

Figure 1. Roadblocks and barriers throughout the multi-center clinical trial lifecycle were opportunities for TIN activity and innovation. IRB = Institutional Review Board; TIN = Trial Innovation Network.

This brief report describes the process that the TIN went through to define, prioritize, map, share, implement, and disseminate innovations. The process was characterized by a network-wide openness to transparency and a desire to develop innovative and complementary ways to support efficient and effective multi-center clinical trials.

Defining and Prioritizing Operational Innovations

While establishing Network infrastructure, TIN leadership discussed the definition of operational innovation. The definition agreed upon was “A novel technology, method, process, or paradigm that can be used to improve the conduct of the clinical trial or study and/or its ultimate speed or likelihood of translation into practice.” The addition of the word operational is important as it makes operational innovation into an umbrella term that can include the full range of resources and activities that are developed to improve trial efficiency and function. This definition aligned thinking and served to underpin conversations about how best to develop and test operational innovations across the TICs and RIC.

At an in-person meeting of all TIC and RIC Principal Investigators (PIs) and Project Leads (PLs) in 2018, attendees were asked to identify the key activities important to improving the success of clinical trials. The conversation was captured, and the 39 responses provided were coded into seven categories: optimization of sites and site selection; acceleration of study startup; community involvement; development of technical resources; education and training; trial management; and trial design.

This began a focused discussion regarding priority innovations that continued in early 2019, with another in-person meeting that included a reminder of the categories identified at the 2018 meeting and a vote by PIs and PLs to prioritize related areas for innovation. The five areas chosen were as follows: Engaging Participants at the Operational Level of Clinical Trials; Study StartUp with Site Incentives and Gamification; Site Assessment; Pragmatic Trials with Limited Variables; and a Next Level Master Protocol.

Mapping and Sharing Operational Innovations

The 2019 meeting was also the start of a TIN Work Group that met to map operational innovations across the network in order to: position the network to review and consider ongoing work and plan future innovations; ensure innovative work was aligned across the TICs and RIC; allow the network to highlight innovations developed by the TIN internally and externally; and lay the groundwork for measuring the impact of innovations. The innovation development pipeline imagined by the Work Group is illustrated in Fig. 2.

Figure 2. The Trial Innovation Network (TIN) innovation development pipeline began with known roadblocks and barriers. Innovations were developed, implemented in multi-center clinical trials, and then disseminated via a variety of communication pathways. Implementation and dissemination phases of the pipeline are pictured with continuous improvement cycles to indicate iterative improvement incorporating lessons learned.

The mapping exercise culminated in a repository of operational innovations derived from the literature, past experiences of TIC and RIC institutions, and work done at the TICs and the RIC and developed and/or implemented within the TIN. This repository was built for internal use to enhance transparency and ensure work across the Network was aligned and complementary. An overview of multi-center study roadblocks and barriers, TIN activities to support operational excellence in these areas, innovation categories, and innovations within each category is listed in Table 1.

Table 1. An overview of multi-center clinical trial roadblocks and TIN activity and operational innovation to address these roadblocks

CTSA = Clinical and Translational Science Award; FDP = Federal Demonstration Partnership; TIN = Trial Innovation Network; REDCap = Research Electronic Data Capture.

To inform the development of the mapped information, a survey was distributed to 49 people including all TIN PIs, NCATS and Liaison Team Leadership, and all TIN Work Group PLs (response rate 90%). Respondents selected the term “Innovations Catalogue” to refer to the initiative, agreed on inclusion criteria and information to be contained within the catalogue, and suggested ways of incorporating the catalogue into existing TIN systems and practices. The qualitative themes that arose were: the importance of framing discussions to be inclusive of all innovations that are used to improve the conduct of clinical trials; support for doing a phased internal roll-out of the catalogue; balancing procedure and over-complexity; designing systems for implementation; focusing on TIN priority areas; and establishing a process to support innovation evaluation.

The Innovations Catalogue was implemented in a TIC- and RIC-wide accessible format in 2020 and presented to TIN leadership and PLs. In 2021, the Innovations Work Group presented again, this time on reframing the approach to innovation to be more inclusive of operational excellence. The operational innovation definition agreed to by TIN leadership was not changed; however, the Work Group wanted to be explicit in creating a more inclusive space for processes that might not be novel but had the potential to improve the conduct of clinical trials. The intention was to include valuable contributions (e.g., technologies, methods, processes, or paradigms) to clinical trial execution. While this broadened an already inclusive definition, operational innovations included in the catalogue were all focused on addressing specific barriers or inefficiencies and were tied to operational hypotheses that could be tested.

Implementing and Disseminating Operational Innovations

Operational innovations that moved from the idea stage through development and into implementation were defined as mature. Mature innovations were presented at cross-consortium Liaison Team meetings, shared with study teams in TIN consultations, published in manuscripts and white papers, and included in the publicly accessible TIN website Toolbox. A new method of identifying trials that included innovations was also developed. These trials were identified as Testing Operational Hypotheses trials and served to test innovations with the goal of improving clinical trial conduct and/or efficiency. Innovations were embedded in multi-center trials as an operational experiment, with expenses and required personnel covered by the TIC or RIC that developed the innovation.

Operational innovations were implemented either at the initial TIN consultation stage, when investigators had meetings with the TICs and RIC to discuss their support needs (e.g., Design Labs [Reference Palm, Selker, Cohen, Lerner, Palm and Concannon12]) or within TIN-supported trials (e.g., Consent Builder [Reference Sward, Enriquez and Burr13]). The Catalogue included the innovation stage – design, development, or implementation – and the trials within which the innovation had been implemented.

Examples of implementation included a survey used to aid site selection (#7 in Table 1), a program to streamline informed consent across multiple sites (#9), the ability to connect trial data collection with electronic health records (#36), and systems implemented to manage risk (#31). Across time, as innovations matured, the number of operational innovations implemented within and across trials increased. Fig. 3 shows the number of innovations implemented, excluding innovations that are implemented in ways disconnected from trial design and conduct, for example, courses and templates that cannot be tracked [Reference Cunningham-Erves, Kusnoor and Villalta-Gil14,Reference Stallings, Boyer and Joosten15].

Figure 3. Split panel depiction of Trial Innovation Network (TIN) innovation implementation during the first TIN funding cycle 2016-2023. The left-hand side (3a) shows the number of innovations implemented, with lines indicating implementation at different stages of the clinical trial life cycle. The right-hand side (3b) showcases the number of Institutional Review Board (IRB) innovations as operationalizing single IRB (SIRB) was an early identified TIN objective.

Operational innovations were implemented within more than 110 TIN trials and over 40 disease areas, with some trials including a single innovation (e.g., SIRB coordination) and others including multiple innovations (e.g., accelerated startup program, gaming and incentives, one-part vs. two-part consent documentation, and streamlining local context review). While some of the innovations were implemented at the design stage pre-funding, the majority were implemented following grant submission and successful receipt of funding. Funders included NIH institutes and centers (e.g., NCI, NHLBI, NIAID, NIDDK, NINDS, and NCATS), PCORI, DOD, industry, and foundation grants.

Evaluation is ongoing, and metrics have been published for some innovations, while others are still being tested [Reference Palm, Selker, Cohen, Lerner, Palm and Concannon12–Reference Kusnoor, Villalta-Gil and Michaels26]. A TIN Work Group established to develop metrics agreed upon 10 priority metrics and data elements to measure clinical research study performance across the Network. These metrics are related to study startup, regulatory approval, the contracting process, patient accrual, and data quality. While further details are outside of the scope of this brief report, it is worth noting that the TIN is in the early stages of collecting cross-network metrics, with a goal to evaluate effectiveness of the innovations developed and implemented.

Facilitators, Barriers, and Lessons Learned

The process of defining and mapping operational innovations was instructive. An expert network of clinical trialists from five different organizations, each with their own specific environments and operational processes, came together to agree on a definition and structure for categorizing and describing operational innovations. These spanned the clinical trial life cycle, from study design through recruitment, and study conduct. It became clear that significant work was being done in complementary areas, and that alignment among them was important.

An example was work being done to support informed consent. All organizations involved in the TICs and RIC were undertaking activities related to supporting the informed consent process. These were complementary, ranging from support for streamlining the technical process of creating and updating informed consent forms, to informed consent training methods, to the development of key information sheets that are understandable and actionable [Reference Sward, Enriquez and Burr13,Reference Markman, Weicker, Klein and Sege27]. The innovations in this area were developed into a toolkit that can be used flexibly in a fit-for-purpose way depending upon study needs [28].

The operational innovations developed and/or implemented within the TIN were designed to be broadly useful to multi-center clinical trial design and conduct. However, it is worth noting that there are elements of clinical trials that are determined by the funding source or sponsor and their requirements. This information should always be a reference point and may have an impact on the decision to implement an innovation.

Barriers to the implementation of innovations were time, cost, and concern about the innovation’s potential disruption of trial processes. The importance of early engagement with investigators to ensure their interest and support was a lesson learned. Efforts were made to guarantee operational innovations were included in a way that did not require additional PI time or expense and that innovations enhanced, rather than disrupted, trials.

The operational innovations prioritized in 2019 varied in the success of their implementation. Although study startup with site incentives/gamification and site assessment were both operationalized, implementation of a pragmatic trial with limited variables and Next Level Master Protocol has been a slower process. Engaging participants at the operational level of clinical trials was the most difficult innovation to implement given the upfront time and ongoing effort that would be required by trial investigators. Fewer foundational and more operational innovations found support and were likely to be incorporated into trials.

Future Directions

Developing and implementing innovations that address roadblocks and barriers to successful and informative clinical trials is essential to improving clinical trial quality and conduct. The development and implementation of innovations in the TIN have been extensive; however, there is still significant work to be done. Three areas for continued development are the implementation of foundational innovations, measurement of outcomes, and broad dissemination. The lessons learned in the first TIN funding cycle should inform future development in these areas.

A process for mapping innovations and tracking their implementation has been developed. These data were used to identify gaps and areas of complementarity and to prioritize future efforts. To date, implementation has been limited to operational innovations, while foundational innovations have been more difficult to implement. It may be useful to consider a separate pathway for foundational innovations that may not be easily embedded in a clinical trial. Work Groups that address the barriers and facilitators to implementation of foundational innovations, and that include stakeholders and policy makers, may help develop more successful pathways.

Establishing a national network, with aligned and efficient processes, is a significant effort. We developed processes for embedding innovations and for capturing priority metrics. However, we are only in the early stages of implementing and testing innovations at scale. We will need time and a focus on iterative process improvement to ensure that we capture the necessary information and develop appropriate statistical analysis plans.

Finally, although some pathways for dissemination have been developed, it is essential that they be expanded and that investigators are provided with support to implement the relevant innovations in their trials. This may mean an expansion of the TIN toolbox, continued work with partners at CTSA hubs to understand support needs, and internal and external meetings to highlight further areas of innovation. Dissemination and implementation methodologists could also be helpful in considering strategies for impactful and broad dissemination.

Acknowledgments

Authors acknowledge contributions from past Working Group members from Duke, Maria Cecilia Santiago-Turla, Jesse Hickerson, Kristi Romero, Jacqueline Huvane, Helen Boyle, Mali Gunawardena; Johns Hopkins, Shannon Hillery; and Vanderbilt, Colleen Lawrence, Sarah Nelson, Julia Dunagan, Stephanie Mayers. Authors also recognize important partnerships with Sarah Cook (Vanderbilt), Mary Pautler, Luca Boi, and Dixie Thompson (Utah), Ryan Majkowski (Johns Hopkins), and Jeri Burr (Utah). Finally, authors are very grateful to Emily Bartlett (Johns Hopkins) for her design support and creation of manuscript figures.

Funding statement

This content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The work was supported by the National Institutes of Health Center for Advancing Translational Sciences (NCATS) and the National Institute on Aging, in support of the Trial Innovation Network under grant numbers U24TR001579 (Vanderbilt University), U24TR001597 (University of Utah), U24TR001608 (Duke/Vanderbilt Universities), and U24TR001609 (Johns Hopkins/Tufts Universities).

Competing interests

None of the authors have competing interests related to this manuscript.

Footnotes

Consuelo H. Wilkins and Harry P. Selker are joint senior authors.

References

New Funding Opportunities for Trial and Recruitment Innovation Centers. National Center for Advancing Translational Sciences. Published April 25, 2015. https://ncats.nih.gov/news/releases/2015/ctsa-ric-tic-funding. Accessed May 2, 2023.Google Scholar
Shah, MR, Culp, MA, Gersing, KR, et al. Early vision for the CTSA program trial innovation network: a perspective from the national center for advancing translational sciences. Clin Transl Sci. 2017;10(5):311–313. doi: 10.1111/cts.12463.CrossRefGoogle ScholarPubMed
Bernard, GR, Harris, PA, Pulley, JM, et al. A collaborative, academic approach to optimizing the national clinical research infrastructure: the first year of the trial innovation network. J Clin Transl Sci. 2018;2(4):187–192. doi: 10.1017/cts.2018.319.CrossRefGoogle ScholarPubMed
Das, MK. Multicenter studies: relevance, design and implementation. Indian Pediatr. 2022;59(7):571–579.CrossRefGoogle ScholarPubMed
Crook, ED, Pierre, K, Arrieta, MA. Identifying and overcoming roadblocks that limit the translation of research findings to the achievement of health equity. J Health Care Poor Underserved. 2019;30(4 Suppl):43–51. doi: 10.1353/hpu.2019.0114.CrossRefGoogle Scholar
Reith, C, Landray, M, Devereaux, PJ, et al. Randomized clinical trials — removing unnecessary obstacles. N Engl J Med. 2013;369(11):1061–1065. doi: 10.1056/NEJMsb1300760.CrossRefGoogle ScholarPubMed
Kasenda, B, von Elm, E, You, J, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. 2014;311(10):1045–1051. doi: 10.1001/jama.2014.1361.CrossRefGoogle ScholarPubMed
Fogel, DB. Factors associated with clinical trials that fail and opportunities for improving the likelihood of success: a review. Contemp Clin Trials Commun. 2018;11:156–164. doi: 10.1016/j.conctc.2018.08.001.CrossRefGoogle ScholarPubMed
Hay, M, Thomas, DW, Craighead, JL, Economides, C, Rosenthal, J. Clinical development success rates for investigational drugs. Nat Biotechnol. 2014;32(1):40–51. doi: 10.1038/nbt.2786.CrossRefGoogle ScholarPubMed
Khan, A, Fahl Mar, K, Brown, WA. The impact of underpowered studies on clinical trial results. Am J Psychiatry. 2018;175(2):188–188. doi: 10.1176/appi.ajp.2017.17091016.CrossRefGoogle ScholarPubMed
Zarin, DA, Goodman, SN, Kimmelman, J. Harms from uninformative clinical trials. JAMA. 2019;322(9):813. doi: 10.1001/jama.2019.9892.CrossRefGoogle ScholarPubMed
Palm, ME, Selker, HP, Cohen, T, et al. Broadly engaged team science comes to life in a design lab. In: Lerner, D, Palm, ME, Concannon, TW, eds. Broadly Engaged Team Science in Clinical and Translational Research. Springer International Publishing; 2022:47–53. doi: 10.1007/978-3-030-83028-1_6.CrossRefGoogle Scholar
Sward, KA, Enriquez, R, Burr, J, et al. Consent builder: an innovative tool for creating research informed consent documents. JAMIA Open. 2022;5(3):ooac069. doi: 10.1093/jamiaopen/ooac069.CrossRefGoogle ScholarPubMed
Cunningham-Erves, J, Kusnoor, SV, Villalta-Gil, V, et al. Development and pilot implementation of guidelines for culturally tailored research recruitment materials for African Americans and Latinos. BMC Med Res Methodol. 2022;22(1):248. doi: 10.1186/s12874-022-01724-4.CrossRefGoogle ScholarPubMed
Stallings, SC, Boyer, AP, Joosten, YA, et al. A taxonomy of impacts on clinical and translational research from community stakeholder engagement. Health Expect Int J Public Particip Health Care Health Policy. 2019;22(4):731–742. doi: 10.1111/hex.12937.Google ScholarPubMed
Johnson, AR, Kasimatis Singleton, M, Ozier, J, et al. Key lessons and strategies for implementing single IRB review in the trial innovation network. J Clin Transl Sci. 2022;6(1):e53. doi: 10.1017/cts.2022.391.CrossRefGoogle ScholarPubMed
Burr, JS, Johnson, A, Risenmay, A, et al. Demonstration project: transitioning a research network to new single IRB platforms. Ethics Hum Res. 2022;44(6):32–38. doi: 10.1002/eahr.500149.CrossRefGoogle Scholar
Serdoz, ES, Edwards, T, Pulley, J, et al. The IRB reliance exchange (IREx): a national web-based platform for operationalizing single IRB review. J Clin Transl Sci. 2022;6(1):e39. doi: 10.1017/cts.2022.376.CrossRefGoogle ScholarPubMed
VanBuren, JM, Roalstad, S, Kay, MT, Zuspan, SJ, Dean, JM, Brulotte, M. Development of a risk assessment and risk management tool for an academic research organization. Contemp Clin Trials. 2022;119:106812. doi: 10.1016/j.cct.2022.106812.CrossRefGoogle ScholarPubMed
Lane, K, Majkowski, R, Gruber, J, et al. Using gamification to enhance clinical trial start-up activities. J Clin Transl Sci. 2022;6(1):e75. doi: 10.1017/cts.2022.405.CrossRefGoogle ScholarPubMed
Selker, HP, Gorman, S, Kaitin, KI. Efficacy-to-effectiveness clinical trials. Trans Am Clin Climatol Assoc. 2018;129:279–300.Google ScholarPubMed
Selker, HP, Eichler, HG, Stockbridge, NL, et al. Efficacy and effectiveness too trials: clinical trial designs to generate evidence on efficacy and on effectiveness in wide practice. Clin Pharmacol Ther. 2019;105(4):857–866. doi: 10.1002/cpt.1347.CrossRefGoogle ScholarPubMed
Selker, HP, Cohen, T, D’Agostino, RB, et al. A useful and sustainable role for N-of-1 trials in the healthcare ecosystem. Clin Pharmacol Ther. 2022;112(2):224–232. doi: 10.1002/cpt.2425.CrossRefGoogle ScholarPubMed
Fritter J, Metheney M, Zuspan SJ. Impact of a Risk-Based, Study-Specific Training Program on Research Coordinator Competency. ACRP. Published June 9, 2020. https://www.acrpnet.org/2020/06/09/impact-of-a-risk-based-study-specific-training-program-on-research-coordinator-competency/. Accessed May 19, 2023.Google Scholar
Harris, PA, Swafford, J, Serdoz, ES, et al. MyCap: a flexible and configurable platform for mobilizing the participant voice. JAMIA Open. 2022;5(2):ooac047. doi: 10.1093/jamiaopen/ooac047.CrossRefGoogle ScholarPubMed
Kusnoor, SV, Villalta-Gil, V, Michaels, M, et al. Design and implementation of a massive open online course on enhancing the recruitment of minorities in clinical trials - faster together. BMC Med Res Methodol. 2021;21(1):44. doi: 10.1186/s12874-021-01240-x.CrossRefGoogle ScholarPubMed
Markman, KM, Weicker, NP, Klein, AK, Sege, R. Community-engaged training in informed consent. J Clin Transl Sci. 2023;7(1):e108. doi: 10.1017/cts.2023.534.CrossRefGoogle ScholarPubMed
Trial Innovation Network Informed Consent Toolkit. TIN Informed Consent Work Group. https://trialinnovationnetwork.org/material-details/?ID=188. Accessed July 2023.Google Scholar
Lawrence, CE, Dunkel, L, McEver, M, et al. A REDCap-based model for electronic consent (eConsent): moving toward a more personalized consent. J Clin Transl Sci. 2020;4(4):345–353. doi: 10.1017/cts.2020.30.CrossRefGoogle Scholar
Figure 0

Figure 1. Roadblocks and barriers throughout the multi-center clinical trial lifecycle were opportunities for TIN activity and innovation. IRB = Institutional Review Board; TIN = Trial Innovation Network.

Figure 1

Figure 2. The Trial Innovation Network (TIN) innovation development pipeline began with known roadblocks and barriers. Innovations were developed, implemented in multi-center clinical trials, and then disseminated via a variety of communication pathways. Implementation and dissemination phases of the pipeline are pictured with continuous improvement cycles to indicate iterative improvement incorporating lessons learned.

Figure 2

Table 1. An overview of multi-center clinical trial roadblocks and TIN activity and operational innovation to address these roadblocks

Figure 3

Figure 3. Split panel depiction of Trial Innovation Network (TIN) innovation implementation during the first TIN funding cycle 2016-2023. The left-hand side (3a) shows the number of innovations implemented, with lines indicating implementation at different stages of the clinical trial life cycle. The right-hand side (3b) showcases the number of Institutional Review Board (IRB) innovations as operationalizing single IRB (SIRB) was an early identified TIN objective.