Introduction
Members of the public, including patients, seek information about clinical trials for many reasons. Motivations include: exploring trials that might offer different treatment options and learning about interventions under study for a family member’s condition. Yet, there is usually no one within a typical healthcare system with both the expertise and supported time to walk a patient through various trial options. Recent enhancements to ClinicalTrials.gov are intended to further increase public transparency and availability of trial information [1], and some groups have created trial listings or other trial finding assistance [2, 3]. However, the searcher must weigh various search options that are often not optimized for lay audiences. These disconnects can lead to patients missing viable trial options. Thus, trial participants may represent an alarmingly small subset, with many others unfortunately winnowed out by various challenges.
Public desire to find currently recruiting trials dovetails with recruitment needs among investigators [Reference Kadam4–Reference Sibai, Carlisle and Tornetta6], a well-documented challenge to the efficient translation of new therapies into better treatments for patients [Reference Oude Rengerink7, Reference Campbell8]. Research has demonstrated that many patients are unaware of how to find information about clinical trials [Reference Heller9, Reference Caldwell10] and are often unable to interpret available information [Reference Friedman11, Reference Montalvo and Larson12]. These issues may have even stronger effects in under-represented populations [Reference Heller9].
Mounting Emphasis on Transparency and Patient Access to Trial Information
Over the last two decades, there have been a number of national activities surrounding the enhancement of public transparency in clinical trials. Expansions to the National Institutes of Health (NIH) ClinicalTrials.gov trial registry have particularly influenced the availability of standard data describing studies in the United States [Reference Zarin13, Reference Zarin14].
A driving force in federal activities has been meeting the regulatory requirements [Reference Zarin14, Reference Zarin, Tse and Ide15]. As such, the resulting infrastructure was not primarily designed to directly support queries by prospective participants. There is clear need for further development of intermediating tools that help the public to find and interpret trial information.
Piloting a Potential Solution
We have designed and implemented a novel public-facing interface leveraging data available from clinicaltrials.gov, called ResearchMatch Trials Today, focused particularly on the needs of individuals seeking clinical trial options in the United States. This report describes the use of the tool and lessons learned during early implementation (March 2015–November 2016) after launch to the lay public.
Methods
Functionality and Design
Trials Today (https://www.trialstoday.org) uses National Library of Medicine web services [16] to download and process data from ClinicalTrials.gov related to all currently recruiting trials in the United States. Trials Today is updated daily and freely available for use by anyone without registration, with the aim of minimizing potential barriers. It has no advertising and accepts no industry sponsorship. Trials Today resides within ResearchMatch (https://www.researchmatch.org/), a national volunteer registry designed to help “match” volunteers with eligible researchers from a large consortium [Reference Harris17].
The search experience starts with an intuitive interface, where patients and families describe their goals for trial participation (see Table 1), medical condition, and geographic location to identify studies for further exploration. Our team developed framing questions by studying data elements available in each record and focusing on how prospective participants might most easily approach finding the most relevant studies. The tool also includes an advanced option for experienced searchers.
Table 1 Patient-selected purpose for Trials Today’s use using the mediated search, ranked by proportion
When a patient begins entering a term (e.g., diabetes), Trials Today maps to concept unique identifiers in the Unified Medical Language System (UMLS—curated by the NIH National Library of Medicine) to gather synonyms for retrieving all relevant trial records and to reduce typographical errors.
During the search, patients see a dynamically generated dashboard displaying the number of studies, sponsors, and conditions meeting their criteria, followed by a list of studies. Studies that are also registered in ResearchMatch are displayed first; results are then prioritized by distance, relevance to the topic, and the trial’s last verification date. The sponsor(s) and condition(s) display adjacent to each study’s title. The full record display organizes information in digestible chunks through tabs guiding participants to specific components (e.g., eligibility, and locations). Inclusion and exclusion criteria are prominent and displayed side-by-side for easier interpretation.
Trials Today also facilitates actionability by offering easy saving and sharing (via creation of a unique URL, rather than requiring an email) to facilitate informed discussion of trial options with providers, friends, and family.
To improve usability, we have made iterative refinements based on valuable feedback from the community member perspective received from the Mid-South Clinical Data Research Network Stakeholder Advisory Council and Vanderbilt’s Effective Health Communication Core.
Analysis
This report includes data from user searches in Trials Today from its launch in March 2, 2015 through November 30, 2016. Search metrics extracted from server logs have been normalized by only counting unique searches per session.
Results
From March 2015 through November 2016, the site logged 101,249 searches. Approximately 22% (n=21,827) employed the advanced search, while the majority employed the mediated search. Table 1 describes the approach selected by those using the mediated search; the largest proportion of patients were looking for studies testing new treatments for their disease/condition (29.5%). Other subgroups included healthy volunteers (17.6%) and individuals indicating that current treatment options are not effective (14.3%).
Among the 79,542 patients answering whether they are open to early phase research, 89% (n=70,777) responded yes. Analysis of queried topics indicated 13,615 different search phrases; after eliminating synonym duplication (e.g., Bassen-Kornzweig disease, and Bassen-Kornzweig syndrome), searches represented 12,649 distinct topics. Of those, 3863 directly mapped to concepts represented in conditions tagged within a trial record, while 8606 did not, likely due to various issues (e.g., misspellings, and extra specificity such as “arthritis in the lower back”). Nonmapped terms were searched as keywords.
A variety of conditions accounted for the 10 most searched for topics in Trials Today (Table 2), including mental health issues (e.g., depression, bipolar disorder), other high prevalence chronic conditions (e.g., obesity, diabetes), and less common diseases with more challenging paths to diagnosis/treatment (e.g., fibromyalgia, idiopathic pulmonary fibrosis).
Table 2 Top 10 most frequently searched conditions in Trials Today
a With regard to searchers who queried the topic “any,” we infer that some users were unaware that they could leave the condition field blank; this potential usability issue will be addressed by the team in improvements to the site’s help materials.
Comparing overlap between the three most popular mediated search questions, results indicated significant concordance across several of the top conditions (Table 3). However, the data also reveal interesting diversity. Individuals interested in new treatments also represented a small unique subset of conditions, including allergy and asthma, while cancer and sleep conditions appeared among the top hits among those interested in diagnosis, prevention, and screening studies.
Table 3 Top 10 a most frequently searched conditions among three user-selected goals for their Trials Today search
ADHD, attention deficit hyperactivity disorder; IPF, idiopathic pulmonary fibrosis.
a Topics ranked by the relative number of searches per topic in each searcher-selected trial goal category.
b These two conditions had the same number of searches among those exploring diagnosis, screening, or prevention trials.
c With regard to searchers who queried the topic “any,” we infer that some users were unaware that they could leave the condition field blank.
A total of 86,740 individuals indicated gender: 70% (n=61,098) were female and 30% (n=25,642) were male. Among those specifying age, means ranged from 31 among healthy volunteers to around 40 for other categories. Openness to travel for research also varied; while 6% were only willing to travel 5–10 miles, 63% indicated willingness to travel 25 miles, and others were willing to travel 50 (14%) or even 100 (11.6%) miles. A small but notable 5% were willing to travel 250 miles or more.
Discussion
Even in its earliest pilot phase, Trials Today logged more than 110,000 searches. The most-searched-for topics likely reflect unmet medical need and emphasize significant motivation among many affected patients to seek new options via trials. The significant majority (almost 90%) open to studies still in a very experimental stage, as well as the more than 30% willing to travel 50 miles or more to a trial site, further speaks to public willingness and desire to participate in research. The diversity among the frequently searched topics also illustrates the attractiveness of trial participation across a range of conditions with particularly challenging paths to effective management, as well as healthy volunteers.
Lessons Learned and Future Development
While some groups have created trial listing databases or provide hotline-style assistance in identifying possible trial options [2, 3, 18, Reference Rocker19], the burden remains on the patient to select a search path. Future improvements in a number of features related to readability and usability of Trials Today, identified as important opportunities for development in several existing trial search interfaces [Reference Schultz20–Reference Ogino, Takahashi and Sato24], will be focused on further increasing its relevance to individuals interested in identifying trial options.
We are currently building from our pilot Trials Today iteration to include more complex concepts around “high target” inclusion/exclusion criteria. Currently, these criteria in ClinicalTrials.gov are free-text and largely nonstandardized, varying significantly in detail and complexity. In addition, the reading level of these records can be more difficult to read than doctor notes in the electronic health record [Reference Wu25]. Using a data-driven approach to derive a semantic lexicon for eligibility criteria [Reference Luo26], we are developing techniques to assign a distinctive UMLS semantic type for each UMLS-recognizable term, thus creating unambiguous standardized structure from unstructured text. This approach will enhance search precision by including more collection and use of the patient’s demographics, condition, and medications, plus add new filtering based on health history, lifestyle, and other protocol requirements [Reference Luo, Johnson and Weng27].
Our planned incorporation of on-demand presentation of glossary support to users will also improve the readability, a key issue noted across the literature on clinical trial information access by potential participants [Reference Schultz20–Reference Bickmore22]. We anticipate that these enhancements will improve the site’s usability as well as make the tool and its content more accessible by individuals with varying health literacy, an important characteristic with important effects on users’ trial search success and satisfaction [Reference Utami23].
We are also exploring a new feature that will allow searchers to pursue more information about participation in specific studies they identify within Trials Today by having the system broker information exchange and expression of interest to individual research teams. By thus enabling actionability of the information in Trials Today, we hope that interested patients and those assisting them, such as clinicians, patient navigators, and family members, can connect more easily with study staff; we plan to collect metrics regarding user experience with this new feature, including study staff contacts and whether trial enrollment is achieved. Finally, we launched a national awareness campaign focusing on Trials Today in mid-2017, further expanding the reach of this resource.
Expanding Trials Today’s Use into Additional Applications
From our initial Trials Today tool, we developed and launched a hybridized version for use just at Vanderbilt. This Vanderbilt-branded version of the newly developed Trials Today Local platform returns only Vanderbilt’s recruiting trials and serves as our public-facing trial listing. Further, we have recently begun sharing Trials Today for similar local use at other institutions. This branded localization service is available at medical centers and research networks at no cost (https://projecttrialstoday.org/). Eleven institutions [Montefiore Medical Center/Einstein College of Medicine, We Partner for Research (Georgetown University), Massachusetts General Hospital, University of Arkansas Medical Center College of Medicine, University of Alabama Birmingham, University of Massachusetts, University of Texas Medical Branch, University of Texas Health—San Antonio, University of Texas Health Science Center at Houston, Vanderbilt University, and Washington University in St. Louis] are now using the Trials Today—Local platform as part of their institution’s public trial listing services.
Limitations
While the volume and variety of searches suggest utility of this tool, the limitations of the current data set preclude quantitative connections with downstream outcomes, such as increases in potential participant contact with study staff, referrals for enrollment, and effects on successful trial recruitment. Collection of such metrics, however, is being incorporated into ongoing enhancements to the site and its features. Further, while we have used lay feedback to improve the interface’s readability of the Trials Today site, ways to optimize Trials Today’s usability are currently being explored. Indeed, opportunities for enhancing usability have been noted by several researchers across a range of trial skearch interfaces [Reference Utami23, Reference Ogino, Takahashi and Sato24].
Conclusions
The ResearchMatch Trials Today tool was created to facilitate identification of trial opportunities for patients across the United States. Usage data to date indicates the resource is being used to identify trials for a range of health conditions, as well as to find opportunities for healthy volunteers to contribute to clinical research. The significant numbers of individuals using Trials Today in early phase work reported here, in the absence of any formal publicity, emphasizes patient need for aid in finding trial options as well as their motivation to pursue study participation. With future planned enhancements, we aim to further empower patients to find clinical trials in which to participate, leading to the discovery of more options and thus greater personal choice for individuals as well as potentially increasing recruitment efficiency in clinical research.
Acknowledgments
The authors extend their sincere thanks to the members of the Mid-South Clinical Data Research Network Stakeholder Advisory Council for their valuable input and guidance in enhancing the Trials Today tool, and Jacquelyn Favours, MPH, CHES, for synthesizing this feedback for us. The authors also wish to express their gratitude to Terri Edwards, RN, for her regulatory and conceptual insights, Alyssa Powlus, BS, for her assistance in preparing the tables for this report, Michael Russell for his programming and design guidance, and the Research Match team for their thoughtful contributions to the development and refinement of the Trials Today tool.
Financial Support
The project described was supported by awards no. UL1 TR002243 from the National Center for Advancing Translational Sciences (NCATS) and no. U24TR001579 from the NCATS and the National Library of Medicine.
Disclosures
The authors have no conflicts of interest to declare.
Disclaimer
The article is solely the responsibility of the authors and does not necessarily represent official views of the National Center for Advancing Translational Sciences, the National Library of Medicine, or the National Institutes of Health.
Open access
