Research mentor training is a valuable professional development activity. Options for training customization (by delivery mode, dosage, content) are needed to address the many critical attributes of effective mentoring relationships and to support mentors in different institutional settings.

We conducted a pilot randomized controlled trial to evaluate a hybrid mentor training approach consisting of an innovative, 90-minute, self-paced, online module (Optimizing the Practice of Mentoring, OPM) followed by workshops based on the Entering Mentoring (EM) curriculum. Mentors (n = 59) were randomized to intervention or control arms; the control condition was receipt of a two-page mentoring tip sheet. Surveys (pre, post, 3-month follow up) and focus groups assessed training impact (self-appraised knowledge, skills, behavior change) and participants’ perceptions of the blended training model.

The intervention (∼6.5 hours) produced significant improvements in all outcomes, including skills gains on par with those reported previously for the 8-hour EM model. Knowledge gains and intention-to-change mentoring practices were realized after completion of OPM and augmented by the in-person sessions. Mentors valued the synergy of the blended learning format, noting the unique strengths of each modality and specific benefits to completing a foundational online module before in-person engagement.

Findings from this pilot trial support the value of e-learning approaches, both as standalone curricula or as a component of hybrid implementation models, for the professional development of research mentors.

Increased endogenous acetate production (Ra) in rodents has been shown to activate the parasympathetic nervous system and thereby promote increased glucose-stimulated insulin secretion (GSIS), increased ghrelin secretion, hyperphagia and obesity.

To examine whether rates of acetate turnover are different in lean versus obese humans and whether increased acetate turnover promotes increased GSIS and increased ghrelin secretion in humans.

Basal acetate Ra was measured following an overnight fast in lean (BMI: 21.3 ± 1.1 Kg/m2) and obese (30.2 ± 0.9 Kg/m2, P = 0.00001) individuals. The subjects underwent two hyperglycemic (10 mmol/L) clamp studies to measure GSIS during a basal acetate infusion and during a high-dose acetate infusion increasing plasma acetate concentrations ∼5-fold.

Basal acetate Ra was 30% higher in the lean compared to the obese subjects (257 ± 27 vs. 173 ± 18 μmol/min; P = 0.025). Basal plasma insulin concentrations were 4-fold higher in the obese than the lean subjects (P = 0.008) and increased 5-fold during hyperglycemia in both groups, independent of changes in plasma acetate concentrations. Fasting plasma ghrelin concentrations were 35% lower in the obese compared to the lean subjects (P = 0.015). During the hyperglycemic clamp, plasma ghrelin decreased by 42% in the lean group (P < 0.022 vs. basal) and did not change in the obese group.

Rates of endogenous acetate turnover are ∼30% higher in the lean subjects compared to the obese subjects, and increasing plasma acetate turnover does not promote increased GSIS or ghrelin secretion in either group.

Advancing understanding of human health promotion and disease prevention and treatment often requires teamwork. To evaluate academic medical institutions’ support for team science in the context of researchers’ career development, we measured the value placed on team science and specificity of guidance provided for documenting team science contributions in the promotion and tenure (P&T) documents of Colleges/Schools of Medicine (CoMs) in the National Center for Advancing Translational Sciences’ Clinical and Translational Science Award (CTSA) program.

We reviewed complete P&T documents from 57 of 63 CTSA CoMs to identify career paths defined by three dimensions: academic rank (associate versus full professor), tenure eligibility (tenure track versus not), and role (research, clinical, education, and administrative), and we rated team science value and documentation guidance for each path. Multilevel models were estimated to compare team science value and documentation guidance as a function of the three career path dimensions while accounting for the clustered data (N = 357 career paths within 57 CoMs).

Team science value was greater for associate than full professors, non-tenure-eligible versus tenure-eligible positions, and roles prioritizing clinical, education, and administrative responsibilities versus those prioritizing research. Guidance for documenting team science achievements was more explicit for roles that prioritized research.

Although P&T policies at most CTSA institutions express value for team science, inconsistent within-institutional patterns of recognition and reward across career paths may have implications for researchers’ involvement in team science. We discuss the implications of our findings for research and for P&T policies that promote team science.

Biomedical researchers need skills in innovation and entrepreneurship (I&E) to efficiently translate scientific discoveries into products and services to be used to improve health.

In 2016, the European Union identified and published 15 entrepreneurial competencies (EntreComp) for the general population. To validate the appropriateness of these competencies for I&E training for biomedical researchers and to identify program content, we conducted six modified Delphi panels of 45 experts (6–9 per panel). Participating experts had diverse experience, representing such fields as entrepreneurship, academic research, venture capital, and industry.

The experts agreed that all 15 EntreComp competencies were important for biomedical research trainees and no additional competencies were identified. In a two-round Delphi process, the experts identified 120 topics to be included in a training curriculum. They rated the importance of each topic using a 5-point scale from not at all important (1) to extremely important (5) for two student groups: entrepreneurs (those interested in starting their own ventures) and intrapreneurs (those wanting to be innovative and strategic within academia or industry). Consensus (mean importance score >4) was reached that 85 (71%) topics were of high importance for the curriculum. Four topics were identified by multiple panels for both student groups: resiliency, goal setting, team management, and communication skills.

I&E training for biomedical trainees should address all 15 EntreComp competencies, including “soft skills,” and be flexible to accommodate the needs of trainees on different career trajectories.

We are developing the novel αIIbβ3 antagonist, RUC-4, for subcutaneously (SC)-administered first-point-of-medical-contact treatment for ST segment elevation myocardial infarction (STEMI).

We studied the (1) pharmacokinetics (PK) of RUC-4 at 1.0, 1.93, and 3.86 mg/kg intravenous (IV), intramuscular (IM), and SC in non-human primates (NHPs); (2) impact of aspirin on RUC-4 IC50 in human platelet-rich plasma (PRP); (3) effect of different anticoagulants on the RUC-4 IC50 in human PRP; and (4) relationship between αIIbβ3 receptor blockade by RUC-4 and inhibition of ADP-induced platelet aggregation.

(1) All doses of RUC-4 were well tolerated, but animals demonstrated variable temporary bruising. IM and SC RUC-4 reached dose-dependent peak levels within 5–15 minutes, with T1/2 s between 0.28 and 0.56 hours. Platelet aggregation studies in NHPs receiving IM RUC-4 demonstrated >80% inhibition of the initial slope of ADP-induced aggregation with all three doses 30 minutes post-dosing, with subsequent dose-dependent loss of inhibition over 4–5 hours. (2) The RUC-4 IC50 for ADP-induced platelet aggregation was unaffected by aspirin treatment (40±9 nM vs 37±5 nM; p = 0.39). (3) The RUC-4 IC50 was significantly higher in PRP prepared from D-phenylalanyl-prolyl-arginyl chloromethyl ketone (PPACK)-anticoagulated blood compared to citrate-anticoagulated blood using either thrombin receptor activating peptide (TRAP) (122±17 vs 66±25 nM; p = 0.05; n = 4) or ADP (102±22 vs 54±13; p<0.001; n = 5). (4) There was a close correspondence between receptor blockade and inhibition of ADP-induced platelet aggregation, with aggregation inhibition beginning with ~40% receptor blockade and becoming nearly complete at >80% receptor blockade.

Based on these results and others, RUC-4 has now progressed to formal preclinical toxicology studies.

The need to diversify the biomedical research workforce is well documented. The importance of fostering the careers of fledgling underrepresented background (URB) biomedical researchers is evident in light of the national and local scarcity of URB scientists in biomedical research. The Career Education and Enhancement for Health Care Research Diversity (CEED) program at the University of Pittsburgh Institute for Clinical Research Education (ICRE) was designed to promote career success and help seal the “leaky pipeline” for URB researchers. In this study, we aimed to quantify CEED’s effect on several key outcomes by comparing CEED Scholars to a matched set of URB ICRE trainees not enrolled in CEED using data collected over 10 years.

We collected survey data on CEED Scholars from 2007 to 2017 and created a matched set of URB trainees not enrolled in CEED using propensity score matching in a 1:1 ratio. Poisson regression was used to compare the rate of publications between CEED and non-CEED URB trainees after adjusting for baseline number of publications.

CEED has 45 graduates. Seventy-six percent are women, 78% are non-White, and 33% are Hispanic/Latino. Twenty-four CEED Scholars were matched to non-CEED URB trainees. Compared to matched URB trainees, CEED graduates had more peer-reviewed publications (p=0.0261) and were more likely to be an assistant professor (p=0.0145).

Programs that support URB researchers can help expand and diversify the biomedical research workforce. CEED has been successful despite the challenges of a small demographic pool.

MD-PhD training programs train physician-scientists to pursue careers involving both clinical care and research, but decreasing numbers of physician-scientists stay engaged in clinical research. We sought to identify current clinical research training methods utilized by MD–PhD programs and to assess how effective they are in promoting self-efficacy for clinical research.

The US MD–PhD students were surveyed in April–May 2018. Students identified the clinical research training methods they participated in, and self-efficacy in clinical research was determined using a modified 12-item Clinical Research Appraisal Inventory.

Responses were received from 61 of 108 MD–PhD institutions. Responses were obtained from 647 MD–PhD students in all years of training. The primary methods of clinical research training included no clinical research training, and various combinations of didactics, mentored clinical research, and a clinical research practicum. Students with didactics plus mentored clinical research had similar self-efficacy as those with didactics plus clinical research practicum. Training activities that differentiated students who did and did not have the clinical research practicum experience and were associated with higher self-efficacy included exposure to Institutional Review Boards and participation in human subject recruitment.

A clinical research practicum was found to be an effective option for MD–PhD students conducting basic science research to gain experience in clinical research skills. Clinical research self-efficacy was correlated with the amount of clinical research training and specific clinical research tasks, which may inform curriculum development for a variety of clinical and translational research training programs, for example, MD–PhD, TL1, and KL2.

Many institutions evaluate applications for local seed funding by recruiting peer reviewers from their own institutional community. Smaller institutions, however, often face difficulty locating qualified local reviewers who are not in conflict with the proposal. As a larger pool of reviewers may be accessed through a cross-institutional collaborative process, nine Clinical and Translational Science Award (CTSA) hubs formed a consortium in 2016 to facilitate reviewer exchanges. Data were collected to evaluate the feasibility and preliminary efficacy of the consortium.

The CTSA External Reviewer Exchange Consortium (CEREC) has been supported by a custom-built web-based application that facilitates the process and tracks the efficiency and productivity of the exchange.

All nine of the original CEREC members remain actively engaged in the exchange. Between January 2017 and May 2019, CEREC supported the review process for 23 individual calls for proposals. Out of the 412 reviews requested, 368 were received, for a fulfillment ratio of 89.3%. The yield on reviewer invitations has remained consistently high, with approximately one-third of invitations being accepted, and of the reviewers who agreed to provide a review, 88.3% submitted a complete review. Surveys of reviewers and pilot program administrators indicate high satisfaction with the process.

These data indicate that a reviewer exchange consortium is feasible, adds value to participating partners, and is sustainable over time.

To enhance enrollment into randomized clinical trials (RCTs), we proposed electronic health record-based clinical decision support for patient–clinician shared decision-making about care and RCT enrollment, based on “mathematical equipoise.”

As an example, we created the Knee Osteoarthritis Mathematical Equipoise Tool (KOMET) to determine the presence of patient-specific equipoise between treatments for the choice between total knee replacement (TKR) and nonsurgical treatment of advanced knee osteoarthritis.

With input from patients and clinicians about important pain and physical function treatment outcomes, we created a database from non-RCT sources of knee osteoarthritis outcomes. We then developed multivariable linear regression models that predict 1-year individual-patient knee pain and physical function outcomes for TKR and for nonsurgical treatment. These predictions allowed detecting mathematical equipoise between these two options for patients eligible for TKR. Decision support software was developed to graphically illustrate, for a given patient, the degree of overlap of pain and functional outcomes between the treatments and was pilot tested for usability, responsiveness, and as support for shared decision-making.

The KOMET predictive regression model for knee pain had four patient-specific variables, and an r2 value of 0.32, and the model for physical functioning included six patient-specific variables, and an r2 of 0.34. These models were incorporated into prototype KOMET decision support software and pilot tested in clinics, and were generally well received.

Use of predictive models and mathematical equipoise may help discern patient-specific equipoise to support shared decision-making for selecting between alternative treatments and considering enrollment into an RCT.

Research opportunities associated with the proliferation of the electronic health record (EHR), big data initiatives, and innovative approaches to trial design can present challenges for obtaining and documenting informed consent. Broad-scale informed consent (a term used herein to describe institutional models, rather than the Common Rule’s strict regulatory definition for “broad consent”) may facilitate the use of existing data and samples and speed the pace of research by minimizing barriers to consent. We explored the use of broad-scale informed consent within the Clinical Translational Science Award (CTSA) Program Network.

We surveyed CTSA Hubs concerning policies, practices, experiences, and needs within three domains of broad-scale informed consent: (1) participant recontact; (2) biospecimens; and (3) clinical data sharing.

Of 61 CTSA Hubs surveyed, 37 (61%) indicated ongoing work related to at least 1 domain of broad-scale informed consent; 18 Hubs (30%) reported work in all 3 domains. The EHR predominated as the implementation system across all three domains. Research and IT leadership and the Institutional Review Board were most commonly endorsed as institutional drivers, while systems/technical issues and impact on clinical workflow were the most commonly reported barriers.

While survey results indicate considerable variability in the implementation of broad-scale informed consent across the CTSA consortium, it is clear that all CTSA Hubs are actively considering policy and process related to these concepts. Next steps cluster within three areas: training and workforce development, streamlined policies and templates, and implementation strategies that facilitate integration into clinical workflow.

High impact biomedical research is increasingly conducted by large, transdisciplinary, multisite teams in an increasingly collaborative environment. Thriving in this environment requires robust teamwork skills, which are not acquired automatically in the course of traditional scientific education. Team science skills training does exist, but most is directed at clinical care teams, not research teams, and little is focused on the specific training needs of early-career investigators, whose early team leadership experiences may shape their career trajectories positively or negatively. Our research indicated a need for team science training designed specifically for early-career investigators.

To address this need, we designed and delivered a 2-day workshop focused on teaching team science skills to early-career investigators. We operationalized team science competencies, sought the advice of team science experts, and performed a needs assessment composed of a survey and a qualitative study. Through these multiple approaches, we identified and grouped training priorities into three broad training areas and developed four robust, hands-on workshop sessions.

Attendees comprised 30 pre- and post-doc fellows (TL1) and early-career faculty (KL2 and K12). We assessed impact with a pre- and post-workshop survey adapted from the Team Skills Scale. Results from the pre- and post-test Wilcoxon signed-rank analysis (n = 25) showed statistically significant improvement in team science skills and confidence. Open-ended responses indicated that the workshop focus was appropriate and well targeted to the trainees’ needs.

Although team science education is still very much in its infancy, these results suggest that training targeted to early-career investigators improves team skills and may foster improved collaboration.

There is a clear need to educate and train the clinical research workforce to conduct scientifically sound clinical research. Meeting this need requires the creation of tools to assess both an individual’s preparedness to function efficiently in the clinical research enterprise and tools to evaluate the quality and effectiveness of programs that are designed to educate and train clinical research professionals. Here we report the development and validation of a competency self-assessment entitled the Competency Index for Clinical Research Professionals, version II (CICRP-II).

CICRP-II was developed using data collected from clinical research coordinators (CRCs) participating in the “Development, Implementation and Assessment of Novel Training In Domain-Based Competencies” (DIAMOND) project at four clinical and translational science award (CTSA) hubs and partnering institutions.

An exploratory factor analysis (EFA) identified a two-factor structure: the first factor measures self-reported competence to perform Routine clinical research functions (e.g., good clinical practice regulations (GCPs)), while the second factor measures competence to perform Advanced clinical functions (e.g., global regulatory affairs). We demonstrate the between groups validity by comparing CRCs working in different research settings.

The excellent psychometric properties of CICRP-II and its ability to distinguish between experienced CRCs at research-intensive CTSA hubs and CRCs working in less-intensive community-based sites coupled with the simplicity of alternative methods for scoring respondents make it a valuable tool for gauging an individual’s perceived preparedness to function in the role of CRC as well as an equally valuable tool to evaluate the value and effectiveness of clinical research education and training programs.

Although the science of team science is no longer a new field, the measurement of team science and its standardization remain in relatively early stages of development. To describe the current state of team science assessment, we conducted an integrative review of measures of research collaboration quality and outcomes.

Collaboration measures were identified using both a literature review based on specific keywords and an environmental scan. Raters abstracted details about the measures using a standard tool. Measures related to collaborations with clinical care, education, and program delivery were excluded from this review.

We identified 44 measures of research collaboration quality, which included 35 measures with reliability and some form of statistical validity reported. Most scales focused on group dynamics. We identified 89 measures of research collaboration outcomes; 16 had reliability and 15 had a validity statistic. Outcome measures often only included simple counts of products; publications rarely defined how counts were delimited, obtained, or assessed for reliability. Most measures were tested in only one venue.

Although models of collaboration have been developed, in general, strong, reliable, and valid measurements of such collaborations have not been conducted or accepted into practice. This limitation makes it difficult to compare the characteristics and impacts of research teams across studies or to identify the most important areas for intervention. To advance the science of team science, we provide recommendations regarding the development and psychometric testing of measures of collaboration quality and outcomes that can be replicated and broadly applied across studies.

The National Academies of Sciences (NAS) emphasize the need for interdisciplinary team science (TS) training, but few training resources are available. COALESCE, an open-access tool developed with National Institutes of Health support and located at teamscience.net, is considered a gold standard resource but has not previously been evaluated. COALESCE launched four learning modules in 2011. The Science of TS (SciTS) module, an interactive encyclopedia, introduces foundational concepts. Three scenario-based modules simulate TS challenges in behavioral, clinical, and basic biomedical sciences. This study examined user characteristics, usage patterns, and effects of completing the four modules on TS knowledge, attitudes, and skills.

Repeated measures ANOVA tested for pre-post changes in performance and compared learning by users with biomedical versus other disciplinary backgrounds.

From 2011 through 2017, the site attracted 16,280 new users who engaged in 6461 sessions that lasted more than 1 min. The modal registrant identified as working in a biomedical field (47%), in an academic institution (72%), and expressed greater interest in the practice than the SciTS (67%). Those completing pre- and post-tests (n = 989) showed significant improvement in knowledge, attitudes, and skills after taking all scenario-based modules (p < 0.005); knowledge and attitudes were unchanged after the SciTS encyclopedia. Biomedical and other health professionals improved comparably.

Evaluation of the TS training tool at teamscience.net indicates broad dissemination and positive TS-related outcomes. Site upgrades implemented between 2018 and 2020, including adding five new modules, are expected to increase the robustness and accessibility of the COALESCE training resource.

Individuals experiencing different medical conditions, as well as healthy volunteers, may often be interested in trial participation, and researchers similarly need to find participants to advance medical knowledge. The ResearchMatch (RM) Trials Today clinical trial searching tool leverages clinicaltrials.gov data to enable potential participants to look for trial opportunities relevant to their situation. To facilitate expanded use of this tool, we undertook a national digital public awareness campaign to increase awareness of Trials Today among members of the general public.

The awareness campaign promoted Trials Today using Facebook and digital banner messages in 2017, encompassing nine cities across the USA. The digital strategy was complemented by print media in several outlets. We employed descriptive statistics to summarize campaign metrics and site usage data during the campaign.

The campaign was successful in increasing visits to Trials Today, with 142,303 sessions logged during its run, as compared to pre-campaign data indicating 104,688 total sessions during the entire 2-year period since the site’s inception. The city-specific click-through rate for all digital impressions, combining Facebook and banner messaging, ranged from 0.50% to 1.09%, resulting in a cost-per-click range of $0.69–$1.15. In addition, visitors conducted 29,697 searches and viewed individual trial records 173,512 times.

The public awareness campaign was successful in increasing use of the RM Trials Today clinical trial searching tool. Our findings support the value of digital media messaging as a cost-effective vehicle for promoting clinical trial awareness, especially for chronic ailments.