Introduction
Since 2006, the National Institutes of Health (NIH) has supported the Clinical and Translational Science Awards (CTSA) program. CTSA-funded centers are designed to improve public health by developing innovative strategies to translate research findings to clinical and community settings [1]. It takes about 17 years for research evidence to be implemented into clinical practice [Reference Balas2, Reference Morris, Wooding and Grant3]. The process of translation is best viewed as bidirectional, because successful efforts begin with a clinical or public health observation or identified needs [Reference Austin4]. Therefore, community engagement is a priority for CTSA programs to shorten gaps in the speed of translating research to practice [1, 5]. Community engagement builds on patient and community health priorities and strengths to accelerate improvements in public health and reduce health disparities.
Systematic reviews found that interventions using community engagement methods led to enhancements on a variety of health outcomes and health behaviors among underserved populations [Reference Cyril6, Reference O’Mara-Eves7]. Effective components of community engagement were shared leadership, collaborative partnerships, bidirectional learning, and incorporating community needs in the research [Reference Cyril6].
Community advisory boards (CABs) are an effective strategy for CTSA programs to increase community-engaged research [Reference Newman8]. A survey of 48 CTSA grant awardees indicated that 89% had formed a CAB, a consultative service to researchers [Reference Wilkins9]. CAB members represent various patient and community organizations and groups. Major CAB functions are to provide advice to researchers on substantive aspects of research projects, foster bidirectional conversations and co-learning, along with community–academic partnership facilitation [Reference Matthews10, Reference Matthews11].
The structure and functions of CTSA-formed CABs have been described [Reference Matthews10, Reference Matthews12], along with self-evaluation or process outcomes such as member satisfaction, improved knowledge and training capacity, and perceived benefits (e.g., networking opportunities) [Reference Newman8,Reference Matthews10,Reference Cramer13,Reference Halladay14]. In addition, researcher experiences associated with consulting with CAB members were reported [Reference Matthews12]. Despite the role of CABs in translational research, less is known about how the research for which CABs provide feedback aligns with community health priorities. Ultimately, it is important to demonstrate improved health outcomes with CTSA-based community engagement research strategies [Reference Wallerstein and Duran15]. Understanding community health needs and the depth of researchers addressing those areas may help to focus priorities for demonstrating such outcomes. As the first step, in this program evaluation, we assessed the health topics presented by Mayo Clinic researchers to the CABs linked to our CTSA Community Engagement Program at all three sites (Minnesota, Arizona, and Florida) for relevance to the local community needs identified in the Community Health Needs Assessments.
Methods
Mayo Clinic Center for Clinical and Translational Science
Our CTSA serves all three Mayo Clinic sites in Rochester, Minnesota; Scottsdale/Phoenix, Arizona; and Jacksonville, Florida. The CTSA Community Engagement Program is the resource for all community-engaged research efforts at all three sites. The program works closely with the Office for Health Disparities Research which focuses on supporting health disparities researchers and on recruiting diverse patients into clinical trials. Each site has a CAB that serves both the CTSA Community Engagement Program and the Office of Health Disparities Research.
Community Advisory Boards
The CABs provide a forum for Mayo researchers to present an idea or concept for a research project or obtain feedback on a well-developed project or grant submission. Feedback requested by investigators from the CABs varies and includes recruitment methods, consent processes, study design, project implementation, and dissemination strategies. To facilitate discussion, researchers are asked to provide a brief concept and list of questions for CAB members to consider prior to the meeting. The researcher’s presentation is followed by in-depth discussion with the CAB members. While not an expectation, the CABs vary with respect to encouragement or solicitation of research topics aligned with CNHA priorities as described below.
Minnesota. Formed in 2012, this CAB currently comprises 12 diverse members. It is estimated that about 25% of its members represent patients, 42% local community members, and 33% community and public health organizations. The CAB meets monthly, 10 times per year. Meetings are co-chaired by two community members. The CAB promotes community-engaged research but has not solicited research topics focused specifically on the CHNA-identified needs. Mayo staff assist with meeting logistics and attend each meeting. At each meeting, members receive a meal and are offered a $25 honorarium.
Arizona. Formed in 2013, this CAB currently comprises 17 diverse members. All members have dual roles as local community members and also representing community and public health organizations (e.g., free clinics, federally qualified health centers, tribal or faith-based organizations). The CAB meets on a quarterly basis. Meetings rotate being hosted and led by the CAB members at their site. Members receive a meal at each meeting and, in addition to the structured agenda items, also have a protected time for roundtable sharing for collaboration and project development.
Mayo Clinic staff assist with meeting facilitation. In addition, since the inception of the CAB, the Mayo community engagement liaison staff member has a key role in planning the CAB agenda and encourages Mayo investigators whose research aligns with the CHNA to present. The Arizona CAB is also closely aligned with the cancer center and thus is able to facilitate research on cancer.
Florida. The CAB was founded in 2008 and currently comprises 25 diverse members. About 20% of its members are patient representatives, 30% represent community and public health organizations, and 50% are local community members. The CAB meets monthly, 10 times per year. Meetings are chaired by a community member. Since the first CHNA was conducted, research topics that address community priorities are encouraged. In addition, CAB members initiate or are involved with research projects that address the CHNA health needs, providing one pathway to promote specific health research. Mayo staff assist with meeting logistics and attend each meeting. Members receive a meal at each meeting and are offered a $50 honorarium.
Community Health Needs Assessments (CHNAs)
Our local communities in Minnesota, Arizona, and Florida served by Mayo Clinic are diverse, with African American/Black, immigrant (Somali and Hispanic), Native American, Latino/Latina, youth, and gender diverse populations being the primary focus of outreach efforts across the three sites. The CHNAs were conducted in 2013 and 2016 in the counties where Mayo Clinic is located – Olmsted (Minnesota), Maricopa (Arizona), and Duval (Florida). The CHNAs are managed across all non-profit organizations in each county. Methodologies including sampling strategy, survey format, length, and duration differed across site and year [16]. Information was collected using a variety of approaches including key informant interviews, listening sessions/focus groups, town hall meetings, as well as internet, mail, and phone surveys. CAB members contributed to the CHNAs in meaningful ways, including participation on workgroups or steering committees, contributing to survey questions, and interpretation and dissemination of findings.
For coding purposes, CHNA needs identified in 2013 and/or 2016 were grouped into the following categories by site:
Minnesota: (1) injury prevention, (2) immunizations/vaccine preventable diseases such as pertussis or varicella, (3) obesity/physical activity, (4) mental health, (5) financial stress/homelessness, and (6) diabetes.
Arizona: (1) access to care, (2) cancer, (3) cardiovascular disease, (4) chronic disease, (5) homelessness, (6) obesity, and (7) diabetes.
Florida: (1) access to care, (2) communicable diseases, (3) health disparities, (4) maternal and child health, (5) mental health, (6) obesity/nutrition/physical activity, (7) poverty, (8) transportation, (9) preventive health care, (10) build environment, and (11) diabetes.
Researcher Presentations
We examined research presentations to the CABs by a Mayo investigator over approximately a 4-year period, from 2014 to 2018. Inclusive dates were January 2014–May 2018 for the Minnesota CAB; September 2014–April 2018 for the Arizona CAB; and October 2014–March 2018 for the Florida CAB. We excluded CAB updates/business/training or presentations that did not include a research idea or project.
For the Minnesota and Arizona CABs, detailed minutes were available for each meeting through having a note-taker present or audiotaping meetings with subsequent transcription. Minutes were not available for the Florida CAB but a list of research topics presented was available for each meeting.
Analysis
Using content analysis [Reference Krippendorff17], two authors independently coded researcher presentation data separately for each site using pre-determined categories based on the CHNA health topics. Presentations were coded with respect to relevance of the topic (yes/no) to one or more local CHNA needs identified, and, if relevant to the CHNA, the topic(s) were recorded and tabulated. The inter-rater reliability coefficient (Kappa = 0.90) suggested a high level of agreement between raters [Reference Cohen18]. Frequencies were summarized using descriptive statistics.
Results
Across the three CABs, there were a total of 65 research presentations, of which 41 (63%) addressed one or more of the local CHNA needs.
Minnesota. A total of 35 research presentations were made to this CAB, of which 16 (46%) focused on one or more needs identified in their local CHNA. Of these, 44% (7/16) addressed obesity/nutrition/physical activity, 38% (6/16) addressed immunizations/vaccine preventable diseases, and 33% (6/16) addressed mental health. Two (13%) presentations focused on financial stress/homelessness, two (13%) on diabetes, and one (6%) on injury prevention.
Arizona. A total of 20 research presentations were made, of which 16 (80%) addressed one or more needs identified in their local CHNA. Of these, 63% (10/16) addressed cancer, 50% (8/16) addressed care access, and 19% (3/16) addressed homelessness. Two (13%) focused on chronic disease, one (6%) on obesity, one (6%) on cardiovascular disease, and one (6%) on diabetes.
Florida. A total of 15 research presentations were made, of which 9 (60%) addressed one or more local CHNA needs. Of the 15 presentations, 56% (5/9) focused on health disparities, 44% (4/9) on obesity/nutrition/physical activity, and 33% (3/9) on mental health. Three presentations (33%) addressed preventive health care/wellness and two (22%) addressed communicable diseases.
Table 1 shows the proportion of health topics presented to the CABs among researcher presentations that addressed CHNA priorities for each site. “Cross-cutting” health topics (addressed at two sites) were obesity/nutrition/physical activity (44% of presentations) as well as mental health addressed in one-third of presentations. If obesity/physical activity/nutrition is classified as cancer prevention, then cancer is a cross-cutting theme for all three sites.
Table 1. Proportion of health topics presented to the CABs among researcher presentations that addressed local CHNAs by site
Text in italics indicates cross-cutting topics (>=2 sites) included in at least one-third of researcher presentations.
Discussion
Effective community engagement calls for bidirectional relationships between the researchers and the local community. While it is important to measure long-term health outcomes of CTSA community engagement efforts [Reference Wallerstein and Duran15], understanding community health needs and the depth of researchers addressing those areas may help to focus priorities for demonstrating success. This preliminary program evaluation found that overall nearly two-thirds (63%) of research presentations aligned with local county health needs. The most common CHNA health topics, with at least one-third of researcher presentations, focused on cancer/cancer prevention, mental health, health-care access, health disparities, immunizations/vaccine preventable diseases, and preventive health care/wellness. Building on the strengths of researcher expertise in these areas, there is an opportunity to increase the depth of community-engaged researchers focused on these health topics, as well as those that have received less attention (i.e., care access, financial stress, diabetes) (see Table 1).
Potential strategies to align research with community-identified needs include providing presentations to junior faculty and trainees on community priorities, strategic seed funding, and using CTSA funding to support inter-disciplinary working teams to address community priorities. Another approach is to utilize the CABs to facilitate partnerships between community groups and investigators to co-create studies in response to the needs assessments.
One limitation is that our analysis did not account for annual trends due to the small number of presentations included in this program evaluation. However, our results will serve as a baseline for evaluating future work. Another limitation is that health outcomes from the research presented were not assessed. As an initial step, our goal was to prioritize the health research areas that could subsequently be measured for demonstrating improvements in patient and community health. Each site is planning a CHNA in 2019 and thus some priorities may be reinforced while others may shift. Processes and suggested strategies from this program evaluation may be useful for other CTSAs to consider when evaluating health outcome priorities for community-engaged research.
Acknowledgments
We wish to thank the members of our CABs for their time, dedication, involvement, and partnership with Mayo Clinic, which is vital to the development of meaningful research.
Funding
This program evaluation was made possible by CTSA Grant Number UL1 TR02377 from the National Center for Advancing Translational Sciences (NCATS), a component of the NIH. Its contents are solely the responsibility of the authors and do not necessarily represent the official view of NIH.
Disclosures
The authors have no conflicts of interest to declare.
Open access
