Skip to main content Accessibility help
×
Home

Outcomes in the age of competency-based medical education: Recommendations for emergency medicine training in Canada from the 2019 symposium of academic emergency physicians

  • Teresa M. Chan (a1), Quinten S. Paterson (a2), Andrew K. Hall (a3), Fareen Zaver (a4), Robert A. Woods (a5), Stanley J. Hamstra (a6), Alexandra Stefan (a7), Daniel K. Ting (a8) and Brent Thoma (a9)...

Abstract

Objectives

The national implementation of competency-based medical education (CBME) has prompted an increased interest in identifying and tracking clinical and educational outcomes for emergency medicine training programs. For the 2019 Canadian Association of Emergency Physicians (CAEP) Academic Symposium, we developed recommendations for measuring outcomes in emergency medicine training in the context of CBME to assist educational leaders and systems designers in program evaluation.

Methods

We conducted a three-phase study to generate educational and clinical outcomes for emergency medicine (EM) education in Canada. First, we elicited expert and community perspectives on the best educational and clinical outcomes through a structured consultation process using a targeted online survey. We then qualitatively analyzed these responses to generate a list of suggested outcomes. Last, we presented these outcomes to a diverse assembly of educators, trainees, and clinicians at the CAEP Academic Symposium for feedback and endorsement through a voting process.

Conclusion

Academic Symposium attendees endorsed the measurement and linkage of CBME educational and clinical outcomes. Twenty-five outcomes (15 educational, 10 clinical) were derived from the qualitative analysis of the survey results and the most important short- and long-term outcomes (both educational and clinical) were identified. These outcomes can be used to help measure the impact of CBME on the practice of Emergency Medicine in Canada to ensure that it meets both trainee and patient needs.

RésuméObjectif

La mise sur pied de la formation médicale fondée sur les compétences (FMFC) à l’échelle nationale a eu pour effet de susciter un intérêt accru pour l’établissement et le suivi de résultats cliniques et éducationnels dans les programmes de formation en médecine d'urgence. Aussi, avons-nous élaboré, en vue du symposium 2019 de la section des affaires universitaires de l'Association canadienne des médecins d'urgence (ACMU), des recommandations sur la mesure des résultats en ce qui concerne la formation en médecine d'urgence dans le contexte de la FMFC, afin de faciliter la tâche des leadeurs éducationnels et des concepteurs de systèmes dans l’évaluation des programmes.

Méthode

Nous avons réalisé une étude en trois phases afin d’établir des résultats cliniques et éducationnels relatifs à la formation en médecine d'urgence (MU) au Canada. Tout d'abord, nous avons cherché à obtenir le point de vue d'experts et de la communauté médicale sur les meilleurs résultats cliniques et éducationnels, par un processus de consultation structuré, réalisé à l'aide d'une enquête ciblée en ligne. Nous avons par la suite procédé à une analyse qualitative des réponses afin de dresser une liste de résultats suggérés. Enfin, nous avons présenté les résultats à une assistance diversifiée, composée d’éducateurs, de stagiaires et de cliniciens, à l'occasion du symposium de la section des affaires universitaires de l'ACMU, afin de recueillir ses observations et d'obtenir son contentement par vote.

Conclusion

Les participants au symposium de la section des affaires universitaires ont approuvé le concept de la mesure des résultats cliniques et éducationnels aux fins de la FMFC et celui du lien entre les deux types de résultats. Il s'est dégagé au total 25 résultats (15 éducationnels et 10 cliniques) de l'analyse qualitative des réponses au questionnaire d'enquête, et la démarche a permis l’établissement des résultats les plus importants à court terme et à long terme (tant éducationnels que cliniques). Ces résultats peuvent aider à mesurer l'incidence de la FMFC sur la pratique en MU au Canada, et permettent de s'assurer que cette forme d'enseignement répond tant aux besoins des stagiaires qu’à ceux des patients.

Copyright

Corresponding author

Correspondence to: Dr. Teresa M. Chan, 237 Barton St. E., Hamilton General Hospital. McMaster Clinics Room 255. Hamilton, ON, Canada, L8L2X2; Email: teresa.chan@medportal.ca

References

Hide All
1.McGaghie, WC, Miller, GE, Sajid, AW, Telder, TV.Competency based curriculum in medical education: an introduction. Public Health Pap. 1978:1191.
2.Gruppen, L, Frank, JR, Lockyer, J, et al. Toward a research agenda for competency-based medical education. Med Teach. 2017;39(6):623–30, doi: 10.1080/0142159X.2017.1315065.
3.Holmboe, ES, Sherbino, J, Englander, R, Snell, L, Frank, JR.A call to action: the controversy of and rationale for competency-based medical education. Med Teach. 2017;39(6):574–81, doi: 10.1080/0142159X.2017.1315067.
4.Touchie, C, Ten Cate, O.The promise, perils, problems and progress of competency-based medical education. Med Educ. 2016;50(1):93100, doi: 10.1111/medu.12839.
5.Ross, S, Hauer, KE, van Melle, E.Outcomes are what matter: competency-based medical education gets us to our goal. MedEdPublish. 2018;7(2):15, doi: 10.15694/mep.2018.0000085.1.
6.Cook, DA, West, CP.Reconsidering the focus on “outcomes research” in medical education: a cautionary note. Acad Med. 2013;88(2):162–7, doi: 10.1097/ACM.0b013e31827c3d78.
7.Schumacher, DJ, Holmboe, ES, Van Der Vleuten, C, Busari, JO, Carraccio, C.Developing resident-sensitive quality measures: a model from pediatric emergency medicine. Acad Med. 2018;93(7):1071–8, doi: 10.1097/ACM.0000000000002093.
8.Smirnova, A, Sebok-Syer, SS, Chahine, S, et al. Defining and adopting clinical performance measures in graduate medical education: where are we now and where are we going? Acad Med. 2019;94(5):671–7, doi: 10.1097/ACM.0000000000002620.
9.Sebok-Syer, SS, Chahine, S, Watling, CJ, Goldszmidt, M, Cristancho, S, Lingard, L.Considering the interdependence of clinical performance: implications for assessment and entrustment. Med Educ. 2018;52(9):970–80, doi: 10.1111/medu.13588.
10.Chan, T, Sherbino, J, Collaborators M. The McMaster Modular Assessment Program (McMAP): a theoretically grounded work-based assessment system for an emergency medicine residency program. 2015;90:900–5, doi: 10.1097/acm.0000000000000707.
11.Ross, S, Binczyk, NM, Hamza, DM, et al. Association of a competency-based assessment system with identification of and support for medical residents in difficulty. JAMA Netw Open. 2018;1(7):e184581, doi: 10.1001/jamanetworkopen.2018.4581.
12.Binczyk, NM, Babenko, O, Schipper, S, Ross, S.Unexpected result of competency-based medical education: 9-year application trends to enhanced skills programs by family medicine residents at a single institution in Canada. Educ Prim Care. 2019;30(3):16, doi: 10.1080/14739879.2019.1573108.
13.Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, Social Sciences and Humanities Research Council. Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans. Vol 45. December 2. Ottawa, ON; 2018. doi: 10.1007/BF02627565.
14.Pereira-Lima, K, Gupta, RR, Guille, C, Sen, S.Residency program factors associated with depressive symptoms in internal medicine interns: a prospective cohort study. Acad Med. 2019;94(6):869875, doi: 10.1097/ACM.0000000000002567.
15.Sargeant, J.Future research in feedback: how to use feedback and coaching conversations in a way that supports development of the individual as a self-directed learner and resilient professional. Acad Med. 2019;94:S9S10, doi: 10.1097/ACM.0000000000002911.
16.Thoma, B, Mohindra, R, Woods, RA.Enhanced training in emergency medicine: the search and application process. CJEM. 2015;17(5):565–8, doi: 10.1017/cem.2015.61.
17.Nousiainen, MT, Mironova, P, Hynes, M, et al. Eight-year outcomes of a competency-based residency training program in orthopedic surgery. Med Teach. 2018;40(10):1042–54, doi: 10.1080/0142159X.2017.1421751.
18.Frank, JR, Snell, LS, Ten, Cate O, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32(8):638645, doi: 10.3109/0142159X.2010.501190.
19.Pines, JM, Alfaraj, S, Batra, S, et al. Factors important to top clinical performance in emergency medicine residency: results of an ideation survey and Delphi panel. AEM Educ Train. 2018;2(4):269–76, doi: 10.1002/aet2.10114.
20.Sebok-Syer, SS, Goldszmidt, M, Watling, CJ, Chahine, S, Venance, SL, Lingard, L.Using electronic health record data to assess residents’ clinical performance in the workplace: the good, the bad, and the unthinkable. Acad Med. 2019;94(6):853–60, doi: 10.1097/ACM.0000000000002672.
21.Hall, A, Rich, J, Dagnone, J, et al. It's a marathon, not a sprint: rapid evaluation of CBME program implementation. Acad Med. 2019, doi: 10.1097/ACM.0000000000003040.

Keywords

Type Description Title
UNKNOWN
Supplementary materials

Chan et al. supplementary material
Chan et al. supplementary material

 Unknown (572 KB)
572 KB

Outcomes in the age of competency-based medical education: Recommendations for emergency medicine training in Canada from the 2019 symposium of academic emergency physicians

  • Teresa M. Chan (a1), Quinten S. Paterson (a2), Andrew K. Hall (a3), Fareen Zaver (a4), Robert A. Woods (a5), Stanley J. Hamstra (a6), Alexandra Stefan (a7), Daniel K. Ting (a8) and Brent Thoma (a9)...

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.