Skip to main content

Main menu

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 Articles
  • Authors
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
  • CMA Members
    • Overview for members
    • Earn CPD Credits
    • Print copies of CMAJ
  • Subscribers
    • General information
    • View prices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2022
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN

User menu

Search

  • Advanced search
CMAJ
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN
CMAJ

Advanced Search

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 Articles
  • Authors
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
  • CMA Members
    • Overview for members
    • Earn CPD Credits
    • Print copies of CMAJ
  • Subscribers
    • General information
    • View prices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2022
  • Visit CMAJ on Facebook
  • Follow CMAJ on Twitter
  • Follow CMAJ on Pinterest
  • Follow CMAJ on Youtube
  • Follow CMAJ on Instagram
Commentary
Open Access

Replacing high-stakes summative examinations with graduated medical licensure in Canada

Brent Thoma, Sandra Monteiro, Alim Pardhan, Heather Waters and Teresa Chan
CMAJ February 07, 2022 194 (5) E168-E170; DOI: https://doi.org/10.1503/cmaj.211816
Brent Thoma
Department of Emergency Medicine (Thoma), University of Saskatchewan, Saskatoon, Sask.; Royal College of Physicians and Surgeons (Thoma), Ottawa, Ott.; Centre for Simulation-Based Learning (Monteiro); McMaster Education Research, Innovation, and Theory (MERIT) Program (Monteiro, Chan); Division of Education & Innovation, Department of Medicine (Monteiro, Chan); Division of Emergency Medicine (Pardhan), Department of Medicine and Pediatrics, and Fellow of the Royal College of Physicians of Canada Emergency Medicine Program (Pardhan); Department of Family Medicine (Waters); McMaster Office of Postgraduate Medical Education Advisory Board (Waters); Division of Emergency Medicine (Chan), Department of Medicine, Faculty of Health Sciences; Office of Continuing Professional Development (Chan), Faculty of Health Sciences, McMaster University, Hamilton, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sandra Monteiro
Department of Emergency Medicine (Thoma), University of Saskatchewan, Saskatoon, Sask.; Royal College of Physicians and Surgeons (Thoma), Ottawa, Ott.; Centre for Simulation-Based Learning (Monteiro); McMaster Education Research, Innovation, and Theory (MERIT) Program (Monteiro, Chan); Division of Education & Innovation, Department of Medicine (Monteiro, Chan); Division of Emergency Medicine (Pardhan), Department of Medicine and Pediatrics, and Fellow of the Royal College of Physicians of Canada Emergency Medicine Program (Pardhan); Department of Family Medicine (Waters); McMaster Office of Postgraduate Medical Education Advisory Board (Waters); Division of Emergency Medicine (Chan), Department of Medicine, Faculty of Health Sciences; Office of Continuing Professional Development (Chan), Faculty of Health Sciences, McMaster University, Hamilton, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alim Pardhan
Department of Emergency Medicine (Thoma), University of Saskatchewan, Saskatoon, Sask.; Royal College of Physicians and Surgeons (Thoma), Ottawa, Ott.; Centre for Simulation-Based Learning (Monteiro); McMaster Education Research, Innovation, and Theory (MERIT) Program (Monteiro, Chan); Division of Education & Innovation, Department of Medicine (Monteiro, Chan); Division of Emergency Medicine (Pardhan), Department of Medicine and Pediatrics, and Fellow of the Royal College of Physicians of Canada Emergency Medicine Program (Pardhan); Department of Family Medicine (Waters); McMaster Office of Postgraduate Medical Education Advisory Board (Waters); Division of Emergency Medicine (Chan), Department of Medicine, Faculty of Health Sciences; Office of Continuing Professional Development (Chan), Faculty of Health Sciences, McMaster University, Hamilton, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Heather Waters
Department of Emergency Medicine (Thoma), University of Saskatchewan, Saskatoon, Sask.; Royal College of Physicians and Surgeons (Thoma), Ottawa, Ott.; Centre for Simulation-Based Learning (Monteiro); McMaster Education Research, Innovation, and Theory (MERIT) Program (Monteiro, Chan); Division of Education & Innovation, Department of Medicine (Monteiro, Chan); Division of Emergency Medicine (Pardhan), Department of Medicine and Pediatrics, and Fellow of the Royal College of Physicians of Canada Emergency Medicine Program (Pardhan); Department of Family Medicine (Waters); McMaster Office of Postgraduate Medical Education Advisory Board (Waters); Division of Emergency Medicine (Chan), Department of Medicine, Faculty of Health Sciences; Office of Continuing Professional Development (Chan), Faculty of Health Sciences, McMaster University, Hamilton, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Teresa Chan
Department of Emergency Medicine (Thoma), University of Saskatchewan, Saskatoon, Sask.; Royal College of Physicians and Surgeons (Thoma), Ottawa, Ott.; Centre for Simulation-Based Learning (Monteiro); McMaster Education Research, Innovation, and Theory (MERIT) Program (Monteiro, Chan); Division of Education & Innovation, Department of Medicine (Monteiro, Chan); Division of Emergency Medicine (Pardhan), Department of Medicine and Pediatrics, and Fellow of the Royal College of Physicians of Canada Emergency Medicine Program (Pardhan); Department of Family Medicine (Waters); McMaster Office of Postgraduate Medical Education Advisory Board (Waters); Division of Emergency Medicine (Chan), Department of Medicine, Faculty of Health Sciences; Office of Continuing Professional Development (Chan), Faculty of Health Sciences, McMaster University, Hamilton, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Related Content
  • Responses
  • Metrics
  • PDF
Loading
KEY POINTS
  • Disruptions to medical licensing exams in Canada during the COVID-19 pandemic have raised an opportunity for reexamination of processes for licensure.

  • No evidence supports the effectiveness of current licensure exams in ensuring patient safety; the current process causes undue stress and directs valuable and limited resources toward passing an exam, potentially detracting from the more meaningful goal of preparing for independent practice.

  • Best practices in medical and continuing education support the use of competency-based assessments, guided by robust programmatic assessment models, to judge fitness to practise, followed by life-long self-directed learning.

  • Credentialing and licensing authorities should advocate for the resources required to replace current high-stakes summative assessments with graduated licensure and to develop quantifiable, nationally synergized, specialty-specific practice standards that support both the oversight of graduated licensure and maintenance of competence.

The COVID-19 pandemic has disrupted the medical assessment system in Canada. Examinations delivered by The College of Family Physicians of Canada (CFPC) and the Royal College of Physicians and Surgeons of Canada (RCPSC) were delayed, cancelled or adapted. As these examinations are required for independent practice, this had a negative impact on trainees, supervisors and patients during a time of great stress within our health care system.1 Although disruptive, these challenges provided an opportunity for change by unfreezing the historical approach to medical licensure in Canada — an approach that can be characterized as arduous, expensive, logistically challenging, poorly aligned with clinical practice and potentially biased.

The current medical licensure practices in Canada depend on high-stakes, standardized, summative examinations that were developed to uphold the medical social contract to guard patient safety and benefit society.2 However, no evidence has shown that these exams contribute to this outcome. Although psychometrically sound exams provide superficial reassurance as a safety net that “catches” trainees who are not prepared for independent practice, the incredibly high pass rates of graduates from Canadian training programs suggest that this function is largely redundant.3 In contrast with this approach, best practices in medical and continuing education support the use of competency-based assessments, guided by robust programmatic assessment models. Programs guided by these models employ frequent, low-stakes assessments within the clinical environment, along with specialty-wide or internally created local exams; such programs are being implemented throughout the medical education system,4 and have resulted in increased assessment volume5 and quality.6 Although further evidence of competence in clinical practice may be required to maintain the social contract, licensing exams, as currently structured, do not provide this evidence.

The ongoing use of high-stakes examinations for licensure has numerous unintended consequences. Standardized exams test nonsalient variables and are at risk of biases (e.g., financial hardship from paying to write and attend examinations, structural racism affecting examination literacy and preparation) that may inhibit the movement of our health care institutions toward equity, diversity and inclusion.7 The medical licensing process directs valuable and limited resources (e.g., time, energy, focus) toward passing an exam, potentially detracting from the more meaningful goal of preparing for independent practice. Moreover, the focus on a single high-stakes examination does not support the development of lifelong, self-directed learning. These exams can also increase stress among trainees to a degree that threatens mental health and wellness.8 Lastly, the exams remain painfully expensive for both the trainee and the regulatory body, at a time when student debt continues to soar.

Although landmark changes have been made in response to vigorous advocacy and debate,9 including the removal of the Medical Council of Canada’s second qualifying examination from licensure requirements, passionate voices urge further modernization to increase flexibility and alignment with intended outcomes. A modern model of assessment for licensure that integrates both training programs’ competency-based assessments and clinical practice data derived from trainees’ clinical work would better align with evidence-informed educational practices, underscore the importance of continuous quality improvement for practitioners and refocus licensure on real-world clinical practice.10,11

The implementation of such a system would be challenging. Most international medical training programs use high-stakes, gatekeeping examinations similar to those used in Canada, so cannot provide robust examples to guide the way forward. Fortunately, the scaffolding for such a model already exists in the Competence By Design assessment programs (RCPSC), the Triple C Curriculum (CFPC) and the Core Professional Activities of the Residency Training Profile (CFPC). The direct observation of real-world clinical activities within these training programs occurs frequently and, when competency-based programs are implemented with fidelity, they provide substantive evidence of competence in the clinical setting. The formalization of “transition to practice” periods within these training programs could occur if this evidence was used to grant a graduated licence that allowed trainees to take on greater clinical autonomy. Trainees with graduated licences would have increased ownership of clinical outcomes that could be tracked through practice audits, supported by their training program and hospital system. The incorporation and oversight of such quality metrics would engage individuals in continuing to employ lifelong learning skills while supporting quality improvement practices within their discipline.

Developing and socializing the cultural changes and quality improvement infrastructure required for this model would be resource intensive. Culturally, the creation of a graduated licence would need to be implemented without increasing medicolegal risk or decreasing compensation for supervisors. The successful socialization of this approach would offload some patient care responsibilities to the trainees with graduated licences, thereby allowing their supervising consultants to develop and oversee their practice audits. The oversight of clinical practice during this stage would require increased sophistication in how health care systems report clinical outcomes and conduct quality-improvement initiatives. These costs could be contained through other synergizing innovations. For example, nationally developed, locally implemented, discipline-specific standards for practice audits could be incorporated into both maintenance-of-competence programs and the assessment of a graduated licensure period.

Logistically, the implementation of these changes would require substantial collaboration between the CFPC, RCPSC and provincial regulatory bodies. From a credentialing perspective, specialty-specific examination boards would need to be replaced with boards trained to review standardized practice audits at the end of the graduated licensure period. Additionally, new accreditation standards would need to be developed to ensure adequate oversight and support of trainees during the graduated training period. From a regulatory perspective, provincial medical licensing bodies would need to evolve to define and supervise a form of graduated licensure that provides trainees with greater clinical autonomy. If these changes were made collaboratively across Canada’s provinces and territories, they could facilitate the harmonization of provincial licensure standards, or even the development of a portable national licensure that would improve physician portability.12

By disrupting traditional approaches to examination, the COVID-19 pandemic has provided an opportunity to imagine alternative approaches to licensure that better align with best practices in education assessment, while also upholding the medical social contract. Credentialing and licensing authorities should advocate for the resources required to replace the current high-stakes summative assessments with graduated licensure; to develop quantifiable, nationally synergized, specialty-specific practice standards that support both the oversight of graduated licensure and maintenance of competence; and to streamline licensure requirements between jurisdictions.

Footnotes

  • Competing interests: Brent Thoma reports honoraria and travel support from the Royal College of Physicians and Surgeons of Canada. Sandra Monteiro reports grants and travel support from McMaster University, and consulting fees from Touchstone Institute and Aquifer. Heather Water reports honoraria, salary support and travel support from McMaster University, honoraria from the Foundation for Medical Practice Education. Teresa Chan has received research grants, honoraria, salary support and support for attending meetings from McMaster University, the Royal College of Physicians and Surgeons of Canada, the Government of Ontario and Physician Services Incorporated, University of British Columbia, Northern Ontario School of Medicine, International Association of Medical Science Educators, Catholic University of Korea START Center for Medical Simulation, Texas Children’s Hospital, Baylor College of Medicine, Taipei Veterans General Hospital, Harvard Medical School and the University of Northern British Columbia, Academic Life in Emergency Medicine Limited Liability Company and the Canadian Association of Emergency Physicians. She also reports sitting on the board of the Canadian Institute for Translation of Knowledge and Education. No other competing interests were declared.

  • This article has been peer reviewed.

  • Contributors: All of the authors contributed to the conception and design of the work, drafted the manuscript, revised it critically for important intellectual content, gave final approval of the version to be published and agreed to be accountable for all aspects of the work.

This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY-NC-ND 4.0) licence, which permits use, distribution and reproduction in any medium, provided that the original publication is properly cited, the use is noncommercial (i.e., research or educational use), and no modifications or adaptations are made. See: https://creativecommons.org/licenses/by-nc-nd/4.0/

References

  1. ↵
    1. Nath A,
    2. Hunchak C,
    3. Smith S,
    4. et al
    . COVID-19 and its impact on CCFP(EM) residency training. CJEM 2021;23:581–4.
    OpenUrl
  2. ↵
    1. Maudsley RF
    . Medical licensure: Let’s not lose sight of the objective. CMAJ 1990;143:98–100.
    OpenUrlPubMed
  3. ↵
    Get ready for your online exam. Ottawa: The Royal College of Physicians and Surgeons of Canada; updated 2021 Mar. 5. Available: https://www.royalcollege.ca/rcsite/credentials-exams/exams-preparation-e (accessed 2021 Dec. 15).
  4. ↵
    1. Karpinski J,
    2. Frank JR
    . The role of EPAs in creating a national system of time-variable competency-based medical education. Acad Med 2021;96:S36–41.
    OpenUrl
  5. ↵
    1. Thoma B,
    2. Hall AK,
    3. Clark K,
    4. et al
    . Evaluation of a national competency-based assessment system in emergency medicine: a CanDREAM study. J Grad Med Educ 2020;12:425–34.
    OpenUrl
  6. ↵
    1. Li S-A,
    2. Sherbino J,
    3. Chan TM
    . McMaster Modular Assessment Program (McMAP) through the years: residents’ experience with an evolving feedback culture over a 3-year period. AEM Educ Train 2017;1:5–14.
    OpenUrl
  7. ↵
    1. Lucey CR,
    2. Saguil A
    . The consequences of structural racism on MCAT scores and medical school admissions: the past is prologue. Acad Med 2020;95:351–6.
    OpenUrl
  8. ↵
    1. Vanston PD
    . The United States Medical Licensing Exam (USMLE) and medical student wellness: an ethnographic qualitative study at Cooper Medical School of Rowan University. Ann Arbor (MI): ProQuest; 2016. Available: https://www.proquest.com/docview/1823606921?pq-origsite=gscholar&fromopenview=true (accessed 2021 Dec. 16).
  9. ↵
    The MCC suspends the delivery of the MCCQE Part II. Ottawa: Medical Council of Canada; 2021. Available: https://mcc.ca/news/mcc-suspends-delivery-of-mccqe-part-ii/ (accessed 2021 Sept. 22).
  10. ↵
    1. Sebok-Syer SS,
    2. Goldszmidt M,
    3. Watling CJ,
    4. et al
    . Using electronic health record data to assess residents’ clinical performance in the workplace: the good, the bad, and the unthinkable. Acad Med 2019;94:853–60.
    OpenUrl
  11. ↵
    1. Sebok-Syer SS,
    2. Shepherd L,
    3. McConnell A,
    4. et al
    . “EMERGing” electronic health record data metrics: insights and implications for assessing residents’ clinical performance in emergency medicine. AEM Educ Train 2020;5:e10501.
    OpenUrl
  12. ↵
    1. Yu Y,
    2. Schipper S
    . Physician mobility in Canada. Can Fam Physician 2020;66:377.
    OpenUrlFREE Full Text
PreviousNext
Back to top

In this issue

Canadian Medical Association Journal: 194 (5)
CMAJ
Vol. 194, Issue 5
7 Feb 2022
  • Table of Contents
  • Index by author

Article extras

  • Version française

Podcast

Subscribe to podcast
Download MP3

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on CMAJ.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Replacing high-stakes summative examinations with graduated medical licensure in Canada
(Your Name) has sent you a message from CMAJ
(Your Name) thought you would like to see the CMAJ web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Replacing high-stakes summative examinations with graduated medical licensure in Canada
Brent Thoma, Sandra Monteiro, Alim Pardhan, Heather Waters, Teresa Chan
CMAJ Feb 2022, 194 (5) E168-E170; DOI: 10.1503/cmaj.211816

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
‍ Request Permissions
Share
Replacing high-stakes summative examinations with graduated medical licensure in Canada
Brent Thoma, Sandra Monteiro, Alim Pardhan, Heather Waters, Teresa Chan
CMAJ Feb 2022, 194 (5) E168-E170; DOI: 10.1503/cmaj.211816
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Jump to section

  • Article
    • Footnotes
    • References
  • Figures & Tables
  • Related Content
  • Responses
  • Metrics
  • PDF

Related Articles

  • Les examens finaux à enjeux élevés menant au permis d’exercer la médecine ont-ils encore leur raison d’être au Canada?
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Revisiting the concept of urgency in surgical prioritization and addressing backlogs in elective surgery provision
  • Antiviral treatment for COVID-19: ensuring evidence is applicable to current circumstances
  • Who is Black? The urgency of accurately defining the Black population when conducting health research in Canada
Show more Commentary

Similar Articles

Collections

  • Topics
    • Health policy
    • Medical careers
    • Medical education, residency, internship
    • Professional conduct & regulation

 

View Latest Classified Ads

Content

  • Current issue
  • Past issues
  • Collections
  • Sections
  • Blog
  • Podcasts
  • Alerts
  • RSS
  • Early releases

Information for

  • Advertisers
  • Authors
  • Reviewers
  • CMA Members
  • Media
  • Reprint requests
  • Subscribers

About

  • General Information
  • Journal staff
  • Editorial Board
  • Advisory Panels
  • Governance Council
  • Journal Oversight
  • Careers
  • Contact
  • Copyright and Permissions
  • Accessibiity
  • CMA Civility Standards
CMAJ Group

Copyright 2022, CMA Impact Inc. or its licensors. All rights reserved. ISSN 1488-2329 (e) 0820-3946 (p)

All editorial matter in CMAJ represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.

To receive any of these resources in an accessible format, please contact us at CMAJ Group, 500-1410 Blair Towers Place, Ottawa ON, K1J 9B9; p: 1-888-855-2555; e: cmajgroup@cmaj.ca

Powered by HighWire