Skip to main content

Main menu

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 Articles
  • Authors
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
  • CMA Members
    • Overview for members
    • Earn CPD Credits
    • Print copies of CMAJ
  • Subscribers
    • General information
    • View prices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2022
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN

User menu

Search

  • Advanced search
CMAJ
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN
CMAJ

Advanced Search

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 Articles
  • Authors
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
  • CMA Members
    • Overview for members
    • Earn CPD Credits
    • Print copies of CMAJ
  • Subscribers
    • General information
    • View prices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2022
  • Visit CMAJ on Facebook
  • Follow CMAJ on Twitter
  • Follow CMAJ on Pinterest
  • Follow CMAJ on Youtube
  • Follow CMAJ on Instagram
Letters

Addressing bias and lack of objectivity in the Canadian resident matching process

Tammy Ryan
CMAJ October 09, 2018 190 (40) E1211-E1212; DOI: https://doi.org/10.1503/cmaj.70008
Tammy Ryan
Medical resident, McMaster University, Hamilton, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Responses
  • Metrics
  • PDF
Loading

The number of unmatched medical graduates has been increasing steadily and has become the focus of attention in recent months, including a CMAJ article entitled “What to do about the Canadian Resident Matching Service.”1 The discussion has focused primarily on the number and distribution of training positions, with calls to increase the number of residency positions to 1.2 per medical graduate. Indeed, the Government of Ontario has recently funded a number of new positions to address this issue.

What has received less attention, however, are the problems with the existing process of resident selection. Although there are few studies of the match, there is existing evidence of bias within the system. A study performed at the University of Calgary found that there is significant in-group bias when selecting residents, with preference for applicants from within the institution.2 In the 2017 match, although 80% of male applicants and 83% of female applicants were matched to their first choice discipline, only 62% of female applicants matched to their first choice if it was a surgical discipline, compared with 72% of male applicants.3 In fact, as of the 2016 cohort, there was one surgical residency program in Ontario that had not taken a female trainee in five years, according to its website (https://fhs.mcmaster.ca/macortho/our_residents.html).

Behind closed doors, many students express frustration at a process they feel is too subjective. This is often attributed to the concept of “fit,” an abstract assessment of an applicant’s ability to integrate into the existing team. Of course, fit is important, but, according to the Canadian Resident Matching Service (CaRMS), it “should not be used to indulge personal biases or to discriminate against applicants.” I have heard my colleagues describe the match as a “black box,” with applicants unable to identify the qualities associated with success. Their frustrations are borne out by the existing data, which show a substantial element of subjectivity in applicant assessment.

An analysis of the plastic surgery match in the United States showed that program directors placed importance on membership in the Alpha Omega Alpha Honor Medical Society, publications, step 1 scores for the United States Medical Licensing Examination, medical class rank and letters of reference when assessing a candidate, whereas Canadian program directors relied heavily on reference letters and clinical interactions.4 More objective measures such as academic honours, awards and publications ranked lower in importance in Canada. The identity of the writer of the reference letter ranked higher in importance than the content. This discrepancy is somewhat to be expected as most Canadian medical schools use pass/fail grading systems, which preclude class rankings; however, it seems that the lack of objectivity is due not just to a paucity of data but, to some degree, to a failure to acknowledge value in the few objective measures available, including awards and publication record.

There is also a complete lack of transparency in this process. Students who have sought feedback have been met with resistance, with many programs refusing to disclose any information regarding the review of an applicant’s file. Given that students pay money to apply to these programs and that the stakes of the match are so high, this is simply not acceptable. It also leads one to wonder whether programs fear the scrutiny.

The office of Admissions and Evaluation for Postgraduate Medical Education at the University of Toronto has put a number of measures in place to try to ensure fairness in the residency selection process. The University of Toronto uses the Best Practices in Application and Selection, a set of standards developed for this purpose.5 This office runs many workshops to train program directors and members of the selection committee about file review and interviewing. However, training is not mandatory, and there is no auditing system in place to ensure that selection committees are following the best practices or adhering to hiring practices outlined by the Ontario Human Rights Commission. “We do the up-front training but we don’t go back and make sure that was followed necessarily. We have so many programs that it’s not really feasible to go back and check” (Dr. Linda Probyn, director, Admissions and Evaluation, Postgraduate Medical Education, Faculty of Medicine, University of Toronto, Toronto, Ont.: personal communication, 2018).

A recent study that assessed adherence to Best Practices in Application and Selection was completed recently at Dalhousie University.6 The authors of the study found that there were substantial weaknesses in the domains of applicant ranking, transparency and knowledge translation, with committee members failing to adhere to standards in all measures of applicant ranking, and five of seven measures of transparency.

There are several steps that could be taken to improve the process. First, all medical schools should adopt Best Practices in Application and Selection, with mandatory training for all members of selection committees. Second, postgraduate medical education- or CaRMS-based auditing of program selection practices should be instituted. It is not feasible to audit every program every year, but random samples of applicants’ files pre- and postinterview would likely provide enough information to assess objectivity and fairness on a recurring basis. Selection committees should also have access to additional objective information. Options include an examination in the style of the US Medical Licensing Examination Step 1 or, alternatively, the Medical Council of Canada Qualifying Examination Part 1 could be moved to the third year of medical school.

Advocates want to fund more residency positions, but to support the current system is to support a process that is fraught with bias and crippled by its subjectivity. At the end of the day, these are government-funded training positions and the medical profession has an obligation to ensure that they are being allocated fairly, using objective, merit-based criteria for ranking applicants. Fit should only be part of a larger, more impartial assessment. This is not a problem that will be solved with money, and failure to acknowledge all of the issues with the existing match process will only result in a failure to capitalize on any additional funding.

Footnotes

  • Competing interests: None declared.

References

  1. ↵
    1. Wilson CR,
    2. Bordman ZN
    . What to do about the Canadian Resident Matching Service. CMAJ 2017; 189:E1436–47.
    OpenUrlFREE Full Text
  2. ↵
    1. Bass A,
    2. Wu C,
    3. Schaefer JP,
    4. et al
    . In-group bias in residency selection. Med Teach 2013;35:747–51.
    OpenUrl
  3. ↵
    2017 R-1 Main Residency Match report. Ottawa: Canadian Resident Matching Service; 2017. Available: www.carms.ca/en/data-and-reports/r-1/r-1-match-reports-2017/ (accessed 2018 Apr. 16).
  4. ↵
    1. Krauss EM,
    2. Bezuhly M,
    3. Williams JG
    . Selecting the best and brightest: a comparison of residency match processes in the United States and Canada. Plast Surg (Oakv) 2015;23:225–30.
    OpenUrl
  5. ↵
    1. Bandiera G,
    2. Abrahams C,
    3. Ruetalo M,
    4. et al
    . Identifying and promoting best practices in residency application and selection in a complex academic health network. Acad Med 2015;90:1594–601.
    OpenUrl
  6. ↵
    1. Rodger A,
    2. Balan M,
    3. Epstein I
    . Applying best practices in residency selection: a quality improvement project for the Dalhousie Internal Medicine program. Proceedings of the 2016 International Conference on Residency Education; 2016 Sept. 30; Ottawa: The Royal College of Physician and Surgeons of Canada. Available: www.royalcollege.ca/rcsite/documents/icre/research-residency-education-rodger.pdf (accessed 2018 May 10).
PreviousNext
Back to top

In this issue

Canadian Medical Association Journal: 190 (40)
CMAJ
Vol. 190, Issue 40
9 Oct 2018
  • Table of Contents
  • Index by author

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on CMAJ.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Addressing bias and lack of objectivity in the Canadian resident matching process
(Your Name) has sent you a message from CMAJ
(Your Name) thought you would like to see the CMAJ web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Addressing bias and lack of objectivity in the Canadian resident matching process
Tammy Ryan
CMAJ Oct 2018, 190 (40) E1211-E1212; DOI: 10.1503/cmaj.70008

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
‍ Request Permissions
Share
Addressing bias and lack of objectivity in the Canadian resident matching process
Tammy Ryan
CMAJ Oct 2018, 190 (40) E1211-E1212; DOI: 10.1503/cmaj.70008
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Jump to section

  • Article
    • Footnotes
    • References
  • Responses
  • Metrics
  • PDF

Related Articles

  • What to do about the Canadian Resident Matching Service
  • PubMed
  • Google Scholar

Cited By...

  • Applicant gender and matching to first-choice discipline: a cross-sectional analysis of data from the Canadian Resident Matching Service (2013-2019)
  • Google Scholar

More in this TOC Section

  • Succinylcholine, malignant hyperthermia and rhabdomyolysis
  • The authors respond to criticisms of their model parameters
  • Error in key model input
Show more Letters

Similar Articles

 

View Latest Classified Ads

Content

  • Current issue
  • Past issues
  • Collections
  • Sections
  • Blog
  • Podcasts
  • Alerts
  • RSS
  • Early releases

Information for

  • Advertisers
  • Authors
  • Reviewers
  • CMA Members
  • Media
  • Reprint requests
  • Subscribers

About

  • General Information
  • Journal staff
  • Editorial Board
  • Advisory Panels
  • Governance Council
  • Journal Oversight
  • Careers
  • Contact
  • Copyright and Permissions
  • Accessibiity
  • CMA Civility Standards
CMAJ Group

Copyright 2022, CMA Impact Inc. or its licensors. All rights reserved. ISSN 1488-2329 (e) 0820-3946 (p)

All editorial matter in CMAJ represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.

To receive any of these resources in an accessible format, please contact us at CMAJ Group, 500-1410 Blair Towers Place, Ottawa ON, K1J 9B9; p: 1-888-855-2555; e: cmajgroup@cmaj.ca

Powered by HighWire