Canadian Medical Association Journal, Vol 158, Issue 2 177-181, Copyright © 1998 by Canadian Medical Association

Research * Recherche

Effectiveness of instruction in critical appraisal (evidence-based medicine) skills: a critical appraisal

G. R. Norman and S. I. Shannon

OBJECTIVE: To examine the evidence that the teaching of critical appraisal (evidence-based medicine) skills to undergraduate medical students or residents will result in significant gains in knowledge and increased use of the literature in clinical decision-making. DATA SOURCES: Articles published from 1966 to 1995, retrieved through a MEDLINE search supplemented by manual searches; review of bibliographies maintained by individuals involved in teaching critical appraisal skills; and a previous methodological review. STUDY SELECTION: Articles were selected if the study involved some form of control group, although strict randomization was not required, and a measure of performance followed the intervention. Articles were excluded if they simply reported the process of teaching critical appraisal skills or used some form of "happiness index." DATA SYNTHESIS: There were 10 studies of the impact of teaching critical appraisal skills, 6 involving medical students and 4 involving residents. Results from 3 of the studies were nearly uninterpretable and thus were excluded; the remaining 7 were methodologically acceptable. Analysis showed that interventions implemented in undergraduate programs resulted in significant gains in knowledge, as assessed by a written test (mean gain 17.0%; standard deviation [SD] 4.0%). Conversely, studies at the residency level consistently showed a small change in knowledge (mean gain 1.3%; SD 1.7%). Two studies that examined residents' use of the literature were unable to demonstrate any positive changes. CONCLUSIONS: Studies of the effect of teaching critical appraisal skills on gains in knowledge at the undergraduate level showed consistent improvement. By contrast, changes in knowledge at the residency level were small. Several suggestions from the educational literature are offered to increase effectiveness of critical appraisal interventions.

This article has been cited by other articles:

				C. De Vito, C. G. Nobile, G. Furnari, M. Pavia, M. De Giusti, I. F. Angelillo, and P. Villari Physicians' knowledge, attitudes and professional use of RCTs and meta-analyses: A cross-sectional survey Eur J Public Health, June 1, 2009; 19(3): 297 - 302. [Abstract] [Full Text] [PDF]

				S. Agrawal, P. Szatmari, and M. Hanson Teaching Evidence-Based Psychiatry: Integrating and Aligning the Formal and Hidden Curricula Acad Psychiatry, November 1, 2008; 32(6): 470 - 474. [Abstract] [Full Text] [PDF]

				M. F Tiburi Evidence-based medicine as viewed by key decision-makers of health plans in southern Brazil Health Serv Manage Res, August 1, 2008; 21(3): 185 - 191. [Abstract] [Full Text] [PDF]

				C. Fitch, A. Malik, P. Lelliott, D. Bhugra, and M. Andiappan Assessing psychiatric competencies: what does the literature tell us about methods of workplace-based assessment? Adv. Psychiatr. Treat., March 1, 2008; 14(2): 122 - 130. [Abstract] [Full Text] [PDF]

				W. D. Hendricson, E. Anderson, S. C. Andrieu, D. G. Chadwick, J. R. Cole, M. C. George, G. N. Glickman, J. F. Glover, J. S. Goldberg, N. K. Haden, et al. Does Faculty Development Enhance Teaching Effectiveness? J Dent Educ., December 1, 2007; 71(12): 1513 - 1533. [Abstract] [Full Text] [PDF]

				D. M. Windish, S. J. Huot, and M. L. Green Medicine Residents' Understanding of the Biostatistics and Results in the Medical Literature JAMA, September 5, 2007; 298(9): 1010 - 1022. [Abstract] [Full Text] [PDF]

				T. Shaneyfelt, K. D. Baum, D. Bell, D. Feldstein, T. K. Houston, S. Kaatz, C. Whelan, and M. Green Instruments for evaluating education in evidence-based practice: a systematic review. JAMA, September 6, 2006; 296(9): 1116 - 1127. [Abstract] [Full Text] [PDF]

				S. Zisook, S. Benjamin, R. Balon, I. Glick, A. Louie, C. Moutier, T. Moyer, C. Santos, and M. Servis Alternate Methods of Teaching Psychopharmacology Acad Psychiatry, June 1, 2005; 29(2): 141 - 154. [Abstract] [Full Text] [PDF]

				P. Bradley, C. Oterholt, L. Nordheim, and A. Bjorndal Medical Students' and Tutors' Experiences of Directed and Self-Directed Learning Programs in Evidence-Based Medicine: A Qualitative Evaluation Accompanying a Randomized Controlled Trial Eval Rev, April 1, 2005; 29(2): 149 - 177. [Abstract] [PDF]

				A. Coomarasamy and K. S Khan What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review BMJ, October 30, 2004; 329(7473): 1017. [Abstract] [Full Text] [PDF]

				G. Norman A conceptual framework may be of limited value BMJ, October 30, 2004; 329(7473): 1032 - 1032. [Full Text] [PDF]

				P. C. Wyer, S. Keitz, R. Hatala, R. Hayward, A. Barratt, V. Montori, E. Wooltorton, and G. Guyatt Tips for learning and teaching evidence-based medicine: introduction to the series Can. Med. Assoc. J., August 17, 2004; 171(4): 347 - 348. [Full Text] [PDF]

				V Moyer Evidence based medicine: is it practical? Arch. Dis. Child., May 1, 2004; 89(5): 399 - 400. [Full Text] [PDF]

				G. R Norman, S. I Shannon, and M. L Marrin The need for needs assessment in continuing medical education BMJ, April 24, 2004; 328(7446): 999 - 1001. [Full Text] [PDF]

				A. Schwartz and J. Hupert Medical students' application of published evidence: randomised trial BMJ, March 8, 2003; 326(7388): 536 - 538. [Abstract] [Full Text] [PDF]

				L Fritsche, T Greenhalgh, Y Falck-Ytter, H-H Neumayer, and R Kunz Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine BMJ, December 7, 2002; 325(7376): 1338 - 1341. [Abstract] [Full Text] [PDF]

				R. Hatala and G. Guyatt Evaluating the Teaching of Evidence-Based Medicine JAMA, September 4, 2002; 288(9): 1110 - 1112. [Full Text] [PDF]

				M. L. Callaham, R. K. Knopp, and E. J. Gallagher Effect of Written Feedback by Editors on Quality of Reviews: Two Randomized Trials JAMA, June 5, 2002; 287(21): 2781 - 2783. [Abstract] [Full Text] [PDF]

				W. R. Hersh, M. K. Crabtree, D. H. Hickam, L. Sacherek, C. P. Friedman, P. Tidmarsh, C. Mosbaek, and D. Kraemer Factors Associated with Success in Searching MEDLINE and Applying Evidence to Answer Clinical Questions J. Am. Med. Inform. Assoc., May 1, 2002; 9(3): 283 - 293. [Abstract] [Full Text] [PDF]

				A. Coomarasamy, P. Latthe, S. Papaioannou, M. Publicover, H. Gee, and K. S Khan Critical appraisal in clinical practice: sometimes irrelevant, occasionally invalid J R Soc Med, January 11, 2001; 94(11): 573 - 577. [Abstract] [Full Text] [PDF]

				W.-C. Leung and P. Whitty Is evidence based medicine neglected by royal college examinations? A descriptive study of their syllabuses BMJ, September 9, 2000; 321(7261): 603 - 604. [Full Text]

				J. O. Lopreiato, D. M. Foulds, and J. H. Littlefield Does a Health Maintenance Curriculum for Pediatric Residents Improve Performance? Pediatrics, April 1, 2000; 105(4): 966 - 972. [Abstract] [Full Text]

				C. H. Y. Fu, B. Hodges, G. Regehr, D. S. Goldbloom, and P. Garfinkel Is a Journal Club Effective for Teaching Critical Appraisal Skills?: A Controlled Trial With Residents in Psychiatry Acad Psychiatry, December 1, 1999; 23(4): 205 - 209. [Abstract] [Full Text]

				A. R Jadad Promoting partnerships: challenges for the internet age BMJ, September 18, 1999; 319(7212): 761 - 764. [Full Text]

HOME	CURRENT ISSUE	PAST ISSUES	COLLECTIONS	HELP	SEARCH
Copyright 1995-1998, Canadian Medical Association. All rights reserved. ISSN 1488-2329 (e) 0820-3946 (p) All editorial matter in CMAJ represents the opinions of the authors and not necessarily those of the Canadian Medical Association.