Chest
Volume 135, Issue 3, Supplement, March 2009, Pages 42S-48S
Journal home page for Chest

CME: ACCP Evidence-Based Educational Guidelines
Continuing Medical Education Effect on Practice Performance: Effectiveness of Continuing Medical Education: American College of Chest Physicians Evidence-Based Educational Guidelines

https://doi.org/10.1378/chest.08-2517Get rights and content

Background

There has been sizable debate and widespread skepticism about the effect of continuing medical education (CME) on the performance of physicians in the practice setting. This portion of the review was undertaken to examine that effect.

Methods

The guideline panel used data from a comprehensive review of the effectiveness of CME developed by The Johns Hopkins Evidence-based Practice Center, focusing on the effect of CME on clinical performance.

Results

The review found 105 studies, which evaluated the impact of CME on short- and long-term physician practice performance. Nearly 60% met objectives relative to changing clinical performance in prescribing; screening; counseling about smoking cessation, diet, and sexual practices; guideline adherence; and other topics. Single live and multiple media appeared to be generally positive in their effect, print media much less so. Multiple educational techniques were more successful at changing provider performance than single techniques. The amount or frequency of exposure to CME activities appeared to have little effect on behavior change.

Conclusions

Overall, CME, especially using live or multiple media and multiple educational techniques, is generally effective in changing physician performance. More research, however, is needed that focuses on the specific types of media and educational techniques that lead to the greatest improvements in performance.

Section snippets

Summary of Recommendations

  • 1.

    General: We recommend that CME interventions be used to improve physician practice performance (Grade 1C).

  • 2.

    Instructional media:

    • a.

      We recommend that both single live and multiple media be used to maintain or improve physician practice performance (Grade 1C).

    • b.

      We recommend that print media should not be used alone to improve physician practice performance (Grade 1C).

  • 3.

    Instructional techniques: We recommend that multiple instructional techniques be used to improve or maintain physician practice

Materials and Methods

The guideline panel reviewed the evidence tables and comprehensive review of the effectiveness of CME developed by The Johns Hopkins Evidence-based Practice Center (EPC), which is detailed in the methods article.2a For this article, we focused on the effect of CME on physician practice performance. These effects were measured in either the short term (< 30 days after an intervention) or the long term (ā‰„ 30 days postintervention). The panel noted several limitations in the methods of the EPC

Overall Effects of CME on Clinical Performance

The review identified 105 studies, which evaluated the impact of CME on short- and long-term physician practice performance. The majority (61 studies, 58%) met practice objectives. A wide mix of objectives was studied, including prescribing; screening; counseling about smoking cessation, diet, and sexual practices; guideline adherence; and others. Fifty studies3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38,

Discussion

It has long been accepted that CME is an important educational intervention for the improvement of practice performance in health care, but the evidence from previous systematic reviews and other data offers less than strong support to this belief.1, 2, 112 Direct comparisons between the EPC review and these studies is made problematic by the EPC's inclusion of self-reported performance outcomes in some studies. This use of self-report with its potential for bias is in contrast to other

Conflict of Interest Disclosures

Dr. Davis has received grants from the university of Toronto for the redevelopment of a database and $100,00 in grants from the Ministry of Health, Ontario, Canada.

Dr. Galbraith has no conflicts of interest to disclose.

References (116)

  • CS Kim et al.

    Physician education and report cards: do they make the grade? Results from a randomized controlled trial

    Am J Med

    (1999)
  • BM Pinto et al.

    Acceptability and feasibility of physician-based activity counseling: the PAL project

    Am J Prev Med

    (1998)
  • JJ Allison et al.

    Multicomponent Internet continuing medical education to promote chlamydia screening

    Am J Prev Med

    (2005)
  • DA Davis et al.

    Changing physician performance: a systematic review of the effect of continuing medical education strategies

    JAMA

    (1995)
  • JM Grimshaw et al.

    Effectiveness and efficiency of guideline dissemination and implementation strategies

    Health Technol Assess

    (2004)
  • A Adams et al.

    Alcohol counseling: physicians will do it

    J Gen Intern Med

    (1998)
  • JF Anderson et al.

    Effectiveness of notification and group education in modifying prescribing of regulated analgesics

    Can Med Assoc J

    (1996)
  • M Beaulieu et al.

    CURATA: a patient health management program for the treatment of osteoarthritis in Quebec; an integrated approach to improving the appropriate utilization of anti-inflammatory/analgesic medications

    Am J Manag Care

    (2004)
  • JB Brown et al.

    Effect of clinician communication skills training on patient satisfaction: a randomized, controlled trial

    Ann Intern Med

    (1999)
  • WS Browner et al.

    Physician management of hypercholesterolemia: a randomized trial of continuing medical education

    West J Med

    (1994)
  • PS Bunting et al.

    Effect of a controlled feedback intervention on laboratory test ordering by community physicians

    Clin Chem

    (2004)
  • MR Chassin et al.

    A randomized trial of medical quality assurance: improving physicians' use of pelvimetry

    JAMA

    (1986)
  • J Chodosh et al.

    Effect of a dementia care management intervention on primary care provider knowledge, attitudes, and perceptions of quality of care

    J Am Geriatr Soc

    (2006)
  • S Chung et al.

    Efficacy of an educational Web site for educating physicians about bioterrorism

    Acad Emerg Med

    (2004)
  • NM Clark et al.

    Impact of education for physicians on patient outcomes

    Pediatrics

    (1998)
  • NM Clark et al.

    Long-term effects of asthma education for physicians on patient satisfaction and use of health services

    Eur Respir J

    (2000)
  • BA Cohn et al.

    The National DES Education Program: effectiveness of the California Health Provider Intervention

    J Cancer Educ

    (2002)
  • SR Cummings et al.

    Training physicians in counseling about smoking cessation: a randomized trial of the ā€œQuit for Lifeā€ program

    Ann Intern Med

    (1989)
  • HC Gerstein et al.

    A controlled evaluation of a national continuing medical education programme designed to improve family physicians' implementation of diabetes-specific clinical practice guidelines

    Diabet Med

    (1999)
  • SR Cummings et al.

    Training physicians about smoking cessation: a controlled trial in private practice

    J Gen Intern Med

    (1989)
  • AJ Dietrich et al.

    Sun protection counseling for children: primary care practice patterns and effect of an intervention on clinicians

    Arch Fam Med

    (2000)
  • DR Gifford et al.

    Can a specialty society educate its members to think differently about clinical decisions? Results of a randomized trial

    J Gen Intern Med

    (1996)
  • R Gonzales et al.

    Decreasing antibiotic use in ambulatory practice: impact of a multidimensional intervention on the treatment of uncomplicated acute bronchitis in adults

    JAMA

    (1999)
  • SB Harris et al.

    Teleconferenced educational detailing: diabetes education for primary care physicians

    J Contin Educ Health Prof

    (2005)
  • CP Herbert et al.

    Better Prescribing Project: a randomized controlled trial of the impact of case-based educational modules and personal prescribing feedback on prescribing for hypertension in primary care

    Fam Pract

    (2004)
  • PA Jennett et al.

    The effects of continuing medical education on family doctor performance in office practice: a randomized control study

    Med Educ

    (1988)
  • TE Kottke et al.

    A randomized trial to increase smoking intervention by physicians: doctors helping smokers, round I

    JAMA

    (1989)
  • DS Lane et al.

    An educational approach to improving physician breast cancer screening practices and counseling skills

    Patient Educ Couns

    (2001)
  • CE Lewis et al.

    Continuing medical education for AIDS: an organizational response

    AIDS Educ Prev

    (1993)
  • E Lindsay-McIntyre et al.

    The impact of a continuing education package for smoking cessation on physicians' clinical behavior and patient smoking

    Proc Annu Conf Res Med Educ

    (1987)
  • LA Maiman et al.

    Improving pediatricians' compliance-enhancing practices: a randomized trial

    Am J Dis Child

    (1988)
  • KV Mann et al.

    Increasing physician involvement In cholesterol-lowering practices: the role of knowledge, attitudes and perceptions

    Adv Health Sci Educ Theory Pract

    (1997)
  • PA Margolis et al.

    Practice based education to improve delivery systems for prevention in primary care: randomised trial

    BMJ

    (2004)
  • PS Mehler et al.

    Bridging the quality gap in diabetic hyperlipidemia: a practice-based intervention

    Am J Med

    (2005)
  • JA Moran et al.

    Measuring the effectiveness of a pilot continuing medical education program

    Can Fam Physician

    (1996)
  • EM Ozer et al.

    Increasing the screening and counseling of adolescents for risky health behaviors: a primary care intervention

    Pediatrics

    (2005)
  • DR Perera et al.

    Teaching sigmoidoscopy to primary care physicians: a controlled study of continuing medical education

    J Fam Pract

    (1983)
  • DL Rabin

    Adapting an effective primary care provider STD/HIV prevention training programme

    AIDS Care

    (1998)
  • WA Ray et al.

    Educational program for physicians to reduce use of non-steroidal anti-inflammatory drugs among community-dwelling elderly persons: a randomized controlled trial

    Med Care

    (2001)
  • WM Rodney et al.

    Flexible sigmoidoscopy: primary care outcomes after two types of continuing medical education

    Am J Gastroenterol

    (1986)
  • Cited by (0)

    Reproduction of this article is prohibited without written permission from the American College of Chest Physicians (www.chestjournal.org/misc/reprints.shtml).

    View full text