Skip to main content

Main menu

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 articles
    • Obituary notices
  • Authors & Reviewers
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
    • Patient engagement
  • Physicians & Subscribers
    • Benefits for Canadian physicians
    • CPD Credits for CMA Members
    • Subscribe to CMAJ digital
    • Subscribe to CMAJ print
    • Subscription prices
    • Obituary notices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2023
    • Avis de décès
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN

User menu

Search

  • Advanced search
CMAJ
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN
CMAJ

Advanced Search

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 articles
    • Obituary notices
  • Authors & Reviewers
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
    • Patient engagement
  • Physicians & Subscribers
    • Benefits for Canadian physicians
    • CPD Credits for CMA Members
    • Subscribe to CMAJ digital
    • Subscribe to CMAJ print
    • Subscription prices
    • Obituary notices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2023
    • Avis de décès
  • Visit CMAJ on Facebook
  • Follow CMAJ on Twitter
  • Follow CMAJ on Instagram
  • Listen to CMAJ podcasts
Research article

How well is the clinical importance of study results reported? An assessment of randomized controlled trials

Karen B.Y. Chan, Malcolm Man-Son-Hing, Frank J. Molnar and Andreas Laupacis
CMAJ October 30, 2001 165 (9) 1197-1202;
Karen B.Y. Chan
From the *Clinical Epidemiology Unit, Ottawa Health Research Institute, Ottawa Hospital, Ottawa, Ont.; the †University of Ottawa Institute on Health of the Elderly, Sisters of Charity Health Services, Ottawa, Ont.; and the ‡Institute for Clinical Evaluative Sciences and the Department of Medicine, University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Malcolm Man-Son-Hing
From the *Clinical Epidemiology Unit, Ottawa Health Research Institute, Ottawa Hospital, Ottawa, Ont.; the †University of Ottawa Institute on Health of the Elderly, Sisters of Charity Health Services, Ottawa, Ont.; and the ‡Institute for Clinical Evaluative Sciences and the Department of Medicine, University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Frank J. Molnar
From the *Clinical Epidemiology Unit, Ottawa Health Research Institute, Ottawa Hospital, Ottawa, Ont.; the †University of Ottawa Institute on Health of the Elderly, Sisters of Charity Health Services, Ottawa, Ont.; and the ‡Institute for Clinical Evaluative Sciences and the Department of Medicine, University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andreas Laupacis
From the *Clinical Epidemiology Unit, Ottawa Health Research Institute, Ottawa Hospital, Ottawa, Ont.; the †University of Ottawa Institute on Health of the Elderly, Sisters of Charity Health Services, Ottawa, Ont.; and the ‡Institute for Clinical Evaluative Sciences and the Department of Medicine, University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Responses
  • Metrics
  • PDF
Loading

Abstract

Background: The interpretation of the results of randomized controlled trials (RCTs) has traditionally emphasized statistical significance rather than clinical importance. Our aim was to assess the quality of reporting of factors related to clinical importance in a sample of published RCTs.

Methods: A random sample of 27 (of a total of 266) RCTs published in 5 major medical journals over a 1-year period were reviewed by 4 independent reviewers for factors considered important in the interpretation of the clinical importance of study results: identification of a clearly defined primary outcome, reporting of the expected difference between groups used in the calculation of sample size (the delta value) and whether it was based on the minimal clinically important difference of the intervention, the statistical significance of the results, presentation of pertinent confidence intervals, and the authors' interpretation of the clinical importance of the results.

Results: Twenty-two of 27 (81%) articles explicitly reported a single primary outcome. Of the 20 articles that included a sample size calculation, 18 (90%) reported a delta value. Two of the 18 (11%) articles explicitly stated that the delta value was chosen to reflect the minimal clinically important difference of the intervention. For the primary outcomes, confidence intervals surrounding the point estimates of the efficacy of the interventions were reported in 11 of 27 (41%) studies. The study results were interpreted from the perspective of clinical importance in 20 of 27 (74%) of the articles. Of these 20 reports, 5 (25%) provided justification for their clinical interpretation of the results.

Interpretation: Authors of RCTs published in major general medical and internal medicine journals do not consistently provide their own interpretation of the clinical importance of their results, and they often do not provide sufficient information to allow readers to make their own interpretation.

View Full Text
PreviousNext
Back to top

In this issue

CMAJ
Vol. 165, Issue 9
30 Oct 2001
  • Table of Contents
  • Index by author

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on CMAJ.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
How well is the clinical importance of study results reported? An assessment of randomized controlled trials
(Your Name) has sent you a message from CMAJ
(Your Name) thought you would like to see the CMAJ web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
How well is the clinical importance of study results reported? An assessment of randomized controlled trials
Karen B.Y. Chan, Malcolm Man-Son-Hing, Frank J. Molnar, Andreas Laupacis
CMAJ Oct 2001, 165 (9) 1197-1202;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
‍ Request Permissions
Share
How well is the clinical importance of study results reported? An assessment of randomized controlled trials
Karen B.Y. Chan, Malcolm Man-Son-Hing, Frank J. Molnar, Andreas Laupacis
CMAJ Oct 2001, 165 (9) 1197-1202;
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Jump to section

  • Article
    • Abstract
    • Methods
    • Results
    • Interpretation
    • Footnotes
    • References
  • Figures & Tables
  • Responses
  • Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • DELTA2 guidance on choosing the target difference and undertaking and reporting the sample size calculation for a randomised controlled trial
  • Decline In Placebo-Controlled Trial Results Suggests New Directions For Comparative Effectiveness Research
  • Ergometer Cycling After Hip or Knee Replacement Surgery: A Randomized Controlled Trial
  • A systematic review of the quality of publications reporting coronary artery bypass grafting trials
  • Communicating With Patients About Chemotherapy Costs
  • Effectiveness of a parent "buddy" program for mothers of very preterm infants in a neonatal intensive care unit
  • Reporting the clinical importance of randomized controlled trials
  • Reporting the clinical importance of randomized controlled trials
  • Reporting the clinical importance of randomized controlled trials
  • Google Scholar

More in this TOC Section

  • Falsely elevated point-of-care lactate measurement after ingestion of ethylene glycol
  • Severe necrotizing pancreatitis following combined hepatitis A and B vaccination
  • Can hockey playoffs harm your hearing?
Show more Research article

Similar Articles

 

View Latest Classified Ads

Content

  • Current issue
  • Past issues
  • Collections
  • Sections
  • Blog
  • Podcasts
  • Alerts
  • RSS
  • Early releases

Information for

  • Advertisers
  • Authors
  • Reviewers
  • CMA Members
  • CPD credits
  • Media
  • Reprint requests
  • Subscribers

About

  • General Information
  • Journal staff
  • Editorial Board
  • Advisory Panels
  • Governance Council
  • Journal Oversight
  • Careers
  • Contact
  • Copyright and Permissions
CMAJ Group

Copyright 2023, CMA Impact Inc. or its licensors. All rights reserved. ISSN 1488-2329 (e) 0820-3946 (p)

All editorial matter in CMAJ represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.

To receive any of these resources in an accessible format, please contact us at CMAJ Group, 500-1410 Blair Towers Place, Ottawa ON, K1J 9B9; p: 1-888-855-2555; e: [email protected]

CMA Civility, Accessibility, Privacy

 

Powered by HighWire