Skip to main content

Main menu

  • Home
  • COVID-19
    • Articles & podcasts
    • Blog posts
    • Collection
    • News
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • Classified ads
  • Authors
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
  • CMA Members
    • Overview for members
    • Earn CPD Credits
    • Print copies of CMAJ
    • Career Ad Discount
  • Subscribers
    • General information
    • View prices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN

User menu

Search

  • Advanced search
CMAJ
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN
CMAJ

Advanced Search

  • Home
  • COVID-19
    • Articles & podcasts
    • Blog posts
    • Collection
    • News
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • Classified ads
  • Authors
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
  • CMA Members
    • Overview for members
    • Earn CPD Credits
    • Print copies of CMAJ
    • Career Ad Discount
  • Subscribers
    • General information
    • View prices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
  • Visit CMAJ on Facebook
  • Follow CMAJ on Twitter
  • Follow CMAJ on Pinterest
  • Follow CMAJ on Youtube
  • Follow CMAJ on Instagram
Commentary

Intention-to-treat principle

Victor M. Montori and Gordon H. Guyatt
CMAJ November 13, 2001 165 (10) 1339-1341;
Victor M. Montori
Dr. Montori is with the Division of Endocrinology, Metabolism, and Nutrition, Department of Internal Medicine, Mayo Clinic and Foundation, Rochester, Minn. Dr. Guyatt is with the Departments of Medicine and of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gordon H. Guyatt
Dr. Montori is with the Division of Endocrinology, Metabolism, and Nutrition, Department of Internal Medicine, Mayo Clinic and Foundation, Rochester, Minn. Dr. Guyatt is with the Departments of Medicine and of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Responses
  • Metrics
  • PDF
Loading

In deciding if a treatment is likely to work in an individual patient, clinicians need to know the effect of the intervention in patients who take the treatment as prescribed. However, participants in clinical trials may not adhere to the protocol, or clinicians may recommend withdrawal of the study medication because of apparent adverse effects. Should investigators exclude from the analysis any participants who violate the research protocol? In this article, we review how randomization reduces bias in clinical trials and then discuss the importance of including all eligible patients in the analysis, to ensure the validity of the results.

Preventing bias in randomized controlled trials

The randomized controlled clinical trial is the best way to minimize bias in ascertaining treatment effects. The intent of randomization is to establish groups of patients with similar distributions of the characteristics that could determine whether they will suffer the adverse outcome of interest. If prognostic factors are balanced in the 2 (or more) groups and if the treatment has no effect, the proportion of participants experiencing the target outcome will be similar in the arms of the study. Conversely, if differences in outcome are observed, clinicians can confidently attribute those differences to the experimental intervention.

Applying the intention-to-treat principle

How should investigators analyze study data if one or more patients have not adhered to the allocated management strategy, for whatever reason? Some investigators deal with these protocol violations by excluding the participants from the analysis. This form of analysis, known as a per protocol, efficacy, explanatory analysis, or analysis by treatment administered, describes the outcomes of the participants who adhered to the research protocol. Although investigators can use information from such an analysis to estimate the intervention's efficacy in those who actually received it in the intended intensity or dose for the intended interval, this estimate is likely to be seriously flawed.

The problem arises because the reasons for nonadherence to the protocol may be related to prognosis. Empirical evidence suggests that participants who adhere tend to do better than those who do not adhere, even after adjustment for all known prognostic factors and irrespective of assignment to active treatment or placebo.1,2 Excluding nonadherent participants from the analysis leaves those who may be destined to have a better outcome and destroys the unbiased comparison afforded by randomization.3

A hypothetical example will illustrate how excluding patients who do not receive the treatment to which they are assigned can introduce bias. Imagine a randomized trial of 200 patients with cerebrovascular disease, of whom 100 are assigned to receive acetylsalicylic acid (ASA) and a surgical intervention for which there is a 1-month waiting period and the other 100 are assigned to receive ASA alone (Fig. 1). Let us assume that the surgery is ineffective in preventing stroke — that is, on average, the same proportion of patients in each of the 2 arms (surgery + ASA and ASA only) will suffer a stroke.

Figure1
  • Download figure
  • Open in new tab
  • Download powerpoint

Fig. 1: Per protocol analysis introduces bias into the estimate of intervention efficacy. For our analysis of this hypothetical randomized controlled trial of patients with cerebrovascular disease, it is assumed that the surgery is ineffective in preventing the adverse outcome of interest (stroke). Per protocol analysis of the treatment group (surgery + acetylsalicylic acid [ASA]) includes only those patients who adhered to the protocol (in this case, those who received surgery); “nonadherent” patients (those who died before having the opportunity to undergo surgery) are excluded. With this analysis, the event rate is 0.11 in the surgery + ASA arm and 0.20 in the control arm, which represents a relative risk reduction (RRR) of 0.45. The intention-to-treat analysis, which counts all events in all randomized patients, shows equal event rates (0.20) in both arms and no risk reduction. This analysis suggests the underlying truth, a treatment effect of zero. R = randomization.

In the surgery + ASA arm, 10 of the 100 patients have a stroke, the primary outcome of the trial, in the 1-month waiting period between randomization and surgery. Of the 90 patients who go on to have the surgery, 10 have a stroke in the subsequent year. Because in the absence of an effective intervention the patients in the ASA-only arm share the same destiny as those in the surgery + ASA arm, and because we have assumed that surgery is ineffective, we know that 10 patients in the ASA-only arm will have a stroke in the month after randomization and another 10 will do so in the subsequent year.

If we restrict the analysis in the surgery + ASA arm to the patients who underwent surgery (a per protocol analysis), the event rate would be 11% (10/90); however, the rate in the ASA-only arm would be 20% (20/100). These values represent a spurious (since we have assumed that surgery in fact has no effect on subsequent occurrence of stroke) reduction in stroke risk of close to 50%. Alternatively, if we count all events in all randomized patients, according to the intention-to-treat principle, we find that there were 20 events in each group and no evidence of a positive treatment effect. This analysis eliminates the misleading estimate of surgery's impact that is obtained with the per protocol analysis.

As illustrated by this example, applying the intention-to-treat principle provides an unbiased assessment of the efficacy of the intervention at the level of adherence observed in the trial. This level of adherence could be similar to that observed in the community, and the results could inform community-based decisions about the effectiveness of the experimental intervention.

However, clinicians make decisions at the level of the individual patient. Patients considering a treatment regimen and committed to complying with treatment wish to know how well the treatment will work when they use it at the intended dose for the intended duration. We have seen how per protocol analysis fails to answer this question and introduces bias. Unfortunately, applying the intention-to-treat principle doesn't solve the problem. When treatment is effective but nonadherence is substantial, the analysis following the intention-to-treat principle underestimates the magnitude of the treatment effect that will occur in adherent patients.

The solution involves conducting an intention-to-treat analysis, but only after using a protocol that ensures maximal adherence. For instance, studies may include run-in periods that identify nonadherent participants or participants intolerant to the experimental treatment, so they can be excluded before randomization.4

Dealing with loss to follow-up

Intention-to-treat analysis cannot minimize bias introduced by loss to follow-up, that is, patients whose outcome status is unknown. If investigators stop following patients who do not adhere to the study protocol, they will be unaware if those patients suffered the target outcome. If they conduct an intention-to-treat analysis and count events in all participants of whose outcomes they are aware (that is, those who followed the protocol), they will, de facto, be conducting a per protocol analysis.

Investigators often include patients lost to follow-up in the denominators in tables describing study results and in calculating estimates of effect. This approach assumes that none of those lost to follow-up suffered the target outcome. Making this unlikely assumption opens the door to a misleading presentation of study results. Alternative strategies are available that impute outcomes to those lost to follow-up. Some of these strategies include using multivariate analysis of prognostic factors to predict the most likely outcome in those lost to follow-up, imputation of outcomes by carrying the last known outcome status forward and analysis of best-case and worst-case scenarios. Nonetheless, these strategies in general make unverifiable assumptions that may introduce bias in the estimates of treatment effect.5 Thus, inferences from studies with appreciable loss to follow-up are usually weaker.

Determining if intention-to-treat analysis was used

Clinicians evaluating a randomized trial need to know if the researchers applied the intention-to-treat principle. A quick approach is to scan the Methods section of the published report looking for the phrase “intention-to-treat analysis.” Two surveys of randomized controlled trials published in major medical journals during 1993–19956 and 19975 found that half of the reports used the term “intention-to-treat analysis.” Unfortunately, the term was not always used appropriately. Thus, readers must look carefully at what was actually done, rather than looking only for the term.

In particular, significant loss to follow-up may introduce exactly the same bias as a per protocol analysis. For instance, Silverstein and associates7 reported the results of a trial in which 8843 patients taking nonsteroidal anti-inflammatory agents for rheumatoid arthritis were randomly assigned to receive misoprostol (4404 patients) or placebo (4439 patients) to prevent gastroduodenal complications, as judged by outcome assessors blinded to treatment assignment. The authors described their analysis as an intention-to-treat analysis. However, patients lost to follow-up were included in the denominator of event rates. Inclusion of these patients in the denominator without accounting for their outcomes in the numerator assumes that no patient lost to follow-up had gastroduodenal complications. The size of the groups lost to follow-up (1851 patients in the misoprostol group and 1617 in the placebo group) eclipsed the number of patients who experienced the primary end point in each group (25 in the misoprostol group and 42 in the placebo group), a situation that leaves the reader uncertain about the true magnitude of the treatment effect.

In another example, Harris and associates8 reported the results of study in which 1628 postmenopausal women with a previous vertebral fracture were randomly assigned to receive risedronate (813 patients) or placebo (815 patients) to prevent another vertebral fracture, as judged by a radiologist blinded to treatment assignment. These authors also described their analysis as an intention-to-treat analysis. After 3 years, 324 patients in the risedronate arm and 365 patients in the placebo arm had been lost to follow-up. The authors reported outcomes up to the point of last follow-up (using survival analysis), including 61 in the risedronate group and 93 patients in the placebo group with new vertebral fractures; the relative risk reduction was 41% in favour of risedronate. Those lost to follow-up from the placebo group were at higher risk (had more vertebral fractures) at baseline than either those in the placebo group who completed the study or those lost from the risedronate arm. This indicates that the placebo patients remaining in the study were a good-prognosis group and had, on average, a better prognosis than the remaining patients in the risedronate group. Because the risedronate group experienced fewer vertebral fractures than the placebo group, the substantial loss to follow-up in this case does not weaken the inference that risedronate results in a relative risk reduction of about 41%.

Conclusions

If randomized controlled trials are to provide unbiased assessments of treatment efficacy, investigators must apply the intention-to-treat principle. To improve the applicability of study results to individual patients, investigators should improve study design to ensure protocol adherence with minimal loss to follow-up. Finally, loss to follow-up can result in exactly the same sort of bias as a per protocol analysis. Therefore, if there is significant loss to follow-up, statements that investigators conducted an “intention-to-treat analysis” generally provide little reassurance.

Acknowledgments

This work was supported in part by the American Medical Association.

Footnotes

  • This article has been peer reviewed.

    Competing interests: None declared.

References

  1. 1.↵
    Coronary Drug Project Research Group. Influence of adherence to treatment and response of cholesterol on mortality in the Coronary Drug Project. N Engl J Med 1980;303:1038-41.
    OpenUrlCrossRefPubMed
  2. 2.↵
    Horwitz R, Viscoli C, Berkman L. Treatment adherence and risk of death after myocardial infarction. Lancet 1990;336:542-5.
    OpenUrlCrossRefPubMed
  3. 3.↵
    Altman D. Clinical trials. In: Practical statistics for medical research. London: Chapman & Hall; 1991. p. 440-4761.
  4. 4.↵
    Heart Outcomes Prevention Evaluation Study Investigators. Effects of an angiotensin-converting-enzyme inhibitor, ramipril, on cardiovascular events in high-risk patients. N Engl J Med 2000;342:145-53.
    OpenUrlCrossRefPubMed
  5. 5.↵
    Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ 1999;319:670-47.
    OpenUrlAbstract/FREE Full Text
  6. 6.↵
    Ruiz-Canela M, Martinez-Gonzalez MA, de Irala-Estevez J. Intention to treat analysis is related to methodological quality. BMJ 2000;320:1007-8
    OpenUrlFREE Full Text
  7. 7.↵
    Silverstein FE, Graham DY, Senior JR, Davies HW, Struthers BJ, Bittman RM, et al. Misoprostol reduces serious gastrointestinal complications in patients with rheumatoid arthritis receiving nonsteroidal anti-inflammatory drugs: a randomized, double-blind placebo-controlled trial. Ann Intern Med 1995;123:241-9.
    OpenUrlCrossRefPubMed
  8. 8.↵
    Harris ST, Watts NB, Genant HK, McKeever CD, Hangartner T, Keller M, et al, for the Vertebral Efficacy with Risedronate Therapy (VERT) Study Group. Effects of risedronate treatment on vertebral and nonvertebral fractures in women with postmenopausal osteoporosis: a randomized controlled trial. JAMA 1999;282:1344-52.
    OpenUrlCrossRefPubMed
PreviousNext
Back to top

In this issue

CMAJ
Vol. 165, Issue 10
13 Nov 2001
  • Table of Contents
  • Index by author

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on CMAJ.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Intention-to-treat principle
(Your Name) has sent you a message from CMAJ
(Your Name) thought you would like to see the CMAJ web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Intention-to-treat principle
Victor M. Montori, Gordon H. Guyatt
CMAJ Nov 2001, 165 (10) 1339-1341;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
‍ Request Permissions
Share
Intention-to-treat principle
Victor M. Montori, Gordon H. Guyatt
CMAJ Nov 2001, 165 (10) 1339-1341;
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Preventing bias in randomized controlled trials
    • Applying the intention-to-treat principle
    • Dealing with loss to follow-up
    • Determining if intention-to-treat analysis was used
    • Conclusions
    • Acknowledgments
    • Footnotes
    • References
  • Figures & Tables
  • Responses
  • Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Efficacy of cognitive behavioural therapy-based smartphone app for smoking cessation in China: a study protocol of a randomised controlled trial
  • Brief mindfulness-based intervention of 'STOP (Stop, Take a Breath, Observe, Proceed) touching your face: a study protocol of a randomised controlled trial
  • Equivalent performance of single-use and reusable duodenoscopes in a randomised trial
  • Long-term outcome of a randomized controlled study in patients with newly diagnosed severe aplastic anemia treated with antithymocyte globulin and cyclosporine, with or without granulocyte colony-stimulating factor: a Severe Aplastic Anemia Working Party Trial from the European Group of Blood and Marrow Transplantation
  • Dynamic Vision Training Transfers Positively to Batting Performance Among Collegiate Baseball Batters
  • Be Careful with Adverse Events Caused by Cefoperazone-Sulbactam
  • Statistical Quality Scale 6 (SQS-6)
  • Protocol for a placebo-controlled, within-participants crossover trial evaluating the efficacy of intranasal oxytocin to improve pain and function among women with chronic pelvic musculoskeletal pain
  • PCI Choice Decision Aid for Stable Coronary Artery Disease: A Randomized Trial
  • Best (but oft-forgotten) practices: intention-to-treat, treatment adherence, and missing participant outcome data in the nutrition literature
  • Variation in Hospital Risk-Adjusted Mortality Rates Following Transcatheter Aortic Valve Replacement in the United States: A Report From the Society of Thoracic Surgeons/American College of Cardiology Transcatheter Valve Therapy Registry
  • Understanding Orthopaedic Registry Studies: A Comparison with Clinical Studies
  • Best (but oft-forgotten) practices: sensitivity analyses in randomized controlled trials
  • Efficacy of metacognitive therapy for prolonged grief disorder: protocol for a randomised controlled trial
  • Adherence-adjusted estimates of benefits and harms from treatment with amoxicillin for LRTI: secondary analysis of a 12-country randomised placebo-controlled trial using randomisation-based efficacy estimators
  • A practical approach to evidence-based dentistry: III: How to appraise and use an article about therapy
  • The effects of a multisite aerobic exercise intervention on asthma morbidity in sedentary adults with asthma: the Ex-asthma study randomised controlled trial protocol
  • Do Community Health Worker Interventions Improve Rates of Screening Mammography in the United States? A Systematic Review
  • Randomized Controlled Study Investigating Viral Suppression and Serological Response following Pre-S1/Pre-S2/S Vaccine Therapy Combined with Lamivudine Treatment in HBeAg-Positive Patients with Chronic Hepatitis B
  • Comparing Ultrasound Biometry with Partial Coherence Interferometry for Intraocular Lens Power Calculations: A Randomized Study
  • Overview of clinical research design
  • Evaluating ethics consultation: randomised controlled trial is not the right tool
  • Blinding of Outcomes in Trials of Orthopaedic Trauma: An Opportunity to Enhance the Validity of Clinical Trials
  • Tai Chi and Perceived Health Status in Older Adults Who Are Transitionally Frail: A Randomized Controlled Trial
  • Pragmatic randomised controlled trials in parenting research: the issue of intention to treat.
  • The Intention-to-Treat Principle: A Primer for the Orthopaedic Surgeon
  • Systematic Evaluation of the Quality of Randomized Controlled Trials in Diabetes
  • Effects of a mutual support group for families of Chinese people with schizophrenia: 18-month follow-up
  • Surgery for non-small cell lung cancer: systematic review and meta-analysis of randomised controlled trials
  • Clinical trials in mild cognitive impairment: lessons for the future
  • Prognostic Significance of O6-Methylguanine-DNA Methyltransferase Determined by Promoter Hypermethylation and Immunohistochemical Expression in Anaplastic Gliomas
  • Google Scholar

More in this TOC Section

  • Time to dismantle systemic anti-Black racism in medicine in Canada
  • Preventing the introduction of SARS-CoV-2 into school settings
  • How should we move for health? The case for the 24-hour movement paradigm
Show more Commentary

Similar Articles

Content

  • Current issue
  • Past issues
  • Collections
  • Sections
  • Blog
  • Podcasts
  • Alerts
  • RSS
  • Early releases

Information for

  • Advertisers
  • Authors
  • Reviewers
  • CMA Members
  • Media
  • Reprint requests
  • Subscribers

About

  • General Information
  • Journal staff
  • Editorial Board
  • Governance Council
  • Journal Oversight
  • Careers
  • Contact
  • Copyright and Permissions

Copyright 2021, Joule Inc. or its licensors. All rights reserved. ISSN 1488-2329 (e) 0820-3946 (p)

All editorial matter in CMAJ represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.

Powered by HighWire