Review
Tips for learners of evidence-based medicine: 3. Measures of observer variability (kappa statistic)
Thomas McGinn, Peter C. Wyer, Thomas B. Newman, Sheri Keitz, Rosanne Leipzig, Gordon Guyatt for and ; The Evidence-Based Medicine Teaching Tips Working Group
CMAJ November 23, 2004 171 (11) 1369-1373; DOI: https://doi.org/10.1503/cmaj.1031981
Thomas McGinn
Peter C. Wyer
Thomas B. Newman
Sheri Keitz
Rosanne Leipzig

Data supplements
EBM Resources
Files in this Data Supplement:
- Tips for teachers of evidence-based medicine: 3. Understanding and calculating kappa -
A companion version of this article directed at teachers of evidence-based medicine [244 KB PDF]
An interactive version of other tools and resources can be found at www.ebmtips.net/ci001.asp
- Tips for teachers of evidence-based medicine: 3. Understanding and calculating kappa -
A companion version of this article directed at teachers of evidence-based medicine [244 KB PDF]
Related Articles
- , . (2004). Highlights of this issue. CMAJ, 171(11), 1317. Accessed January 26, 2023. Retrieved from http://www.cmaj.ca/content/171/11/1317.
- Wyer, P. C., Keitz, S., Hatala, R., Hayward, R., Barratt, A., Montori, V., Wooltorton, E., & Guyatt, G. (2004). Tips for learning and teaching evidence-based medicine: introduction to the series. CMAJ, 171(4), 347-348. Accessed January 26, 2023. https://doi.org/10.1503/cmaj.1031665.
- (2005). Correction. CMAJ, 173(6), 579. Accessed January 26, 2023. https://doi.org/10.1503/cmaj.051025.
- Hatala, R., Keitz, S., Wyer, P., & Guyatt, G. (2005). Tips for learners of evidence-based medicine: 4. Assessing heterogeneity of primary studies in systematic reviews and whether to combine their results. CMAJ, 172(5), 661-665. Accessed January 26, 2023. https://doi.org/10.1503/cmaj.1031920.
- Barratt, A., Wyer, P. C., Hatala, R., McGinn, T., Dans, A. L., Keitz, S., Moyer, V., & for, G. G. (2004). Tips for learners of evidence-based medicine: 1. Relative risk reduction, absolute risk reduction and number needed to treat. CMAJ, 171(4), 353-358. Accessed January 26, 2023. https://doi.org/10.1503/cmaj.1021197.
- Montori, V. M., Kleinbart, J., Newman, T. B., Keitz, S., Wyer, P. C., Moyer, V., & Guyatt, G. (2004). Tips for learners of evidence-based medicine: 2. Measures of precision (confidence intervals). CMAJ, 171(6), 611-615. Accessed January 26, 2023. https://doi.org/10.1503/cmaj.1031667.
- Montori, V. M., Wyer, P., Newman, T. B., Keitz, S., & Guyatt, G. (2005). Tips for learners of evidence-based medicine: 5. The effect of spectrum of disease on the performance of diagnostic tests. CMAJ, 173(4), 385-390. Accessed January 26, 2023. https://doi.org/10.1503/cmaj.1031666.
In this issue
Article tools
Respond to this article
Tips for learners of evidence-based medicine: 3. Measures of observer variability (kappa statistic)
Thomas McGinn, Peter C. Wyer, Thomas B. Newman, Sheri Keitz, Rosanne Leipzig, Gordon Guyatt for
CMAJ Nov 2004, 171 (11) 1369-1373; DOI: 10.1503/cmaj.1031981
Jump to section
Related Articles
Cited By...
- A systematic review of medical and clinical research landscapes and quality in Malaysia and Indonesia [REALQUAMI]: the review protocol
- Changes in medication administration error rates associated with the introduction of electronic medication systems in hospitals: a multisite controlled before and after study
- An Interrater Reliability Study of Pulmonary Function Assessment With a Portable Spirometer
- Updated meta-analysis on prevention of venous thromboembolism in ambulatory cancer patients
- Comparison of informal caregiver and named nurse assessment of symptoms in elderly patients dying in hospital using the palliative outcome scale
- Paediatric advance care planning survey: a cross-sectional examination of congruence and discordance between adolescents with HIV/AIDS and their families
- Most elite athletes return to competition following operative management of meniscal tears: a systematic review
- The use of antibiotic prophylaxis in hip arthroscopy is under-reported and lacks evidence-based guidelines: a systematic review and survey
- Systematic review and meta-analysis of the effect of SGLT-2 inhibitors on microvascular outcomes in patients with type 2 diabetes: a review protocol
- Effects of advanced life support versus basic life support on the mortality rates of patients with trauma in prehospital settings: a study protocol for a systematic review and meta-analysis
- Effectiveness of a 'Do not interrupt bundled intervention to reduce interruptions during medication administration: a cluster randomised controlled feasibility study
- A systematic review and meta-analysis of trials of social network interventions in type 2 diabetes
- Surgical treatment of femoroacetabular impingement following slipped capital femoral epiphysis: A systematic review
- Answering medical questions at the point of care: a cross-sectional study comparing rapid decisions based on PubMed and Epistemonikos searches with evidence-based recommendations developed with the GRADE approach
- Prospective validation of a clinical decision rule to identify patients presenting to the emergency department with chest pain who can safely be removed from cardiac monitoring
- Athletic groin pain: a systematic review of surgical diagnoses, investigations and treatment
- Safety and efficacy of tranexamic acid in bleeding paediatric trauma patients: a systematic review protocol
- Return to Work and Sport Following High Tibial Osteotomy: A Systematic Review
- Early evidence reports positive outcomes after osteochondral grafts and chondrocyte transplantation in the hip: a systematic review
- Retractions in orthopaedic research: A systematic review
- Use of heparins in patients with cancer: individual participant data meta-analysis of randomised trials study protocol
- Childhood Cancer Mortality in India: Direct Estimates From a Nationally Representative Survey of Childhood Deaths
- No difference in outcome between early versus delayed weight-bearing following microfracture surgery of the hip, knee or ankle: a systematic review of outcomes and complications
- Expanding the scope of Critical Care Rapid Response Teams: a feasible approach to identify adverse events. A prospective observational cohort
- Non-visible versus visible haematuria and bladder cancer risk: a study of electronic records in primary care
- Computed tomography to assess risk of death in acute pulmonary embolism: a meta-analysis
- The Correlation Between Esophageal and Abdominal Pressures in Mechanically Ventilated Patients Undergoing Laparoscopic Surgery
- Determining the frequency and preventability of adverse drug reaction-related admissions to an Irish University Hospital: a cross-sectional study
- Periprocedural Heparin Bridging in Patients Receiving Vitamin K Antagonists: Systematic Review and Meta-Analysis of Bleeding and Thromboembolic Rates
- Authors response
- Errors in the administration of intravenous medications in hospital and the role of correct procedures and nurse experience
- Bedside Screening for Fistula Stenosis Should Be Tailored to the Site of the Arteriovenous Anastomosis
- In Search of an Optimal Bedside Screening Program for Arteriovenous Fistula Stenosis
- Homocysteine in Vascular Behcet Disease: A Meta-Analysis
- Visual Assessment of the Spine Bruckel Instrument, a Novel Status Tool to Reflect Appearance of the Spine in Patients with Ankylosing Spondylitis
- JAK2V617F mutation for the early diagnosis of Ph- myeloproliferative neoplasms in patients with venous thromboembolism: a meta-analysis
- Relationship Between Preventability of Death After Coronary Artery Bypass Graft Surgery and All-Cause Risk-Adjusted Mortality Rates
- Cardiovascular Risk Factors and Venous Thromboembolism: A Meta-Analysis
- Accuracy of Physical Examination in the Detection of Arteriovenous Fistula Stenosis
- Erythropoietin-receptor agonists in critically ill patients: a meta-analysis of randomized controlled trials
- Discordance in Perceptions of Barriers to Diabetes Care Between Patients and Primary Care and Secondary Care
- Thrombophilic abnormalities, oral contraceptives, and risk of cerebral vein thrombosis: a meta-analysis
- Not Working 3 Years After Breast Cancer: Predictors in a Population-Based Study
- Reliability of the Whiff Test in Clinical Practice
- Teaching evidence-based practice on foot
- Work absence after breast cancer diagnosis: a population-based study
- Teaching evidence-based practice on foot
- Kappa statistic
- Kappa statistic
- Kappa statistic
- Kappa statistic
- Editor's note