This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow [Online Tables]
Right arrow Correction (v170,p1082)
Right arrow Submit a response
Right arrow View responses
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Schünemann, H. J.
Right arrow Articles by for The GRADE Working Group
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Schünemann, H. J.
Right arrow Articles by for The GRADE Working Group,
Related Collections
Right arrow Other medical informatics
Right arrow International health
Right arrow Organization of health care
Right arrowRelated Article
CMAJ • September 30, 2003; 169 (7)
© 2003 Canadian Medical Association or its licensors


Commentary
Commentaire

Essay

Letters, numbers, symbols and words: how to communicate grades of evidence and recommendations

Holger J. Schünemann, Dana Best, Gunn Vist, Andrew D. Oxman and for The GRADE Working Group

From the Departments of Medicine and of Social and Preventive Medicine, University of Buffalo, Buffalo, NY (Schünemann); the Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ont. (Schünemann); the Division of General Pediatrics, Children's National Medical Center, Washington, DC (Best); and the Department of Health Services Research, Norwegian Directorate for Health and Social Welfare, Oslo, Norway (Vist, Oxman)Members of the GRADE Working Group : David Atkins, Chief Medical Officer, Center for Practice and Technology Assessment, Agency for Healthcare Research and Quality, USA; Dana Best, Assistant Professor, Department of General Pediatrics and Adolescent Medicine, George Washington University, Children's National Medical Center, USA; Peter A Briss, Acting Chief Community Guide Branch, Centers for Disease Control and Prevention, USA; Martin Eccles, Professor, and James Mason, Professor, Centre for Health Services Research, University of Newcastle upon Tyne, U.K.; Yngve Falck-Ytter, Associate Director, German Cochrane Centre, Institute for Medical Biometry and Medical Informatics, University Hospital Freiburg, Germany; Gunn E. Vist, Researcher, Signe Flottorp, Researcher, and Andrew D. Oxman, Director, Department of Health Services Research, Norwegian Directorate for Health and Social Welfare, Norway; Gordon H. Guyatt, Professor, and Roman Jaeschke, Associate Clinical Professor, Departments of Clinical Epidemiology and Biostatistics and Medicine, McMaster University, Canada; Robin T. Harbour, Quality and Information Director, Scottish Intercollegiate Guidelines Network, United Kingdom; Margaret C. Haugh, Methodologist, Fédération Nationale des Centres de Lutte Contre le Cancer, France; David Henry, Professor and Suzanne Hill, Senior Lecturer, Department of Clinical Pharmacology, Faculty of Medicine and Health Sciences, University of Newcastle, Australia; Gillian Leng, Guidelines Programme Director, National Institute for Clinical Excellence, United Kingdom; Alessandro Liberati, Professor, Università di Modena e Reggio Emilia and Centro per la Valutazione della Efficacia della Assistenza Sanitaria, Italy; Nicola Magrini, Director, Centro per la Valutazione della Efficacia della Assistenza Sanitaria, Italy; Philippa Middleton, Honorary Research Fellow, Australasian Cochrane Centre, Australia; Jacek Mrukowicz, Executive Director, Polish Institute for Evidence Based Medicine, Poland; Dianne O'Connell, Senior Epidemiologist, Cancer Epidemiology Research Unit, Cancer Research and Registers Division, The Cancer Council, Australia; Bob Phillips, Associate Fellow, Centre for Evidence-based Medicine, University Department of Psychiatry, Warneford Hospital, United Kingdom; Holger J Schünemann, Assistant Professor, Departments of Medicine and of Social & Preventive Medicine, University of Buffalo, USA; Tessa Tan-Torres Edejer, Medical Officer/Scientist, Global Programme on Evidence for Health Policy, World Health Organisation, Switzerland; Helena Varonen, Associate Editor, Finnish Medical Society Duodecim, Finland; John W. Williams Jr., Associate Professor, The Center for Health Services Research in Primary Care, Health Services Research and Development, Department of Veterans Affairs Medical Center and Duke University Medical Center, USA; Stephanie Zaza, Acting Associate Director for Science, Epidemiology Program Office, Centers for Disease Control and Prevention, USA

Correspondence to: Dr. Holger J. Schünemann, Departments of Medicine and of Social and Preventive Medicine, University of Buffalo, 270 Farber Hall, 3435 Main St., Buffalo NY 14214, USA; fax 716-898-4493; hjs{at}buffalo.edu

Abstract

THE GRADE WORKING GROUP IS DEVELOPING and evaluating a common, sensible approach to grading quality of evidence and strength of recommendations in health care. In this article, we discuss the advantages and disadvantages of using letters, numbers, symbols or words to represent grades of evidence and recommendations. Using multiple strategies, we searched for comparative studies of alternative ways of representing ordered categories in any context. In addition, we contacted experts and reviewed theoretical work and qualitative research on how best to communicate grades of any kind quickly and clearly. We were unable to identify health care research that addressed, either directly or indirectly, the best way to present grades of evidence and recommendations. We found examples of symbols used by government, commercial and consumer organizations to communicate quality of evidence or strength of recommendations, but no comparative studies. Although a number of grading systems are used in health care and other fields, there is little or no evidence of how well various presentations are understood. Before promoting the use of specific symbols, numbers, letters or words, the extent to which the intended message is comprehended should be evaluated.



Related Article

Are all evidence-based practices alike? Problems in the ranking of evidence
Ross E.G. Upshur
Can. Med. Assoc. J. 2003 169: 672-673. [Full Text] [PDF]



This article has been cited by other articles:


Home page
ChestHome page
G. H. Guyatt, D. J. Cook, R. Jaeschke, S. G. Pauker, and H. J. Schunemann
Grades of Recommendation for Antithrombotic Agents: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines (8th Edition)
Chest, June 1, 2008; 133(6_suppl): 123S - 131S.
[Abstract] [Full Text] [PDF]


Home page
BMJHome page
G. H Guyatt, A. D Oxman, R. Kunz, Y. Falck-Ytter, G. E Vist, A. Liberati, H. J Schunemann, and for the GRADE Working Group
Going from evidence to recommendations
BMJ, May 10, 2008; 336(7652): 1049 - 1051.
[Full Text] [PDF]


Home page
JCOHome page
M. C. Brouwers, M. R. Somerfield, and G. P. Browman
A for Effort: Learning From the Application of the GRADE Approach to Cancer Guideline Development
J. Clin. Oncol., March 1, 2008; 26(7): 1025 - 1026.
[Full Text] [PDF]


Home page
CMAJHome page
V. A. Palda MD MSc, D. Davis MD, and J. Goldman MSc
A guide to the Canadian Medical Association Handbook on Clinical Practice Guidelines
Can. Med. Assoc. J., November 6, 2007; 177(10): 1221 - 1226.
[Full Text] [PDF]


Home page
Am. J. Respir. Crit. Care Med.Home page
H. J. Schunemann, R. Jaeschke, D. J. Cook, W. F. Bria, A. A. El-Solh, A. Ernst, B. F. Fahy, M. K. Gould, K. L. Horan, J. A. Krishnan, et al.
An Official ATS Statement: Grading the Quality of Evidence and Strength of Recommendations in ATS Guidelines and Recommendations
Am. J. Respir. Crit. Care Med., September 1, 2006; 174(5): 605 - 614.
[Full Text] [PDF]


Home page
BMJHome page
G. Elwyn, A. O'Connor, D. Stacey, R. Volk, A. Edwards, A. Coulter, R. Thomson, A. Barratt, M. Barry, S. Bernstein, et al.
Developing a quality criteria framework for patient decision aids: online international Delphi consensus process
BMJ, August 26, 2006; 333(7565): 417.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Coll. Nutr.Home page
A. G. Logan
Dietary Sodium Intake and Its Relation to Human Health: A Summary of the Evidence
J. Am. Coll. Nutr., June 1, 2006; 25(3): 165 - 169.
[Full Text] [PDF]


Home page
Nephrol Dial TransplantHome page
K. Uhlig, E. M. Balk, J. Lau, and A. S. Levey
Clinical Practice Guidelines in nephrology--for worse or for better
Nephrol. Dial. Transplant., May 1, 2006; 21(5): 1145 - 1153.
[Full Text] [PDF]


Home page
Ann Rheum DisHome page
J Zochling, D van der Heijde, R Burgos-Vargas, E Collantes, J C Davis Jr, B Dijkmans, M Dougados, P Geher, R D Inman, M A Khan, et al.
ASAS/EULAR recommendations for the management of ankylosing spondylitis
Ann Rheum Dis, April 1, 2006; 65(4): 442 - 452.
[Abstract] [Full Text] [PDF]


Home page
Evid. Based Med.Home page
G. Guyatt, G. Vist, Y. Falck-Ytter, R. Kunz, N. Magrini, and H. Schunemann
An emerging consensus on grading recommendations?
Evid. Based Med., February 1, 2006; 11(1): 2 - 4.
[Full Text] [PDF]


Home page
ChestHome page
R. Kunz
"What's in the Black Box?"
Chest, January 1, 2006; 129(1): 7 - 10.
[Full Text] [PDF]


Home page
J Bone Joint Surg BrHome page
D. Tovey and G. Bognolo
Levels of evidence and the orthopaedic surgeon
J Bone Joint Surg Br, December 1, 2005; 87-B(12): 1591 - 1592.
[Full Text] [PDF]


Home page
Am. J. Respir. Cell Mol. Bio.Home page
H. J. Schunemann and J. E. Heffner
A New ATS Committee: Competing in the Marketplace of Ideas
Am. J. Respir. Cell Mol. Biol., November 1, 2005; 33(5): 423 - 424.
[Full Text] [PDF]


Home page
Proc Am Thorac SocHome page
H. J. Schunemann and J. E. Heffner
A New ATS Committee: Competing in the Marketplace of Ideas
Proceedings of the ATS, November 1, 2005; 2(4): 249 - 250.
[Full Text] [PDF]


Home page
Am. J. Respir. Crit. Care Med.Home page
H. J. Schunemann and J. E. Heffner
A New ATS Committee: Competing in the Marketplace of Ideas
Am. J. Respir. Crit. Care Med., November 1, 2005; 172(9): 1067 - 1068.
[Full Text] [PDF]


Home page
ANN INTERN MEDHome page
R. Chou and M. Helfand
Challenges in Systematic Reviews That Assess Treatment Harms
Ann Intern Med, June 21, 2005; 142(12_Part_2): 1090 - 1099.
[Abstract] [Full Text] [PDF]


Home page
PERSPECT VASC SURG ENDOVASC THERHome page
P. Gloviczki
Do We Need Evidence-Based Medicine in the Field of Venous Diseases?
Perspectives in Vascular Surgery and Endovascular Therapy, June 1, 2004; 16(2): 129 - 133.
[PDF]


Home page
CMAJHome page
G. J.M. Tevaarwerk
Grading evidence
Can. Med. Assoc. J., March 16, 2004; 170(6): 928 - 929.
[Full Text] [PDF]


Home page
CMAJHome page
H. J. Schunemann, D. Best, G. Vist, and A. D. Oxman
Grading evidence
Can. Med. Assoc. J., March 16, 2004; 170(6): 929 - 930.
[Full Text] [PDF]


Home page
BMJHome page
P. Glasziou, J. Vandenbroucke, and I. Chalmers
Assessing the quality of research
BMJ, January 3, 2004; 328(7430): 39 - 41.
[Full Text] [PDF]


Home page
CMAJHome page
R. E.G. Upshur
Are all evidence-based practices alike? Problems in the ranking of evidence
Can. Med. Assoc. J., September 30, 2003; 169(7): 672 - 673.
[Full Text] [PDF]

eLetters:

Read all eLetters

Prior study of interest
Adam L Scheffler
CMAJ, 1 Oct 2003 [Full text]
Re: Prior study of interest
Holger Schuenemann
CMAJ, 7 Oct 2003 [Full text]
Grading the evidence!
Malvinder S. Parmar
CMAJ, 6 Nov 2003 [Full text]