|
| Essay |
From the Departments of Medicine and of Social and Preventive Medicine, University of Buffalo, Buffalo, NY (Schünemann); the Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ont. (Schünemann); the Division of General Pediatrics, Children's National Medical Center, Washington, DC (Best); and the Department of Health Services Research, Norwegian Directorate for Health and Social Welfare, Oslo, Norway (Vist, Oxman)Members of the GRADE Working Group : David Atkins, Chief Medical Officer, Center for Practice and Technology Assessment, Agency for Healthcare Research and Quality, USA; Dana Best, Assistant Professor, Department of General Pediatrics and Adolescent Medicine, George Washington University, Children's National Medical Center, USA; Peter A Briss, Acting Chief Community Guide Branch, Centers for Disease Control and Prevention, USA; Martin Eccles, Professor, and James Mason, Professor, Centre for Health Services Research, University of Newcastle upon Tyne, U.K.; Yngve Falck-Ytter, Associate Director, German Cochrane Centre, Institute for Medical Biometry and Medical Informatics, University Hospital Freiburg, Germany; Gunn E. Vist, Researcher, Signe Flottorp, Researcher, and Andrew D. Oxman, Director, Department of Health Services Research, Norwegian Directorate for Health and Social Welfare, Norway; Gordon H. Guyatt, Professor, and Roman Jaeschke, Associate Clinical Professor, Departments of Clinical Epidemiology and Biostatistics and Medicine, McMaster University, Canada; Robin T. Harbour, Quality and Information Director, Scottish Intercollegiate Guidelines Network, United Kingdom; Margaret C. Haugh, Methodologist, Fédération Nationale des Centres de Lutte Contre le Cancer, France; David Henry, Professor and Suzanne Hill, Senior Lecturer, Department of Clinical Pharmacology, Faculty of Medicine and Health Sciences, University of Newcastle, Australia; Gillian Leng, Guidelines Programme Director, National Institute for Clinical Excellence, United Kingdom; Alessandro Liberati, Professor, Università di Modena e Reggio Emilia and Centro per la Valutazione della Efficacia della Assistenza Sanitaria, Italy; Nicola Magrini, Director, Centro per la Valutazione della Efficacia della Assistenza Sanitaria, Italy; Philippa Middleton, Honorary Research Fellow, Australasian Cochrane Centre, Australia; Jacek Mrukowicz, Executive Director, Polish Institute for Evidence Based Medicine, Poland; Dianne O'Connell, Senior Epidemiologist, Cancer Epidemiology Research Unit, Cancer Research and Registers Division, The Cancer Council, Australia; Bob Phillips, Associate Fellow, Centre for Evidence-based Medicine, University Department of Psychiatry, Warneford Hospital, United Kingdom; Holger J Schünemann, Assistant Professor, Departments of Medicine and of Social & Preventive Medicine, University of Buffalo, USA; Tessa Tan-Torres Edejer, Medical Officer/Scientist, Global Programme on Evidence for Health Policy, World Health Organisation, Switzerland; Helena Varonen, Associate Editor, Finnish Medical Society Duodecim, Finland; John W. Williams Jr., Associate Professor, The Center for Health Services Research in Primary Care, Health Services Research and Development, Department of Veterans Affairs Medical Center and Duke University Medical Center, USA; Stephanie Zaza, Acting Associate Director for Science, Epidemiology Program Office, Centers for Disease Control and Prevention, USA
Correspondence to: Dr. Holger J. Schünemann, Departments of Medicine and of Social and Preventive Medicine, University of Buffalo, 270 Farber Hall, 3435 Main St., Buffalo NY 14214, USA; fax 716-898-4493; hjs{at}buffalo.edu
Abstract
THE GRADE WORKING GROUP IS DEVELOPING and evaluating a common, sensible approach to grading quality of evidence and strength of recommendations in health care. In this article, we discuss the advantages and disadvantages of using letters, numbers, symbols or words to represent grades of evidence and recommendations. Using multiple strategies, we searched for comparative studies of alternative ways of representing ordered categories in any context. In addition, we contacted experts and reviewed theoretical work and qualitative research on how best to communicate grades of any kind quickly and clearly. We were unable to identify health care research that addressed, either directly or indirectly, the best way to present grades of evidence and recommendations. We found examples of symbols used by government, commercial and consumer organizations to communicate quality of evidence or strength of recommendations, but no comparative studies. Although a number of grading systems are used in health care and other fields, there is little or no evidence of how well various presentations are understood. Before promoting the use of specific symbols, numbers, letters or words, the extent to which the intended message is comprehended should be evaluated.
Related Article
This article has been cited by other articles:
![]() |
G. H. Guyatt, D. J. Cook, R. Jaeschke, S. G. Pauker, and H. J. Schunemann Grades of Recommendation for Antithrombotic Agents: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines (8th Edition) Chest, June 1, 2008; 133(6_suppl): 123S - 131S. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. H Guyatt, A. D Oxman, R. Kunz, Y. Falck-Ytter, G. E Vist, A. Liberati, H. J Schunemann, and for the GRADE Working Group Going from evidence to recommendations BMJ, May 10, 2008; 336(7652): 1049 - 1051. [Full Text] [PDF] |
||||
![]() |
M. C. Brouwers, M. R. Somerfield, and G. P. Browman A for Effort: Learning From the Application of the GRADE Approach to Cancer Guideline Development J. Clin. Oncol., March 1, 2008; 26(7): 1025 - 1026. [Full Text] [PDF] |
||||
![]() |
V. A. Palda MD MSc, D. Davis MD, and J. Goldman MSc A guide to the Canadian Medical Association Handbook on Clinical Practice Guidelines Can. Med. Assoc. J., November 6, 2007; 177(10): 1221 - 1226. [Full Text] [PDF] |
||||
![]() |
H. J. Schunemann, R. Jaeschke, D. J. Cook, W. F. Bria, A. A. El-Solh, A. Ernst, B. F. Fahy, M. K. Gould, K. L. Horan, J. A. Krishnan, et al. An Official ATS Statement: Grading the Quality of Evidence and Strength of Recommendations in ATS Guidelines and Recommendations Am. J. Respir. Crit. Care Med., September 1, 2006; 174(5): 605 - 614. [Full Text] [PDF] |
||||
![]() |
G. Elwyn, A. O'Connor, D. Stacey, R. Volk, A. Edwards, A. Coulter, R. Thomson, A. Barratt, M. Barry, S. Bernstein, et al. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process BMJ, August 26, 2006; 333(7565): 417. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. G. Logan Dietary Sodium Intake and Its Relation to Human Health: A Summary of the Evidence J. Am. Coll. Nutr., June 1, 2006; 25(3): 165 - 169. [Full Text] [PDF] |
||||
![]() |
K. Uhlig, E. M. Balk, J. Lau, and A. S. Levey Clinical Practice Guidelines in nephrology--for worse or for better Nephrol. Dial. Transplant., May 1, 2006; 21(5): 1145 - 1153. [Full Text] [PDF] |
||||
![]() |
J Zochling, D van der Heijde, R Burgos-Vargas, E Collantes, J C Davis Jr, B Dijkmans, M Dougados, P Geher, R D Inman, M A Khan, et al. ASAS/EULAR recommendations for the management of ankylosing spondylitis Ann Rheum Dis, April 1, 2006; 65(4): 442 - 452. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Guyatt, G. Vist, Y. Falck-Ytter, R. Kunz, N. Magrini, and H. Schunemann An emerging consensus on grading recommendations? Evid. Based Med., February 1, 2006; 11(1): 2 - 4. [Full Text] [PDF] |
||||
![]() |
R. Kunz "What's in the Black Box?" Chest, January 1, 2006; 129(1): 7 - 10. [Full Text] [PDF] |
||||
![]() |
D. Tovey and G. Bognolo Levels of evidence and the orthopaedic surgeon J Bone Joint Surg Br, December 1, 2005; 87-B(12): 1591 - 1592. [Full Text] [PDF] |
||||
![]() |
H. J. Schunemann and J. E. Heffner A New ATS Committee: Competing in the Marketplace of Ideas Am. J. Respir. Cell Mol. Biol., November 1, 2005; 33(5): 423 - 424. [Full Text] [PDF] |
||||
![]() |
H. J. Schunemann and J. E. Heffner A New ATS Committee: Competing in the Marketplace of Ideas Proceedings of the ATS, November 1, 2005; 2(4): 249 - 250. [Full Text] [PDF] |
||||
![]() |
H. J. Schunemann and J. E. Heffner A New ATS Committee: Competing in the Marketplace of Ideas Am. J. Respir. Crit. Care Med., November 1, 2005; 172(9): 1067 - 1068. [Full Text] [PDF] |
||||
![]() |
R. Chou and M. Helfand Challenges in Systematic Reviews That Assess Treatment Harms Ann Intern Med, June 21, 2005; 142(12_Part_2): 1090 - 1099. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Gloviczki Do We Need Evidence-Based Medicine in the Field of Venous Diseases? Perspectives in Vascular Surgery and Endovascular Therapy, June 1, 2004; 16(2): 129 - 133. [PDF] |
||||
![]() |
G. J.M. Tevaarwerk Grading evidence Can. Med. Assoc. J., March 16, 2004; 170(6): 928 - 929. [Full Text] [PDF] |
||||
![]() |
H. J. Schunemann, D. Best, G. Vist, and A. D. Oxman Grading evidence Can. Med. Assoc. J., March 16, 2004; 170(6): 929 - 930. [Full Text] [PDF] |
||||
![]() |
P. Glasziou, J. Vandenbroucke, and I. Chalmers Assessing the quality of research BMJ, January 3, 2004; 328(7430): 39 - 41. [Full Text] [PDF] |
||||
![]() |
R. E.G. Upshur Are all evidence-based practices alike? Problems in the ranking of evidence Can. Med. Assoc. J., September 30, 2003; 169(7): 672 - 673. [Full Text] [PDF] |
||||
Read all eLetters