This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kalant, N.
Right arrow Articles by Marcotte, F.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kalant, N.
Right arrow Articles by Marcotte, F.
Related Collections
Right arrow Ischemic heart disease
Right arrow Quality improvement
CMAJ • June 27, 2000; 162 (13)
© 2000 Canadian Medical Association or its licensors

Research
Recherche

How valid are utilization review tools in assessing appropriate use of acute care beds?

Norman Kalant*, Marc Berlinguet{ddagger}, Jean G. Diodati*{dagger}, Leonidas Dragatakis*{dagger} and François Marcotte*{dagger}

From *the Department of Medicine and {dagger}the Division of Cardiology, Sir Mortimer B. Davis - Jewish General Hospital, Montreal, Que., and {ddagger}the Ministère de la Santé et des Services Sociaux du Québec, Quebec City, Que.

Background: Despite their widespread acceptance, utilization review tools, which were designed to assess the appropriateness of care in acute care hospitals, have not been well validated in Canada. The aim of this study was to assess the validity of 3 such tools - ISD (Intensity of service, Severity of illness, Discharge screens), AEP (Appropriateness Evaluation Protocol) and MCAP (Managed Care Appropriateness Protocol) - as determined by their agreement with the clinical judgement of a panel of experts.

Methods: The cases of 75 patients admitted to an acute cardiology service were reviewed retrospectively. The criteria of each utilization review tool were applied by trained reviewers to each day the patients spent in hospital. An abstract of each case prepared in a day-by-day format was evaluated independently by 3 cardiologists, using clinical judgement to decide the appropriateness of each day spent in hospital.

Results: The panel considered 92% of the admissions and 67% of the subsequent hospital days to be appropriate. The ISD underestimated the appropriateness rates of admission and subsequent days; the AEP and MCAP overestimated the appropriateness rate of subsequent days in hospital. The kappa statistic of overall agreement between tool and panel was 0.45 for ISD, 0.24 for MCAP and 0.25 for AEP, indicating poor to fair validity of the tools.

Interpretation: Published validation studies had average kappa values of 0.32-0.44 (i.e., poor to fair) for admission days and for subsequent days in hospital for the 3 tools. The tools have only a low level of validity when compared with a panel of experts, which raises serious doubts about their usefulness for utilization review.




This article has been cited by other articles:


Home page
 Int J Qual Health CareHome page
R. Guile, C. Leux, C. Paille, P. Lombrail, and L. Moret
Validation of a tool assessing appropriateness of hospital days in rehabilitation centres
Int. J. Qual. Health Care, June 1, 2009; 21(3): 198 - 205.
[Abstract] [Full Text] [PDF]

Home page
 Age AgeingHome page
B. Walsh, H. C. Roberts, P. G. Nicholls, and V. A Lattimer
Trends in hospital inpatient episodes for signs, symptoms and ill-defined conditions: observational study of older people's hospital episodes in England, 1995-2003
Age Ageing, July 1, 2008; 37(4): 455 - 458.
[Full Text] [PDF]

Home page
 PediatricsHome page
S. Mahant, R. Peterson, M. Campbell, D. L. MacGregor, and J. N. Friedman
Reducing Inappropriate Hospital Use on a General Pediatric Inpatient Unit
Pediatrics, May 1, 2008; 121(5): e1068 - e1073.
[Abstract] [Full Text] [PDF]

Home page
 AJPHHome page
S. A. Ibrahim, C. K. Kwoh, and E. Krishnan
Factors Associated With Patients Who Leave Acute-Care Hospitals Against Medical Advice
Am J Public Health, December 1, 2007; 97(12): 2204 - 2208.
[Abstract] [Full Text] [PDF]

Home page
 Age AgeingHome page
C. Luthy, C. Cedraschi, F. Herrmann, M. Kossovsky, E. Perrin, P. Chopard, J.-P. Michel, and A.-F. Allaz
Appropriateness of hospital use: comparison between elderly patients' point of view and a structured questionnaire
Age Ageing, November 1, 2007; 36(6): 681 - 684.
[Full Text] [PDF]

Home page
 BMJHome page
A. Alijani, G. B Hanna, D. Ziyaie, S. L Burns, K. L Campbell, M. E T McMurdo, and A. Cuschieri
Instrument for objective assessment of appropriateness of surgical bed occupancy: validation study
BMJ, June 5, 2003; 326(7401): 1243 - 1244.
[Full Text] [PDF]

Home page
 CMAJHome page
R. Saitz
Discharges against medical advice: time to address the causes
Can. Med. Assoc. J., September 1, 2002; 167(6): 647 - 648.
[Full Text] [PDF]

Home page
 CMAJHome page
N. Kalant
Validity of utilization review tools
Can. Med. Assoc. J., November 1, 2000; 163(10): 1239 - 1242.
[Full Text]

Home page
 CMAJHome page
J. V. Tu
Utilization review: Can it be improved?
Can. Med. Assoc. J., June 1, 2000; 162(13): 1824 - 1825.
[Full Text] [PDF]