Skip to main content

Main menu

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 Articles
    • Obituary notices
  • Authors & Reviewers
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
    • Patient engagement
  • Members & Subscribers
    • Benefits for CMA Members
    • CPD Credits for Members
    • Subscribe to CMAJ Print
    • Subscription Prices
    • Obituary notices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2023
    • Avis de décès
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN

User menu

Search

  • Advanced search
CMAJ
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN
CMAJ

Advanced Search

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 Articles
    • Obituary notices
  • Authors & Reviewers
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
    • Patient engagement
  • Members & Subscribers
    • Benefits for CMA Members
    • CPD Credits for Members
    • Subscribe to CMAJ Print
    • Subscription Prices
    • Obituary notices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2023
    • Avis de décès
  • Visit CMAJ on Facebook
  • Follow CMAJ on Twitter
  • Follow CMAJ on Pinterest
  • Follow CMAJ on Youtube
  • Follow CMAJ on Instagram
Research

Comparing methods to calculate hospital-specific rates of early death or urgent readmission

Carl van Walraven, Jenna Wong, Steven Hawken and Alan J. Forster
CMAJ October 16, 2012 184 (15) E810-E817; DOI: https://doi.org/10.1503/cmaj.120801
Carl van Walraven
From the Faculty of Medicine (van Walraven, Forster), University of Ottawa; the Clinical Epidemiology Program (van Walraven, Wong, Hawken, Forster), Ottawa Hospital Research Institute, Ottawa, Ont.; and the Institute for Clinical Evaluative Sciences (van Walraven, Wong, Hawken, Forster), Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: carlv@ohri.ca
Jenna Wong
From the Faculty of Medicine (van Walraven, Forster), University of Ottawa; the Clinical Epidemiology Program (van Walraven, Wong, Hawken, Forster), Ottawa Hospital Research Institute, Ottawa, Ont.; and the Institute for Clinical Evaluative Sciences (van Walraven, Wong, Hawken, Forster), Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Steven Hawken
From the Faculty of Medicine (van Walraven, Forster), University of Ottawa; the Clinical Epidemiology Program (van Walraven, Wong, Hawken, Forster), Ottawa Hospital Research Institute, Ottawa, Ont.; and the Institute for Clinical Evaluative Sciences (van Walraven, Wong, Hawken, Forster), Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alan J. Forster
From the Faculty of Medicine (van Walraven, Forster), University of Ottawa; the Clinical Epidemiology Program (van Walraven, Wong, Hawken, Forster), Ottawa Hospital Research Institute, Ottawa, Ont.; and the Institute for Clinical Evaluative Sciences (van Walraven, Wong, Hawken, Forster), Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Related Content
  • Responses
  • Metrics
  • PDF
Loading

Article Figures & Tables

Figures

  • Tables
  • Figure 1:
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 1:

    Comparison of values for observed-to-expected ratios for death or urgent readmission within 30 days determined for 162 hospitals using 4 different methods of calculation. The Spearman correlation coefficient is presented in the top left corner of each plot. The panels are aligned as rows and columns by categories.

  • Figure 2:
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 2:

    Comparison of hospital rankings determined using 4 different methods of calculating observed-to-expected ratios for death or urgent readmission within 30 days for the 162 hospitals included in the study. The Spearman correlation coefficient is presented in the top left corner of each plot. The panels are aligned as rows and columns by categories.

Tables

  • Figures
    • View popup
    Table 1:

    Characteristics of hospitals included in the study

    Characteristic per hospitalHospital-specific average
    Median (IQR)*MinimumMaximum
    Hospital volume
    Annual no. of discharges1142.8 (427.8–5192.3)69.024 341.8
    Patients
    Age, yr, mean63.5 (60.9–67.0)19.875.4
    Male sex, %46.8 (45.2–48.4)33.769.0
    Charlson Comorbidity Index score14 ≥ 1, %34.4 (29.3–39.8)10.562.6
    Visits to emergency department in previous 6 mo, %55.4 (46.5–63.9)19.876.8
    Elective admissions in previous yr, %9.4 (8.4–11.3)5.635.3
    Emergent admissions in previous yr, %32.1 (27.0–37.7)12.950.1
    Admissions
    Emergent, %82.4 (70.2–90.0)19.498.8
    Length of stay, d, mean6.0 (5.4–7.2)2.416.9
    Admissions with any alternate level of care, %2.2 (1.4–3.6)0.038.7
    Admissions with case-mix group score‡ > 0, %28.0 (20.7–33.2)2.945.5
    LACE+§ score, mean49.0 (43.8–54.6)18.263.1
    Outcomes following discharge
    Death or urgent readmission within 30 d, %13.2 (11.0–15.4)4.620.0
    Death within 30 d, %1.9 (1.5–2.4)0.24.3
    Urgent readmission within 30 d, %12.2 (10.2–14.1)4.119.3
    • Note: IQR = interquartile range.

    • ↵* The values are medians of percentages or means for each hospital.

    • ↵‡ Risk of death within 30 days or unplanned readmission, independent of factors known to influence this outcome;15 higher scores indicate higher risk.

    • ↵§ Risk of death within 30 days or unplanned readmission;11 higher scores indicate higher risk.

    • View popup
    Table 2:

    Observed-to-expected ratios for death or urgent readmission within 30 days for the 162 hospitals included in the study, calculated using 4 different measures*

    MeasureObserved-to- expected ratio, mean ± SDObserved-to- expected ratio, median (range)
    All admissions, adjusted for patient age and sex1.11 ± 0.211.10 (0.45–1.77)
    Single admission per patient, adjusted for patient age and sex1.14 ± 0.231.13 (0.44–1.83)
    All admissions, adjusted for all measurable factors0.94 ± 0.110.93 (0.71–1.39)
    Single admission per patient, adjusted for all measurable factors0.94 ± 0.120.94 (0.63–1.40)
    • Note: SD = standard deviation.

    • ↵* The number of expected events was calculated by use of logistic regression models. Age- and sex-adjusted ratios calculated the expected number of events after adjustment for patient age and sex; completely adjusted ratios used the LACE+ model to determine the expected numbers of events.

    • View popup
    Table 3:

    Variation in hospital-specific observed-to-expected ratios for death or urgent readmission within 30 days and their associated rankings

    VariationStandardized ranges* for observed-to-expected ratios (%)Hospital rankings based on observed-to-expected ratios†
    Mean ± SDMedian (IQR)MinimumMaximumMean ± SDMedian (IQR)MinimumMaximum
    Among measures within specific years
    200532.5 ± 22.828 (18–42)723243.3 ± 30.035 (20–61)0143
    200630.0 ± 18.729 (14–44)29652.5 ± 32.949 (26–74)0136
    200731.8 ± 23.428 (14–41)215754.4 ± 33.348 (30–75)3159
    200830.5 ± 18.728 (15–42)38050.8 ± 32.045.5 (28–68)2145
    200931.9 ± 22.828 (17–41)421249.5 ± 31.842.5 (26–70)0151
    201032.0 ± 23.827 (15–42)114147.9 ± 32.843 (23–68)1151
    All years31.5 ± 21.828 (16–42)123247.4 ± 32.243.5 (23–66)2148
    Among years within specific measures
    Age-, sex-adjusted, all admissions27.5 ± 19.722 (15–35)415445.2 ± 31.438 (22–62)1155
    Age-, sex-adjusted, single admission/patient49.8 ± 35.343 (26–66)827361.0 ± 38.751.5 (31–81)1161
    Complete adjustment, all admissions26.0 ± 18.421 (14–33)313162.8 ± 37.057 (34–87)4161
    Complete adjustment, single admission/patient47.8 ± 37.038 (24–59)728875.8 ± 40.272 (44–103)3161
    • Note: IQR = interquartile range, SD = standard deviation.

    • ↵* Range in observed-to-expected ratios for readmission within each hospital as a percentage of the overall readmission ratio for that hospital. The overall ratio was calculated using a fixed-effects model that weighted observations by each ratio’s variance, which were calculated using Byar’s approximation.14

    • ↵† The maximum range in rankings is 162 (i.e., the total number of hospitals included in the study).

    • View popup
    Table 4:

    Comparison of hospital rankings using different measures of death or urgent readmission within 30 days

    Method 1Method 2RankingWeighted κ† (95% CI)
    Agreement among measures*Disagreement among measures (%), n = 162
    Top 10%, n = 16Middle 80%, n = 130Bottom 10%, n = 16
    Age-, sex-adjusted, all admissionsAge-, sex-adjusted, single admission/ patient131251312 (7.4)0.79 (0.64–0.94)
    Complete adjustment, all admissions61151130 (18.5)0.62 (0.43–0.80)
    Complete adjustment, single admission/patient6114934 (21.0)0.49 (0.29–0.69)
    Age-, sex-adjusted, single admission/patientComplete adjustment, all admissions7113834 (21.0)0.44 (0.23–0.64)
    Complete adjustment, single admission/patient71151030 (18.5)0.56 (0.37–0.75)
    Complete adjustment, all admissionsComplete adjustment, single admission/patient9117927 (16.7)0.51 (0.31–0.71)
    • Note: CI = confidence interval.

    • ↵* Determined for ranking categories (top 10%, middle 80% and bottom 10%) and the proportion of hospitals having different categorizations using the 2 methods.

    • ↵† Presents the agreement beyond that expected by chance, taking into account the degree of disagreement between the measures.

PreviousNext
Back to top

In this issue

Canadian Medical Association Journal: 184 (15)
CMAJ
Vol. 184, Issue 15
16 Oct 2012
  • Table of Contents
  • Index by author

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on CMAJ.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Comparing methods to calculate hospital-specific rates of early death or urgent readmission
(Your Name) has sent you a message from CMAJ
(Your Name) thought you would like to see the CMAJ web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Comparing methods to calculate hospital-specific rates of early death or urgent readmission
Carl van Walraven, Jenna Wong, Steven Hawken, Alan J. Forster
CMAJ Oct 2012, 184 (15) E810-E817; DOI: 10.1503/cmaj.120801

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
‍ Request Permissions
Share
Comparing methods to calculate hospital-specific rates of early death or urgent readmission
Carl van Walraven, Jenna Wong, Steven Hawken, Alan J. Forster
CMAJ Oct 2012, 184 (15) E810-E817; DOI: 10.1503/cmaj.120801
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Jump to section

  • Article
    • Abstract
    • Methods
    • Results
    • Interpretation
    • Acknowledgement
    • Footnotes
    • References
  • Figures & Tables
  • Related Content
  • Responses
  • Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Physician experience and outcomes among patients admitted to general internal medicine teaching wards
  • Safely and effectively reducing inpatient length of stay: a controlled study of the General Internal Medicine Care Transformation Initiative
  • Google Scholar

More in this TOC Section

  • Development and validation of a hospital frailty risk measure using Canadian clinical administrative data
  • The effect of changing screening practices and demographics on the incidence of gestational diabetes in British Columbia, 2005–2019
  • Self-reported sleep disturbances among people who have had a stroke: a cross-sectional analysis
Show more Research

Similar Articles

Collections

  • Topics
    • Research methods & statistics

 

View Latest Classified Ads

Content

  • Current issue
  • Past issues
  • Collections
  • Sections
  • Blog
  • Podcasts
  • Alerts
  • RSS
  • Early releases

Information for

  • Advertisers
  • Authors
  • Reviewers
  • CMA Members
  • CPD credits
  • Media
  • Reprint requests
  • Subscribers

About

  • General Information
  • Journal staff
  • Editorial Board
  • Advisory Panels
  • Governance Council
  • Journal Oversight
  • Careers
  • Contact
  • Copyright and Permissions
  • Accessibiity
  • CMA Civility Standards
CMAJ Group

Copyright 2023, CMA Impact Inc. or its licensors. All rights reserved. ISSN 1488-2329 (e) 0820-3946 (p)

All editorial matter in CMAJ represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.

To receive any of these resources in an accessible format, please contact us at CMAJ Group, 500-1410 Blair Towers Place, Ottawa ON, K1J 9B9; p: 1-888-855-2555; e: cmajgroup@cmaj.ca

Powered by HighWire