Skip to main content

Main menu

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 Articles
  • Authors
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
  • CMA Members
    • Overview for members
    • Earn CPD Credits
    • Print copies of CMAJ
  • Subscribers
    • General information
    • View prices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2022
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN

User menu

Search

  • Advanced search
CMAJ
  • CMAJ JOURNALS
    • CMAJ Open
    • CJS
    • JAMC
    • JPN
CMAJ

Advanced Search

  • Home
  • Content
    • Current issue
    • Past issues
    • Early releases
    • Collections
    • Sections
    • Blog
    • Infographics & illustrations
    • Podcasts
    • COVID-19 Articles
  • Authors
    • Overview for authors
    • Submission guidelines
    • Submit a manuscript
    • Forms
    • Editorial process
    • Editorial policies
    • Peer review process
    • Publication fees
    • Reprint requests
    • Open access
  • CMA Members
    • Overview for members
    • Earn CPD Credits
    • Print copies of CMAJ
  • Subscribers
    • General information
    • View prices
  • Alerts
    • Email alerts
    • RSS
  • JAMC
    • À propos
    • Numéro en cours
    • Archives
    • Sections
    • Abonnement
    • Alertes
    • Trousse média 2022
  • Visit CMAJ on Facebook
  • Follow CMAJ on Twitter
  • Follow CMAJ on Pinterest
  • Follow CMAJ on Youtube
  • Follow CMAJ on Instagram
Research Letter

Bias inherent in retrospective waiting-time studies: experience from a vascular surgery waiting list

Boris Sobolev, Peter Brown, David Zelt and Samuel Shortt
CMAJ June 27, 2000 162 (13) 1821-1822;
Boris Sobolev
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter Brown
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Zelt
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Samuel Shortt
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Responses
  • Metrics
  • PDF
Loading

In the absence of waiting-time registries, administrative health care databases are often used to study how long it takes to receive medical services.[1, 2] In these studies waiting time is ascertained retrospectively, from the date of service to some preceding moment.

In waiting-time analysis, however, retrospective and prospective approaches to data collection do not yield the same information. In retrospective design, the sampling unit is "patient received service." In prospective design, where waiting is evaluated in a cohort of patients added to a waiting list and followed forward in time, the sampling unit is "patient added to the list."

If every wait ended in the receipt of the service, the 2 designs would generate equivalent data. However, for a variety of reasons, some patients are removed from waiting lists without receiving the service.3 Any patient removed from the list before receiving the service would not be sampled in a retrospective study. In a prospective study an observation for a patient removed from the list without access to the service is considered "right censored," which indicates that the waiting time for that patient was less than it otherwise would have been.

If the "censored" observations are not accounted for, as in a retrospective design, the estimated probabilities of receiving the service may be biased toward a higher rate, and the median and mean waiting time may be underestimated.

To assess the magnitude of this bias, we used data for surgical waiting times collected prospectively at an acute care hospital in Ontario. We conducted waiting-time analysis in 2 ways: first, with data for all patients, as would be done in a prospective study, and then, with data only for those who actually underwent the surgery, as would be done in a retrospective study.

All patients accepted for elective vascular surgery in the Department of Surgery, Queen's University, Kingston, Ont., between 1994 and 1998, were eligible for the study. The surgical procedures included repair of abdominal aortic aneurysm, carotid endarterectomy, peripheral vascular bypass surgery and other surgery involving blood supply to the legs. The follow-up period ended 6 months after the last patients were added to the waiting list. Of 1084 consecutive cases, 985 patients received surgery, 14 were still waiting at the end of the follow-up period, and 85 were removed from the list without surgery for a variety of reasons: the patient's condition improved (19 patients), death occurred while the patient was awaiting surgery (3), the surgical risk became too great (38), or the patient decided against surgery (25).

To calculate the mean number of admissions from the list per week (i.e., the admission rate) we divided the total number of admissions by the total number of patient-weeks for the list. The probability of receiving surgery as a function of waiting time was estimated by the product-limit method.4

Fig. 1 shows the estimated probabilities of receiving surgery with data for the patients who had surgery (retrospective design) and for all patients added to the list (prospective design). The difference between these estimates, as measured by the log-rank test, was statistically significant (p < 0.001). As expected, the retrospective analysis produced estimates of the probability of undergoing surgery that were biased upward and underestimated the median waiting time. For this analysis, the mean weekly admission rate was 11.6 (95% confidence interval [CI] 10.9-12.3) per 100 patients, and the median time to admission was 6 (95% CI 5-6) weeks. In contrast, for the prospective design, the mean weekly admission rate was 9.8 (95% CI 9.5-10.1) per 100 patients, and the median time to admission was 7 (95% CI 6-7) weeks. These differences were statistically significant (p < 0.001). The mean (and standard error) time to admission was 8.6 (0.3) for the retrospective design and 10.2 (0.3) for the prospective design.

Figure
  • Download figure
  • Open in new tab
  • Download powerpoint

Fig. 1: Estimated probability of undergoing surgery as a function of waiting time. Data for a single group of patients awaiting vascular surgery were analysed according to a retrospective and a prospective design.

In other time-to-event studies, it has been suggested that retrospective design can lead to serious problems with inferences.5 Retrospective designs can similarly bias the results of studies of waiting times. For instance, coexisting illnesses could cause delay in surgery in a subpopulation and have no effect on the other patients in the cohort. If sicker patients are routinely removed from the waiting list before surgery, the impact of comorbid conditions might be missed by such a design.

Partial salary support for Dr. Sobolev came from the Institute for Clinical Evaluative Sciences, Toronto.

Competing interests: None declared.

Acknowledgments

A special issue of Clinical and Investigative Medicine

February 2000 • Vol. 23, No. 1

Extensive changes in the curricula of Canada's 16 medical schools in recent years have had a notable impact on non-clinical teaching. In response to growing concern that physicians of the future may no longer be receiving adequate grounding in the science of medicine, close to 40 faculty representing basic science and clinical departments, and deans of undergraduate medical education met in Hamilton, Ont., May 21-23, 1999, to discuss these key issues. FIGURE

Figure

Figure.

\#10070; What understanding of basic science is required by MD graduates?

\#10070; Who should be responsible that this material is learned?

\#10070; What organization is required within a faculty of medicine/health sciences to support the basic science component?

\#10070; Should basic science be an explicit component of the Medical Council of Canada examinations?

This special issue of Clinical and Investigative Medicine includes 20 presentations from the workshop and an edited transcript of the discussions. It is also available online.

Member Service Centre; Canadian Medical Association; Tel: 888 855-2555; Fax: 613 236-8864; cmamsc{at}cma.ca; Price: US$30; (includes shipping and handling)

www.cma.ca/cim

Footnotes

  • This article has been peer reviewed.

    Reprint requests to: Dr. Boris Sobolev, Queen's Health Policy, 3rd floor Abramsky Hall, Kingston ON K7L 3N6; fax 613 533-6353; bs9@post.queensu.ca

References

  1. 1.↵
    DeCoster C, Carrière KC, Peterson S, Walld R, MacWilliam L. Waiting times for surgical procedures. Med Care 1999;37(6 Suppl):JS187-205.
  2. 2.↵
    Mackillop WJ, Groome PA, Zhang-Solomons J, Zhou Y, Feldman-Stewart D, Paszat L, et al. Does a centralized radiotherapy system provide adequate access to care? J Clin Oncol 1997;15:1261-71.
    OpenUrlAbstract/FREE Full Text
  3. 3.↵
    Lee A, Don B, Goldacre MJ. Waiting list statistics. II: An estimate of inflation of waiting list length. BMJ (Clin Res Ed) 1987;295(6607):1197-8.
  4. 4.↵
    Hosmer DW, Lemeshow S. Descriptive methods for survival data. In: Applied survival analysis: regression modeling of time to event data. New York: John Wiley & Sons; 1998; p. 27-86.
  5. 5.↵
    Weinberg CR, Baird DD, Rowland AS. Pitfalls inherent in retrospective time-to-event studies: the example of time to pregnancy. Stat Med 1993;12(9):867-79.
    OpenUrlPubMed
PreviousNext
Back to top

In this issue

CMAJ
Vol. 162, Issue 13
27 Jun 2000
  • Table of Contents
  • Index by author

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on CMAJ.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Bias inherent in retrospective waiting-time studies: experience from a vascular surgery waiting list
(Your Name) has sent you a message from CMAJ
(Your Name) thought you would like to see the CMAJ web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Bias inherent in retrospective waiting-time studies: experience from a vascular surgery waiting list
Boris Sobolev, Peter Brown, David Zelt, Samuel Shortt
CMAJ Jun 2000, 162 (13) 1821-1822;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
‍ Request Permissions
Share
Bias inherent in retrospective waiting-time studies: experience from a vascular surgery waiting list
Boris Sobolev, Peter Brown, David Zelt, Samuel Shortt
CMAJ Jun 2000, 162 (13) 1821-1822;
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Jump to section

  • Article
    • Acknowledgments
    • Footnotes
    • References
  • Figures & Tables
  • Responses
  • Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Do administrative databases accurately measure waiting times for medical care? Evidence from general surgery
  • Monitoring trends in waiting periods in Canada for elective surgery: validation of a method using administrative data
  • Risk of emergency admission while awaiting elective cholecystectomy
  • Equity in Canadian health care: Does socioeconomic status affect waiting times for elective surgery?
  • Potential for bias in waiting time studies: events between enrolment and admission
  • Calculating waiting times retrospectively
  • Calculating waiting times retrospectively
  • Google Scholar

More in this TOC Section

  • Neonatal exposure to active pulmonary tuberculosis in a health care professional
  • How should abridged scientific articles be presented in journals? A survey of readers and authors
  • Predictive value of a self-reported history of varicella infection in determining immunity in adults
Show more Research letter

Similar Articles

Collections

  • Topics
    • Patient safety & quality improvement
    • Research methods & statistics
    • Vascular surgery

 

View Latest Classified Ads

Content

  • Current issue
  • Past issues
  • Collections
  • Sections
  • Blog
  • Podcasts
  • Alerts
  • RSS
  • Early releases

Information for

  • Advertisers
  • Authors
  • Reviewers
  • CMA Members
  • Media
  • Reprint requests
  • Subscribers

About

  • General Information
  • Journal staff
  • Editorial Board
  • Advisory Panels
  • Governance Council
  • Journal Oversight
  • Careers
  • Contact
  • Copyright and Permissions
  • Accessibiity
  • CMA Civility Standards
CMAJ Group

Copyright 2022, CMA Impact Inc. or its licensors. All rights reserved. ISSN 1488-2329 (e) 0820-3946 (p)

All editorial matter in CMAJ represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.

To receive any of these resources in an accessible format, please contact us at CMAJ Group, 500-1410 Blair Towers Place, Ottawa ON, K1J 9B9; p: 1-888-855-2555; e: cmajgroup@cmaj.ca

Powered by HighWire