Abstract
Background: Adverse drug-related events are common in the elderly, and inappropriate prescribing is a preventable risk factor. Our objective was to determine whether inappropriate prescribing could be reduced when primary care physicians had computer-based access to information on all prescriptions dispensed and automated alerts for potential prescribing problems.
Methods: We randomly assigned 107 primary care physicians with at least 100 patients aged 66 years and older (total 12 560) to a group receiving computerized decision-making support (CDS) or a control group. Physicians in the CDS group had access to information on current and past prescriptions through a dedicated computer link to the provincial seniors' drug-insurance program. When any of 159 clinically relevant prescribing problems were identified by the CDS software, the physician received an alert that identified the nature of the problem, possible consequences and alternative therapy. The rate of initiation and discontinuation of potentially inappropriate prescriptions was assessed over a 13-month period.
Results: In the 2 months before the study, 31.8% of the patients in the CDS group and 33.3% of those in the control group had at least 1 potentially inappropriate prescription. During the study the number of new potentially inappropriate prescriptions per 1000 visits was significantly lower (18%) in the CDS group than in the control group (relative rate [RR] 0.82, 95% confidence interval [CI] 0.69–0.98), but differences between the groups in the rate of discontinuation of potentially inappropriate prescriptions were significant only for therapeutic duplication by the study physician and another physician (RR 1.66, 95% CI 0.99–2.79) and drug interactions caused by prescriptions written by the study physician (RR 2.15, 95% CI 0.98–4.70).
Interpretation: Computer-based access to complete drug profiles and alerts about potential prescribing problems reduces the rate of initiation of potentially inappropriate prescriptions but has a more selective effect on the discontinuation of such prescriptions.
Drug-related adverse events are reported to be the sixth leading cause of death1,2 and contribute to substantial morbidity, particularly in the elderly.2,3,4,5,6,7,8,9 Inappropriate prescribing has been identified as a preventable cause of at least 20% of drug-related adverse events.10,11,12,13,14,15,16 Elderly patients are at greatest risk of receiving inappropriate prescriptions.17 Because primary care physicians write approximately 80% of prescriptions for people 65 years of age and older,18 effective interventions to optimize prescribing in primary care are a priority.
Computerized decision-making support (CDS) for drug management may be an effective method of reducing inappropriate prescribing. Automated surveillance of a patient's drug and disease profile can alert a physician to potentially problematic prescriptions when treatment decisions are being made. There is evidence that CDS in hospital can reduce the incidence of drug-related adverse events,19,20,21,22 improve the cost-effectiveness of drug selection23,24,25,26,27 and optimize drug–dose calculations.28,29,30,31,32
Evaluation of CDS for prescription drug management in primary care settings has been limited.20 One of the challenges in community-based practice is that there is no central pharmacy to track all drugs prescribed. This is a substantial problem because 40% of elderly patients use more than 1 pharmacy, and 70% have more than 1 prescribing physician.18 In this study we assessed whether inappropriate prescribing would be reduced when primary care physicians had access to information on all prescriptions dispensed to their elderly patients.
Methods
Context
The study was conducted in Quebec, where a universal health insurance program provides complete coverage of medical and hospital services for all residents, as well as comprehensive drug insurance for the elderly. Beneficiary, medical-service and prescription-claims databases maintained by the Régie de l'assurance maladie du Québec (RAMQ)33 and previously validated34 were used to assemble the eligible study population, provide information on prescriptions dispensed, and evaluate the use of both medical services and drugs before and after the implementation of CDS.
Study design and participants
To test whether CDS would reduce inappropriate prescribing, we conducted a 13-month cluster-randomized controlled trial between January 1997 and February 1998. Sample size was estimated for the cluster trial35 with a relative reduction in inappropriate prescribing of 30%, type 1 and 2 errors of 1% and 20% respectively and estimates of variation in rates among patients and among physicians.36 The Collège des medicines du Québec used annual licensure-renewal data to identify eligible physicians: general practitioners 30 years of age or older who had practices in Montreal, spent at least 70% of the week in private fee-for-service practice and had a minimum of 100 elderly patients. Letters of invitation and information sessions were used to recruit physicians. To minimize the possibility of contamination, only 1 physician per group practice was included. Differences in characteristics and prescribing habits of participating and non-participating physicians were assessed with the use of non-identifiable data from the Collège and the RAMQ prescription-claims files.
Patients of participating physicians were eligible if they were 66 years of age or older, had been seen on 2 or more occasions by the study physician in the past year, and were living in the community at the start of the study. The RAMQ provided a list of eligible patients to each physician and a total count of patients per practice to the investigators. With the consent of the patient, personal information was provided to the RAMQ and the researchers.
Randomization and blinding
Physicians were stratified by age (3 categories), sex, language (French, English), location of medical school of graduation (foreign, Canada or the United States) and number of elderly patients (less than 118, 118 or more).
Two months before CDS was implemented, after more than 90% of patients had been recruited, half of the physicians within each stratum were randomly assigned to the CDS group and the other half to the control group. Physicians and patients were not told the specific outcomes of the study but were aware of which group they had been assigned to.
Basic intervention
Each physician was given a computer, a printer, health-record software and dial-up access to the Internet. The health-record software documented health problems and medications prescribed. For each patient, trained personnel developed a health-problem list by abstracting, coding and entering data from the primary care physician's chart, using a standardized form that documented the 26 health problems related to the targeted drug–disease contraindications, as well as other chronic health problems. Concordance in identification of key target problems between the chief abstractor and the abstraction team was 86.1% (κ = 0.56) in independent audits of a systematic sample of 1138 charts.
CDS group
Physicians in the CDS group obtained information on each patient by downloading updates of dispensed prescriptions from the RAMQ drug-insurance program. All retail pharmacies have a data link to the RAMQ for online prescription adjudication, which provided a daily update of all prescriptions dispensed for each patient. These data were integrated into the patient's health record and categorized as having been prescribed by the study physician or by another physician. Alerts were instituted to identify 159 clinically relevant prescribing problems in the elderly, a list established previously by expert consensus:37 26 problems were related to drug–disease contraindications, 23 to drug interactions, 17 to drug–age contraindications, 3 to duration of therapy and 90 to therapeutic duplication. The alerts appeared when the electronic chart was opened, when prescription-record updates were downloaded from the RAMQ, and when current health problems and prescriptions were recorded by the physician in the chart. Each alert message identified the nature of the problem and possible consequences and suggested alternative therapy in accordance with the expert consensus.
Outcomes
The primary outcome measures were initiation and discontinuation rates of the 159 prescription-related problems. Records of prescriptions dispensed and medical visits (from the RAMQ prescription-claims and medical-service-claims files and from the abstracted office-chart data) were used to assess outcomes to ensure that the same measures were used for the 2 groups of physicians. Discontinuation rates were calculated for patients who had been given at least 1 inappropriate prescription in the 2 months before the study began. An inappropriate prescription was considered to have been discontinued by the study physician if it had not been refilled within 2 months after the prescription end date and if there had been a visit to the study physician before or during the month of the prescription end date. Initiation rates were calculated for the remaining patients from the prescriptions written by the study physician for 1 or more of the 159 prescription-related problems during the 13-month study period. The denominator for each rate, measured by medical-service claims, was the number of patient visits to the study physician during the study period; this number provided an accurate assessment of differences in opportunity to initiate or discontinue inappropriate prescriptions. Follow-up was terminated after an inappropriate prescription had been initiated or discontinued. Secondary outcomes were initiation and discontinuation rates by type of prescribing problem and discontinuation rates by source of prescription.
Analysis
Descriptive statistics were used to summarize the characteristics of the physicians and patients in the 2 groups. The association between the weekly frequency of prescription downloads and the number of weeks of computer problems was estimated with Pearson correlation. Poisson regression, within the framework of a generalized estimating equation, was used to determine if there were differences between the 2 groups of physicians in the rates of initiation and discontinuation of inappropriate prescriptions, based on an intention-to-treat analysis.38,39 The patient was the unit of analysis. Physicians were identified as the clustering factor within which rates were examined, and an exchangeable correlation structure was used to take into account the dependence of observations for patients of the same physician. Empirical standard errors were used to take into account the overdispersion in estimated rates.
Results
Of the 440 eligible physicians, 127 (28.9%) agreed to participate, and the first 107 were included in the study (Fig. 1). Participating physicians were slightly younger than those who did not participate (mean age 46.5 v. 49.4 years). However, participating and nonparticipating physicians were similar in the average number of prescriptions per elderly patient (35.6 v. 33.8) and the prevalence of inappropriate prescribing (18.9% v. 18.8%) in the 18 months before the study start date. There were no differences in characteristics between the CDS and control groups (Table 1).
Of the 20 109 eligible patients, 12 560 (62.4%) agreed to participate. Those in the CDS group were more likely than those in the control group to be men, to have made fewer visits to their primary care physician and to have received fewer prescriptions from their primary care physician (Table 1).
At the beginning of the study, there was at least 1 prescribing problem for 33.3% of the patients in the control group and 31.8% of those in the CDS group (Table 2). For 20.4% and 18.8%, respectively, the problems were attributable to a study physician, for 3.3% and 3.2% they were attributable to a study physician plus another physician, and for 8.3% and 9.1% they were attributable to another physician. In both groups, drug–disease contraindications were the most common prescribing problems, followed by drug–age contraindications and excessive duration of therapy (Table 2).
Two unforeseen factors influenced the effectiveness of the CDS. First, copayments for prescription drugs were increased when the study began, which resulted in a 9% reduction in prescription drug use by the elderly.40 Second, 22% of the physicians experienced frequent hardware or software failure in the early months of the study; the proportion declined to 4% by month 6. Physicians in the CDS group downloaded prescription information in 81% of the study weeks; however, those who had more computer problems downloaded information less often (r = –0.31).
During the study, the rate of initiation of an inappropriate prescription was significantly lower (18%) in the CDS group than in the control group (Table 3). This trend was evident for drug–disease contraindications, drug–age contraindications, excessive duration of therapy and therapeutic duplication and was significant for drug–age contraindications and excessive duration of therapy.
CDS had no significant impact on the discontinuation of pre-existing inappropriate prescriptions (Table 4). Although more patients in the CDS group than in the control group had all inappropriate prescriptions discontinued (47.5% v. 44.5%; or 35.5 v. 32.1 per 1000 visits; relative rate [RR] 1.14; 95% confidence interval [CI] 0.98–1.33), the 14% difference was not statistically significant. The only substantially higher discontinuation rate for a specific prescribing problem was for drug interactions: 68.6 v. 51.5 per 1000 visits in the CDS and control groups respectively.
Physicians in the CDS group were able to identify excessive duration of therapy, therapeutic duplication and drug interaction resulting from more than one source of prescribing for the same patient. Most of the therapeutic duplications and drug interactions occurred because prescriptions were written by both the study physician and another physician or another physician alone (Table 5). Discontinuation rates in the CDS group were systematically higher for problems created by the combination of prescriptions from study physicians and other physicians than for the other types of prescription problems. An exception was with drug interactions: the relative difference in discontinuation rates between CDS and control physicians was highest for problematic prescriptions written by the study physician, followed by problematic prescriptions written by both the study physician and another physician.
Adjusting for patient characteristics (Table 1) did not modify differences in initiation and discontinuation rates between the CDS and control groups. However, a physician's previous computer experience influenced the effectiveness of CDS. Among experienced computer users the rate of initiation of inappropriate prescriptions was 30% lower in the CDS group than in the control group (RR 0.70, 95% CI 0.55–0.89). Among the computer beginners the rate of initiation of inappropriate prescriptions was virtually identical in the 2 groups (RR 1.03, 95% CI 0.82–1.29). The same trend was evident for discontinuation rates (RR for experienced users 1.17 and for beginners 0.93), but this apparent modification of the effectiveness of CDS by computer experience was not significant (interaction term: study group*computer experience, p = 0.32).
Interpretation
This study illustrated the magnitude of the challenge of coordinating health care for elderly patients in an urban setting. Primary care physicians provided only half of all medical services to their elderly patients, who, on average, received prescriptions from at least 3 other physicians and filled those prescriptions at several pharmacies. We addressed the problem of incomplete information on current drug use by using existing prescription-claims information to provide a complete drug profile for each patient. This was a lower-cost solution than using pharmacy-information networks41,42 or smart cards.43
The study also addressed one of the chief criticisms of software screening for drug interactions: clinical relevance.44 We limited alerts to interactions judged by a consensus panel to produce clinically important adverse effects, and we expanded surveillance to include clinically relevant drug–disease contraindications, drug–age contraindications, excessive duration of therapy and therapeutic duplication.37 The alert system was limited, however, by the absence of treatment indications (needed to assess prescription appropriateness) and the absence of weight, height and data on renal function (needed to assess dosage appropriateness). Further, because lower levels of evidence are used to identify potentially problematic prescriptions, the effect of reducing inappropriate prescribing on health outcome remains unknown.
The selectively greater impact of CDS on the initiation of inappropriate prescriptions than on the discontinuation of existing ones could be the result of inaccurate measurement of discontinuation or type 1 errors from multiple comparisons. However, the same pattern was observed in a drug review trial,45 in which physicians were reluctant to stop drug therapy, even when they agreed with the consulting pharmacist's recommendation, because of concerns for patient resistance or discomfort in discontinuing therapy prescribed by another physician. Physicians in the CDS group expressed similar concerns, particularly in relation to drugs prescribed by other physicians. As with a Dutch study,46 we found that the perception of responsibility for patients' treatment varied among the physicians. This lack of clarity in responsibility likely had an impact on the action taken when physicians identified problematic prescriptions.
Poor technical performance is a known deterrent to the use of computer-based systems.47,48,49 Hardware and software failures reduced the frequency of computer use and likely the potential benefits of the CDS. An extensive infrastructure was required to resolve numerous technical problems with the computers and local patient databases. This “heavy client model” is not a viable solution for community-based computer networks. Handheld “personal digital assistants” and wireless technologies, coupled with architectures that provide centralized services for applications and data,50 will provide community-based physicians with less labour-intensive technologic solutions in patient care.
Future research should assess the role of more robust information technologies in primary care, as well as the impact of inappropriate prescriptions on health outcomes.
Footnotes
-
This article has been peer reviewed.
Contributors: Dr. Tamblyn, as principal investigator and author, was involved in all aspects of the study and article preparation. Drs. Huang, Perreault, Jacques, Roy and Hanley were involved in the study's conception and design and revised the article for important intellectual content. In addition, Dr. Hanley was involved in the analysis and interpretation of the data. Dr. McLeod was involved in the study's conception and design. Dr. Laprise was involved in the acquisition, analysis and interpretation of the data. All authors approved the final version of the article.
Acknowledgements: Funding was provided by the Fonds de recherche en santé du Québec, the Fond d'autoroute à l'information, the Medical Research Council, the National Health Research and Development Program and Clinidata Inc. In addition, Dr. Tamblyn was supported as a health scholar by the National Health Research and Development Program. This study was made possible by support provided by the Régie de l'assurance maladie du Québec, which developed the computerized interface for the drug insurance-claims database of the seniors drug-insurance program, and by Clinidata, which developed the software to record disease and drug profiles and to conduct automated surveillance for investigator-defined prescribing problems. Catherine Marquis, Jimmy Fragos and Teresa Moraga provided expert assistance in study coordination, implementation and analysis.
Competing interests: None declared.