Abstract
Background We conducted a meta-analysis of randomized controlled trials to assess the effectiveness of disease-management programs for improving glycemic control in adults with diabetes mellitus and to study which components of programs are associated with their effectiveness.
Methods We searched several databases for studies published up to December 2009. We included randomized controlled trials involving adults with type 1 or 2 diabetes that evaluated the effect of disease-management programs on glycated hemoglobin (hemoglobin A1C) concentrations. We performed a meta-regression analysis to determine the effective components of the programs.
Results We included 41 randomized controlled trials in our review. Across these trials, disease-management programs resulted in a significant reduction in hemoglobin A1C levels (pooled standardized mean difference between intervention and control groups −0.38 [95% confidence interval −0.47 to −0.29], which corresponds to an absolute mean difference of 0.51%). The finding was robust in the sensitivity analyses based on quality assessment. Programs in which the disease manager was able to start or modify treatment with or without prior approval from the primary care physician resulted in a greater improvement in hemoglobin A1C levels (standardized mean difference −0.60 v. −0.28 in trials with no approval to do so; p < 0.001). Programs with a moderate or high frequency of contact reported a significant reduction in hemoglobin A1C levels compared with usual care; nevertheless, only programs with a high frequency of contact led to a significantly greater reduction compared with low-frequency contact programs (standardized mean difference −0.56 v. −0.30, p = 0.03).
Interpretation Disease-management programs had a clinically moderate but significant impact on hemoglobin A1C levels among adults with diabetes. Effective components of programs were a high frequency of patient contact and the ability for disease managers to adjust treatment with or without prior physician approval.
Despite well-established recommendations for diabetes care,1–3 quality of care still needs to be improved. Although many nonpharmacologic strategies (patient education, psychological intervention, dietary education, self-monitoring and telemedicine) have been developed, their effectiveness is still unclear.4–6 “Disease management” is a structured, multi-faceted intervention that includes several of the above-mentioned components. In two recent meta-analyses, disease management was associated with an improvement in glycemic control, as assessed by a mean reduction in hemoglobin A1C concentration of 0.52% and 0.81%.7,8 Disease management seems to be more effective than single strategies such as clinician education, patient education or promotion of self-management.7
Because disease-management programs are heterogeneous, the effective components need to be identified to improve program implementation. Previous studies have evaluated the efficacy of some program components.7,8 Independent medication changes by the disease manager appear to be particularly effective.7 However, other important factors such as the intensity of the intervention have not been previously evaluated.
We conducted a meta-analysis of randomized controlled trials (RCTs) involving adults with type 1 or 2 diabetes mellitus that evaluated the effect of disease-management programs on hemoglobin A1C levels. We determined the effective components of the programs, considering both the type of component and the intensity of the intervention.
Methods
Definition of disease management
There is no consensual definition of disease management. According to the Care Continuum Alliance (formerly the Disease Management Association of America), disease management “supports the physician or practitioner/patient relationship and plan of care; emphasizes prevention of exacerbations and complications utilizing evidence-based practice guidelines and patient empowerment strategies; and evaluates clinical, humanistic, and economic outcomes on an on-going basis with the goal of improving overall health” (www.carecontinuum.org/dm_definition.asp). To identify relevant studies for our meta-analysis, we adopted an operational definition based on the above definition, literature review and expert opinion.
We defined disease management as ongoing and proactive follow-up of patients that includes at least two of the following five components: patient education (dietary and exercise counselling, self-monitoring, and knowledge of disease and medication); coaching (the disease manager encourages the patient to overcome psychological or social barriers that impede autonomy or improvement in medication compliance); treatment adjustment (the disease manager is able to start or modify treatment with or without prior approval from the primary care physician); monitoring (the disease manager gets medical data from the patient); and care coordination (the disease manager reminds the patient about upcoming appointments or important aspects of self-care and informs the primary care physician about complications, treatment adjustment or therapeutic recommendations).
Literature search
We searched the following computerized databases: MEDLINE (1966 to December 2009), Scopus (1960 to December 2009), Web of Science (1975 to December 2009) and the Cochrane Library (1993 to 2009 [issue 4]) The complete MEDLINE search strategy is presented in Appendix 1 (available at www.cmaj.ca/cgi/content/full/cmaj.091786/DC1). In an attempt to minimize the omission of potentially relevant trials, we also searched the reference lists of included studies. We used the terms “patient care team,” “disease management,” “case management,” “managed care programs,” “home-based intervention” and “patient care management” to cover the inconsistency in the definition of disease management; we also used the terms “diabetes mellitus,” “HbA1C” and “glycated hemoglobin.”
Two of us (C.P. and C.H.) first reviewed the titles and abstracts of identified articles and then examined the full-text version of selected articles further to assess relevance to the research topic. Only RCTs were included, because this study design supports maximum validity and causal inference.9 The search was limited to English-language publications. We restricted inclusion to studies that reported hemoglobin A1C levels, which is an index of the mean blood glucose concentration of the preceding 8–12 weeks.10 In addition to our operational definition of disease management, we defined the following inclusion criteria: the study had to involve adults with type 1 or 2 diabetes; it had to report both pre- and postintervention hemoglobin A1C levels; and postintervention hemoglobin A1C levels had to be assessed after at least 12 weeks of follow-up.
We excluded trials in which the intervention did not involve direct contact between the disease manager and the patient or was unclear, unspecified or exclusively based on contact by Internet or mail.
Data extraction
Two of us (C.P. and C.H.) evaluated each study separately and extracted data. To assess outcome, hemoglobin A1C levels before and after the intervention were extracted. In the event of several postintervention values, only the first one was considered. Other data extracted were as follows: characteristics of the participants (percentage of women, mean age), sample size, number of dropouts, intervention mode (one-to-one session, phone contact or both), type of program components (patient education, psychological coaching, monitoring, feedback of initial evaluation to primary care physician, treatment adjustment), length of intervention, frequency of contact, interval between pre- and postintervention hemoglobin A1C assessments, and adverse events (hypoglycemic episodes, hospital admission and death).
Frequency of contact was estimated on the basis of the reported intervention protocol and, when available, the results. We classified the frequency into three levels: low (less than one contact monthly per patient), moderate (one contact monthly per patient) and high (several contacts monthly per patient). In the event of discrepancies in the classification of contact frequency, data were reviewed by another one of us (M.L.G.), and a consensus was reached.
When data were missing, the original authors of the article were contacted by email.
Statistical analysis
To account for differences in baseline hemoglobin A1C levels between the studies, we calculated the mean difference between pre- and postintervention hemoglobin A1C levels for the intervention and control groups, and the standard deviation (SD) of each difference. Thus, our outcome corresponds to the improvement in glycemic control in the intervention group between baseline and postintervention hemoglobin A1C levels compared with the control group. We used the imputation method according to baseline values for missing SDs (we imputed missing SDs according to the pre-intervention values). Owing to significant heterogeneity, we used a random-effects model to calculate the pooled standardized mean difference in hemoglobin A1C levels between the intervention and control groups, along with the 95% confidence interval (CI).11 Heterogeneity was quantified by using I2 and τ2 (study variance) values.12,13
We used meta-regression analysis to determine what part of between-study variance was explained by patient characteristics (mean hemoglobin A1C level, age, sex) and components of the disease-management programs (length of intervention, treatment adjustment, mode of patient education, frequency of contact, feedback of initial evaluation to primary care physician, and mode of intervention). Results are expressed as standardized mean changes in the hemoglobin A1C level. Explained heterogeneity was expressed as a percentage change of τ2 (between-study variance).
Because quality assessment in meta-analysis is controversial,14 we performed three sensitivity analyses based on key components of internal validity to test the robustness of our results.15 In the first sensitivity analysis, we excluded trials that had a dropout rate of 20% or more and trials without dropout information. In the second analysis, we excluded trials in which the difference in dropout rates between study groups was 7% or more (highest quintile) and trials without dropout information. In the third analysis, we excluded trials with unclear information about allocation concealment.16
For all analyses, a p value of 0.05 or less was considered to be statistically significant.
Results
Study characteristics
The selection of studies for our review is summarized in Figure 1.17 The initial search strategy identified 2148 citations, and 135 full-text articles were reviewed. Forty-four studies met our inclusion criteria. Three studies were excluded because of missing data on hemoglobin A1C levels at baseline, even after contacting the authors.18–20 Thus, we included 41 RCTs published between 1990 and 2009 that enrolled a total of 7013 adults with type 1 or 2 diabetes.21–61
The main features of the 41 RCTs are shown in Table 1 (at the end of the article). Twenty-six trials were conducted in the United States, five in Canada, three in Europe and seven in Asia. Sample sizes ranged from 31 to 1665. The length of the intervention ranged from 1.5 to 48 months. In most trials, the length of intervention and the length of follow-up were similar, with only five trials reporting a few months’ difference between the end of the intervention and hemoglobin A1C assessment.21,23,29,39,49 Most of the studies (29 trials) focused solely on type 2 diabetes, 9 included patients with either type 1 or 2 diabetes, and 3 trials focused on type 1 diabetes. The mean age of the participants was 57.6 years (SD 7.3); 46.0% were men. The mean hemoglobin A1C concentration at baseline was 8.5% (SD 1.4%).
Effect of intervention on glycemic control
The impact of the disease-management programs on changes in hemoglobin A1C concentrations in the intervention and control groups is presented in Figure 2. In the random-effects model, the pooled standardized mean difference in levels between the intervention and control groups was −0.38 (95% CI −0.47 to −0.29; p < 0.001), favouring disease management over usual care. This standardized mean difference corresponds to an absolute mean difference in hemoglobin A1C levels of 0.51% between the intervention and control groups. None of the studies reported a significant change in hemoglobin A1C in favour of usual care. There was significant heterogeneity among the trials regarding changes in hemoglobin A1C (I2 = 66%).62
Meta-regression and subgroup analyses
Results of univariable meta-regression analyses, stratified by patient characteristics and components of the disease-management programs, are shown in Table 2. Of the patient characteristics analyzed, age and sex were not associated with between-group differences in hemoglobin A1C outcomes. The reduction in hemoglobin A1C levels was significantly greater among patients with a baseline hemoglobin A1C level of 8.0% or higher (standardized mean difference −0.45) than among those with a baseline level of less than 8.0% (standardized mean difference −0.14) (p = 0.003). About 33% of the variance between trials could be explained by mean hemoglobin A1C values at baseline.
Two components of the disease-management programs led to greater improvements in glycemic control (Table 2). First, programs in which the disease manager was able to start or modify treatment with or without prior approval from the primary care physician resulted in a significantly greater reduction in hemoglobin A1C levels (standardized mean difference −0.60 v. −0.28 in trials with no approval to do so; p < 0.001). Second, among the 36 trials that reported sufficient information to allow classification of the frequency of patient contact (Table 1), programs with a moderate or high frequency of contact (28 trials) reported a significant reduction in hemoglobin A1C levels compared with usual care (standardized mean difference −0.56 for high frequency and −0.24 for moderate frequency). Nevertheless, only programs with a high frequency of contact led to a significantly greater reduction in hemoglobin A1C levels compared with programs with a low frequency of contact (standardized mean difference −0.56 v. −0.30, p = 0.03).
In the random-effects subgroup analyses, none of the other program components modified the effectiveness of the intervention on hemoglobin A1C levels. Two components explained a large part of the variance between trials: 31.9% was explained by mode of education and 39.2% by treatment adjustment. Trials in which the disease manager was able to start or modify treatment with or without prior approval of the physician, trials with face-to-face sessions and trials with a moderate frequency of patient contact each showed a low level of heterogeneity (I2 < 50%).
Sensitivity analyses
Our primary findings did not change after we excluded trials with dropout rates of 20% or more and trials without dropout information (Table 3). The same was true after we excluded trials with a between-group difference in dropout rates of 7% or more and trials without dropout information, and after we excluded trials with unclear allocation concealment (Table 3).
Adverse events
Hypoglycemic episodes were not systematically assessed. Only 9 of the 41 studies reported this information separately for intervention and control groups, but with varied definitions of hypoglycemic episodes.22,25,27,31,40,43,45–47 No difference in hypoglycemic episodes between study groups was reported in six of the nine trials. In two of the three trials that reported a difference, the adverse event occurred more frequently in the control groups than in the intervention groups.31,45 Twenty studies reported deaths over the follow-up period; no overall difference in mortality between groups was found (p = 0.18). Hospital admissions were not clearly or systematically reported.
Interpretation
Our meta-analysis suggests that disease-management programs have a favourable effect on improving glycemic control, with a pooled standardized mean reduction of 0.38 (corresponding to a pooled absolute mean reduction of 0.51%) in hemoglobin A1C levels compared with usual care. This finding was robust in sensitivity analyses based on quality assessment. The United Kingdom Prospective Diabetes Study showed that each 1% reduction in hemoglobin A1C level was associated with a 37% decrease in the risk of microvascular complications and a 21% decrease in the risk of death related to diabetes, with no evidence of a threshold.63 Therefore, the absolute reduction of 0.51% in hemoglobin A1C level in our study appears to be clinically significant. Moreover, this finding is probably largely underestimated, because the usual care provided in control groups in RCTs is often better than that provided in clinical practice. Indeed, there was a significant standardized mean reduction in hemoglobin A1C levels of −0.25 in the control groups, which corresponds to an absolute mean reduction of 0.40%. Some studies included in our meta-analysis permitted patients in the control group to contact the medical team or be contacted by them during follow-up in addition to usual care.23,43,55 Also, patients received structured individual education before randomization in some trials.21,23
Our findings suggest that disease-management programs are more effective for patients who have poor glycemic control (mean hemoglobin A1C ≥ 8.0% at baseline) than for those with better glycemic control. This is concordant with results among patients starting insulin therapy.64 Thus, disease management could be particularly effective if targeted at patients with nonstabilized diabetes. Moreover, such patients have a higher risk of complications and so would probably derive greater long-term benefit from disease management.
We found that the ability of disease managers to start or modify medical treatment was an effective feature of disease-management programs. This confirms the findings of Shojania and colleagues, who evaluated the ability to adjust treatment without prior physician agreement.7 However, we found that the ability to adjust treatment was an effective feature both with and without prior physician agreement, which is more relevant for physicians, nurses and pharmacists in clinical practice. This has important implications, because nonadherence to medical treatment is a significant predictor of all-cause mortality and hospital admission among patients with diabetes.65
Despite its relevance for clinicians and policy-makers, the intensity of disease-management programs has not been investigated in previous reviews. Program intensity depends on the frequency of patient contacts, their duration and the length of the program. Because the duration of contact was not reported in most of the studies included in our review, we were not able to explore it. However, we explored frequency of contact and length of intervention. We did not find any significant difference associated with length of intervention, despite a nonsignificant improvement observed with shorter interventions. Frequency of contact proved to be a key feature of the effectiveness of disease-management programs. There was substantial discrepancy in frequency across trials, ranging from “counseling by telephone every week if necessary”22 to “at least five visits by the nurse within a study period of one year.”41 For our analysis, frequency of contact was estimated on the basis of the intervention protocol reported and, when available, the results. Although the reported intervention protocol probably overestimated the real frequency of contact, frequency was evaluated on the basis of results in 12 studies and was consequently found to be an effective measure. Our findings are consistent with those from a recent large controlled trial, although it showed a nonsignificant trend toward better glycemic control with more intensive intervention.20 The greater effectiveness associated with a high frequency of patient contact suggests that only disease-management programs with intensive interventions should be implemented, perhaps by targeting patients at high risk of diabetes complications.
Patient education is the cornerstone of diabetes care. An overall beneficial effect of education among patients with diabetes has already been shown in several studies.66,67 We did not find any difference in effectiveness between individual education and a combination of individual and group education. This finding suggests that a combination of group and individual education could be a solution to cope with the lack of medical providers and the time-consuming aspect of individual education. Surprisingly, neither the mode of contact nor feedback of the initial evaluation to the primary care physician were discriminatory components. However, we cannot rule out the possibility of incorrect classification of feedback as a program component, because it was taken for granted that such feedback would be provided systematically, so this step was not stipulated formally in the protocol.
Strengths and limitations
The strengths of the study include a comprehensive systematic review of the literature, with a large number of studies included. We used a broad search strategy to capture all relevant information. Our work confirms the findings of previous reviews, with a mean difference in hemoglobin A1C level similar to that observed in previous studies.7,8,68,69 However, we included only RCTs and several more recent studies, with thus a larger sample size. Therefore, our estimate is probably more precise than that in previous studies.
Our study has limitations. Our analyses were based on results from randomized controlled trials, and adjustment was not done at an individual patient level. By including only studies published in English, we may have missed other relevant studies. The weak description of the intervention strategy in most studies precluded the analysis of some potentially relevant components. Notably, we were unable to study the effect of the degree of the primary care physician’s involvement in these programs, which is an essential aspect for implementation. For some components, such as frequency of patient contact, we contacted the authors for more details. However, because some trials were performed several years ago, no supplementary information was available. Another limitation was the short follow-up in many of the trials, even though we excluded trials with less than 12 weeks of follow-up. Because only five trials continued for more than 12 months, we were unable to capture the long-term effects of disease-management programs. However, outcomes such as long-term diabetes complications, especially vascular complications, have not yet been examined in studies of disease management for improved diabetes care. In some trials, the length of the intervention was very short (less than six months in six trials) and thus may have been too short to produce any clinical benefits.
We noted heterogeneity in the overall effect estimate and performed a meta-regression analysis to determine potential sources. The two components of disease-management programs that led to significantly greater improvements in glycemic control accounted for 6.1% (frequency of contact) and 39.2% (treatment adjustment) of the variance between studies. We did not identify all sources of variance among trials, but a meta-analysis of summary data from reported studies has little capacity to do so.
Although a recurrent problem in meta-analyses is publication bias, application of asymmetry tests seemed inappropriate owing to the presence of heterogeneity.70 A previous meta-analysis reported a larger effect estimate for small studies.7 Because a higher intensity of intervention appears to be an important feature underpinning the efficacy of disease-management programs, this “size trial effect” could be due to a higher intensity of intervention in small studies. Indeed, of the 16 studies with a high frequency of patient contact in our analysis, 11 (69%) were relatively small, with samples smaller than the median for the studies included (117 patients). This more intensive intervention in small studies, rather than publication bias, could explain the greater improvement in glycemic control.
Conclusion
Disease-management programs had a clinically moderate but significant impact on hemoglobin A1C levels among adults with diabetes. Effective components of the programs were a high frequency of patient contact and the ability for disease managers to adjust treatment with or without prior physician approval. Our findings have important implications for both the current policy on the delivery of diabetes care and the direction of future research. Our work delineates a general framework with core features for effective programs for disease management. Priority should be given to programs with intensive and proactive follow-up that target patients at high risk of diabetes complications rather than to programs with low frequency of contact that target the overall population of patients with diabetes. In addition, disease managers should be allowed to start or modify medical treatment proactively.
More research is needed concerning the long-term impact of disease-management programs on glycemic control, microvascular and macrovascular complications, admission to hospital and mortality. Further research should also determine whether, in addition to patients with nonstabilized diabetes, other groups of patients with diabetes would benefit from disease management. Lastly, high-quality cost-effectiveness studies of disease-management programs are needed to direct care providers and policy-makers in the allocation of health care resources.
Acknowledgements
The authors acknowledge the assistance of Evelyne Mouillet, Coralie Thore and Christian Weller from the documentary centre of the Institut de santé publique, d’épidémiologie et de développement.
Footnotes
-
Competing interests: Catherine Helmer has received grants from the Agence nationale de la recherche and the Institut national de prévention et d’education pour la santé; honoraria from Eisai Inc., Pfizer Inc. and Ipsen; and royalties from Edi-mark for an article on an unrelated topic. Rodolphe Thiébaut is a member of the advisory board for Gilead. No competing interests declared by Clément Pimouguet, Mélanie Le Goff or Jean François Dartigues.
-
This article has been peer reviewed.
-
Contributors: Clément Pimouguet and Catherine Helmer designed the study, completed the literature search, extracted the data and drafted the manuscript. Mélanie Le Goff contributed to the data extraction, performed the data analysis and helped with the revision of the manuscript. Rodolphe Thiébaut helped with the interpretation of the results, and the consolidation and revision of the manuscript. Jean François Dartigues assisted with the design of the study, contributed to the interpretation of the results and helped with the consolidation and revision of the last draft of the manuscript. All of the authors approved the final version of the manuscript.
-
Funding: This study was funded by the French Ministry of Health. The ministry had no role in the design of the study, the analysis or interpretation of the data, or the writing of the manuscript.