OBJECTIVE—Twenty-one international pediatric diabetes centers from 17 countries investigated the effect of simple feedback about the grand mean HbA1c level of all centers and the average value of each center on changes in metabolic control, rate of severe hypoglycemia, and insulin therapy over a 3-year period.

RESEARCH DESIGN AND METHODS—Clinical data collection and determination of HbA1c levels were conducted at a central location in 1995 (n = 2,780, age 0–18 years) and 1998 (n = 2,101, age 11–18 years).

RESULTS—Striking differences in average HbA1c concentrations were found among centers; these differences remained after adjustment for the significant confounders of sex, age, and diabetes duration. They were apparent even in patients with short diabetes duration and remained stable 3 years later (mean adjusted HbA1c level: 8.62 ± 0.03 vs. 8.67 ± 0.04 [1995 vs. 1998, respectively]). Three centers had improved significantly, four centers had deteriorated significantly in their overall adjusted HbA1c levels, and 14 centers had not changed in glycemic control. During the observation period, there were increases in the adjusted insulin dose by 0.076 U/kg, the adjusted number of injections by 0.23 injections per day, and the adjusted BMI by 0.95 kg/m2. The 1995 versus 1998 difference in glycemic control for the seven centers could not be explained by prevailing insulin regimens or rates of hypoglycemia.

CONCLUSIONS—This study reveals significant outcome differences among large international pediatric diabetes centers. Feedback and comparison of HbA1c levels led to an intensification of insulin therapy in most centers, but improved glycemic control in only a few.

In view of the complexity of the medical—but also the educational and psychological—aspects of pediatric diabetology, it has been suggested that the optimal therapeutic approach requires a competent multidisciplinary team (1). There is evidence that increasing numbers of children in some countries have access to such teams (2). The multidisciplinary approach is strongly supported by the results of the Diabetes Control and Complications Trial (3). In the adolescent subgroup of that study, however, a poorer average level of glycemic control was achieved, even though adolescents received more counseling than the adults in that study (4). So far, few studies have evaluated the variation of structure, process, and outcome data of the multidisciplinary approach for children with diabetes, which may provide key evidence for the improvement of quality of care (5).

The Hvidøre Study Group on Childhood Diabetes evolved during a workshop to discuss strategies that might be important in improving the quality of pediatric diabetes care. The prevailing insulin regimens (6) and the level of glycemic control achieved by the study group patients in a cross-sectional survey were reported previously (7) and showed substantial differences in the average level of glycemic control among centers. The present study investigates the reproducibility of these differences and analyzes factors potentially influencing the variation of glycemic control among centers.

A multicenter cross-sectional study involving 21 pediatric departments from 17 countries in Europe, Japan, and North America was performed in the two following sampling periods:

1) from March through the end of August 1995—data from 2,780 patients aged 0–18 years (subgroup 11–18 years of age: n = 2,040); and

2) from March through the end of September 1998—data from 2,101 patients aged 11–18 years.

The study sample included 4,835 HbA1c measurements in 3,805 patients whose clinical data are given in Table 1. There were 891 patients (age in 1995: 11.3 ± 2.2 years; diabetes duration: 4.6 ± 3.0 years) who participated in both sampling periods. One center did not participate in the second sampling period and was therefore excluded from further analysis. Information on each patient’s sex, age, height, weight, duration of diabetes, number of severe hypoglycemic events (defined as seizures or loss of consciousness in the 3 months preceding the blood sampling), insulin regimen, and daily insulin dose was recorded in each sampling period. A capillary blood sample was drawn from each patient for HbA1c determination in each sampling period, and all samples were analyzed at Steno Diabetes Center, Gentofte, Denmark. Details of this assay (normal range: 4.4–6.3%) and the transport of specimens have been published previously (7). In 1995, each center supplied a mean HbA1c determination for the participants and the mean of the HbA1c determination for the nonparticipants for the same time period, giving no indication of a selection bias (7).

The study was performed according to the criteria of the Helsinki II Declaration and was approved by the local ethics committee at each center.

Statistical analysis

Summary statistics are expressed as means ± SD or means ± SEM. Comparisons of centers with the grand mean HbA1c level were performed using a one-way analysis of variance, taking into account each center’s contribution to the grand mean. To correct for differences in sex, age, and diabetes duration distributions, an adjusted center mean was evaluated by a multiple regression analysis including center as a class variable, and sex, age, and disease duration as continuous variables. By means of these values, the center effect was adjusted to correspond to the average values of the other explanatory variables. Evaluation of the change in HbA1c level, insulin frequency, insulin dose, and BMI for each center was done by a repeated-measurements model (with random subject effects) to account for the fact that some patients contributed with two measurements and others with only one. Sex, age, and duration of disease were included to adjust for these factors. The rate of severe hypoglycemic events was analyzed by a loglinear Poisson model, including sex, age, and center class (i.e., above average, average, and below average) as covariates. This was calculated both with and without including each individual’s HbA1c level. To examine whether differences among centers were particularly pronounced early or later in the duration of diabetes, we calculated the mean HbA1c level for each center separately for children with diabetes duration ≤3 years and >3 years. All data were analyzed in three different data sets: the total cohort, the subgroup of patients participating at both time points (i.e., repeat patients), and patients 11–18 years of age at both time points. However, as no major difference in the results among these analyses was apparent, except declining levels of significance due to the smaller sample size, only the results of the total cohort are described in the results section.

Differences among centers in glycemic control

Glycemic control as assessed by HbA1c concentration varied significantly among centers in the first sampling period (P < 0.0001) (Fig. 1). The grand mean HbA1c level in 1995 was 8.62 ± 0.03%. The HbA1c concentration was higher in female subjects than in male subjects (0.22 ± 0.05, P < 0.0001, estimate ± SEM) and increased for each year of age (0.046 ± 0.008, P < 0.0001) or diabetes duration (0.079 ± 0.007, P < 0.0001). After adjustment for these factors, six centers were significantly above the grand mean for HbA1c, eight centers were significantly below the grand mean (P < 0.05), and seven centers did not differ significantly from the average HbA1c value.

Reproducibility of center differences in glycemic control

Three years later, three centers had improved significantly in their mean HbA1c levels and four centers had deteriorated significantly in their overall HbA1c levels (Fig. 1). The mean adjusted HbA1c concentration remained unchanged: 8.67 ± 0.04%. Regarding the grouping in average, above-average, and below-average centers, only one center changed from being below average to being above average and one vice versa, respectively, whereas 14 centers did not change their position. Thus, the differences among centers are a reproducible finding.

Lack of association between changes in glycemic control and changes in the therapeutic regimen

The insulin dose in 12 centers increased significantly during the observation period (in two of three centers with significant improvement in HbA1c levels and two of four with worsening of HbA1c levels) (Fig. 2). The overall increase in insulin dose was 0.076 U/kg, after adjusting for the increase due to age and duration of diabetes. The change in insulin dose was unrelated to change in HbA1c concentration. The number of daily injections increased overall by ∼0.23 daily injections (adjusted for the increase due to age and duration), with a significant increase in 11 centers. This increase was not associated with changes in the average HbA1c level of the respective centers (Fig. 2).

The BMI increased with age and duration of diabetes. Even after adjustment for this expected increase, however, a further overall increase of 0.95 kg/m2 over 3 years occurred. A significant increase in BMI was found in all 11 centers where the number of daily injections had increased, but only in 6 of 10 centers with an unchanged frequency of injections (Fig. 2). Only 1 of 12 centers with an increase in the insulin dose had no significant rise in average BMI.

Better levels of glycemic control were not associated with higher insulin doses prescribed at different ages (Fig. 3). Centers with the best levels of glycemic control appeared to be successful in achieving good control from the onset of the disease, as a significant correlation was found in the mean HbA1c concentration during the first 3 years of diabetes and the HbA1c of patients with longer duration at the individual centers during both sampling periods (Fig. 4).

Differences among centers in the rate of severe hypoglycemia

To quantify the differences among centers regarding the rates of hypoglycemia, a paired comparison of the three center groups with average, above average, and below average glycemic control was performed with a loglinear Poisson model. In this analysis, the relative risk of severe hypoglycemia was lowest in the group with the best glycemic control, regardless of whether the 1995 data or the 1998 data were used for analysis (Fig. 5, 1998 data). However, the center effect did not reach significance due to the low rates of hypoglycemia in this population (χ2 = 5.46, with 2 degrees of freedom; P = 0.07).

Substantial differences in the average HbA1c level and the average rate of severe hypoglycemia were present among international multidisciplinary pediatric diabetes centers. Simple feedback about these differences led to an intensification of insulin therapy in most centers. However, only three centers were able to significantly improve their average glycemic control, and these changes were unrelated to parameters of insulin therapy investigated in the present study. However, cautious interpretation of the findings is warranted. Even though most of the participating centers claimed that the majority of their patients were from their geographic area, and no clear evidence of a selection bias could be found (7), this was not a population-based study. Moreover, the reasons why patients continue to attend a particular clinic may be directly related to the outcome of the management of their diabetes at that clinic.

Interestingly, the differences among centers were already apparent in patients with a very short duration of diabetes. This may have been due to the heterogeneity of type 1 diabetes itself, as significant differences have been reported at onset of diabetes among children from different geographic locations (8). Also, the HLA- DR3,DQ2 and -DR4,DQ8 haplotype distributions vary considerably among countries, and HLA-DR3,DQ2 has been reported to be associated with a milder course of the disease reflected by better metabolic control. However, when correlating the reported frequencies of these haplotypes (9) with the average control from patients representing these countries, we found no association. Ethnic or cultural differences have also been suggested to be related to differences in glycemic control (10,11). The present results are in agreement with those of other investigations that report that ethnic aspects appear to be of lesser importance than other factors (e.g., socioeconomic) for health-related behavior in adolescents (12,13), as geographic factors were unable to explain the observed differences (7). Low socioeconomic level and minority status are related to poor glycemic control (14). Potential heterogeneity of the patient populations due to varying proportions of immigrants or minorities at some centers may have a significant influence on results in some centers (11), but not in others (15).

In a nationwide study in France, glycemic control was better in university-affiliated hospitals and centers following >50 patients (16). Although specialized diabetes care in general is associated with better glycemic control (17), significant differences were apparent in our study, even though only relatively large centers with special expertise in pediatric diabetology were included. In single-center analyses (15,18,19), an association was seen between the average HbA1c level and the number of annual visits or the weekly time allocated for outpatient diabetes care by the members of the diabetes team. Indeed, in one center with significant improvement in the average HbA1c level, structural improvements in the delivery of health care resulted in improved glycemic control (20).

Similar to the experience with hypoglycemia in the Diabetes Control and Complications Trial, there was no clear-cut association between average control at an individual center and the rate of severe hypoglycemia (21). For both sampling periods, a higher rate of severe hypoglycemia was associated with lower age and better glycemic control (7). However, some centers were more successful than others in preventing hypoglycemia independent of the prevailing average HbA1c level at the respective center. This important finding may relate to other features of diabetes management, such as psychological support and more successful education in centers with low incidence of hypoglycemia (15,19,21,22).

Therefore, an alternative explanation for the good correlation between the average control in patients with a short duration of diabetes and those with a long-term course of the disease has to include differences in diabetes education and management from the onset of the disease. Thus, differing attitudes of the diabetes teams (e.g., regarding the use of sliding-scale insulin dosage adjustments) and/or differing degrees of patient empowerment may represent a major factor underlying these differences among centers. Parameters of insulin therapy showed no clear-cut association with glycemic control or hypoglycemia rates either in the original sample (7) or in the present assessment of the differences among centers. As a consequence of the unsatisfactory level of glycemic control in the first survey, it is possible that most centers had increased the number of injections and the insulin dose before reinvestigation at the second sampling. These changes were not associated with an improvement in glycemic control. As a possible side effect of this strategy, a substantial increase in the BMI was observed in many centers, particularly in girls (23).

In conclusion, it is naive to limit quality assessment in pediatric diabetology to comparing HbA1c levels, hypoglycemia rates, or superficial structural aspects of diabetes care as suggested by contemporary guidelines. Factors such as the attitudes of treatment teams, self-care behaviors, educational models, or patient satisfaction may be more directly related to outcomes than insulin regimens. The demonstration of the differences among centers has been disquieting to the participants of the study, and the subsequent analyses have revealed more questions than answers. Now that it has been established that differences among centers are maintained over 3 years, future studies need to focus on the early course of the disease when differences are already present. Subsequent studies undertaken by the Hvidøre Group will therefore investigate the remission phase and health care delivery via a patient satisfaction survey.

Figure 1—

Adjusted means ± SEM (adjustment for sex, age, and diabetes duration) of HbA1c levels at participating centers at the baseline evaluation in 1995 (A). Centers with an HbA1c level significantly below average (□), with average HbA1c concentrations ([cjs2110]), and with levels significantly above average are shown (▪). The change in the adjusted mean after 3 years (B) is also shown. The three centers that significantly (*P < 0.05) improved their adjusted HbA1c levels are shown with light gray bars, the four centers that significantly worsened are shown with dark gray bars, and those that had no significant change are shown with empty bars.

Figure 1—

Adjusted means ± SEM (adjustment for sex, age, and diabetes duration) of HbA1c levels at participating centers at the baseline evaluation in 1995 (A). Centers with an HbA1c level significantly below average (□), with average HbA1c concentrations ([cjs2110]), and with levels significantly above average are shown (▪). The change in the adjusted mean after 3 years (B) is also shown. The three centers that significantly (*P < 0.05) improved their adjusted HbA1c levels are shown with light gray bars, the four centers that significantly worsened are shown with dark gray bars, and those that had no significant change are shown with empty bars.

Close modal
Figure 2—

Changes in the insulin dose (A), number of insulin injections (B), and BMI (C) between the baseline evaluation and 3 years later in the respective centers, sorted according to the center rank in the adjusted HbA1c level at baseline (see Fig. 1). As in Fig. 1, the three centers that significantly improved their adjusted HbA1c levels are shown with light gray bars, the four centers that significantly worsened are shown with dark gray bars, and those that had no significant change are shown with empty bars. *Significant (P < 0.05) changes from the first evaluation in the respective centers.

Figure 2—

Changes in the insulin dose (A), number of insulin injections (B), and BMI (C) between the baseline evaluation and 3 years later in the respective centers, sorted according to the center rank in the adjusted HbA1c level at baseline (see Fig. 1). As in Fig. 1, the three centers that significantly improved their adjusted HbA1c levels are shown with light gray bars, the four centers that significantly worsened are shown with dark gray bars, and those that had no significant change are shown with empty bars. *Significant (P < 0.05) changes from the first evaluation in the respective centers.

Close modal
Figure 3—

Age-specific average curves (1995: age 2–18 years; 1998: age 10–18 years) for insulin doses in the centers significantly below the grand mean HbA1c level, those centers not differing from the mean level, and those significantly above the mean level.

Figure 3—

Age-specific average curves (1995: age 2–18 years; 1998: age 10–18 years) for insulin doses in the centers significantly below the grand mean HbA1c level, those centers not differing from the mean level, and those significantly above the mean level.

Close modal
Figure 4—

Relation between the average control of the short-term patients (during the first 3 years of diabetes) and those with duration of diabetes >3 years at the 21 individual centers (□ 1995, Rs: 0.83, P < 0.001; ▪ 1998, Rs: 0.68, P = 0.001; both time points combined, Rs: 0.77, P < 0.001).

Figure 4—

Relation between the average control of the short-term patients (during the first 3 years of diabetes) and those with duration of diabetes >3 years at the 21 individual centers (□ 1995, Rs: 0.83, P < 0.001; ▪ 1998, Rs: 0.68, P = 0.001; both time points combined, Rs: 0.77, P < 0.001).

Close modal
Figure 5—

Incidence of severe hypoglycemic episodes per 100 patient-years in centers above, below, and not significantly different from the mean level of HbA1c. To show the estimated rates of events, a standard person from the 1998 group is considered (male, 13 years of age, and with diabetes duration of 5 years). Then, the predicted rate of events is shown as a function of center class (dotted line center significantly below the mean) and individual HbA1c level using a Poisson loglinear regression model.

Figure 5—

Incidence of severe hypoglycemic episodes per 100 patient-years in centers above, below, and not significantly different from the mean level of HbA1c. To show the estimated rates of events, a standard person from the 1998 group is considered (male, 13 years of age, and with diabetes duration of 5 years). Then, the predicted rate of events is shown as a function of center class (dotted line center significantly below the mean) and individual HbA1c level using a Poisson loglinear regression model.

Close modal
Table 1—

Clinical data

19951998
Total n 2,780 2,101 
Males/females 1,404/1,376 1,085/1,016 
Age (years) 11.97 ± 4.02 13.81 ± 2.12 
Duration (years) 4.78 ± 3.70 5.23 ± 3.79 
BMI (kg/m219.67 ± 3.39 21.28 ± 3.46 
HbA1c (%) 8.62 ± 1.64 8.74 ± 1.66 
Insulin dose (U/kg) 0.85 ± 0.29 0.98 ± 0.32 
19951998
Total n 2,780 2,101 
Males/females 1,404/1,376 1,085/1,016 
Age (years) 11.97 ± 4.02 13.81 ± 2.12 
Duration (years) 4.78 ± 3.70 5.23 ± 3.79 
BMI (kg/m219.67 ± 3.39 21.28 ± 3.46 
HbA1c (%) 8.62 ± 1.64 8.74 ± 1.66 
Insulin dose (U/kg) 0.85 ± 0.29 0.98 ± 0.32 

We thank Novo Nordisk A/S for its enthusiasm and practical support throughout this study, with special appreciation to Lene Kaa Meier. We are also grateful to the Steno Diabetes Center for the assistance that it provided.

1
Laron Z, Galatzer A, Amir S, Gil R, Karp M, Mimouni M: A multidisciplinary comprehensive ambulatory treatment scheme for diabetes mellitus in children.
Diabetes Care
2
:
342
–348,
1979
2
Greene S: Diabetes in the young: current challenges in their management.
Baillieres Clin Pediatr
4
:
563
–575,
1996
3
Diabetes Control and Complications Trial Research Group: The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus.
N Engl J Med
329
:
977
–986,
1993
4
Diabetes Control and Complications Trial Research Group: Effect of intensive diabetes treatment on the development and progression of long-term complications in adolescents with insulin-dependent diabetes mellitus: Diabetes Control and Complications Trial.
J Pediatr
125
:
177
–188,
1994
5
Brook RH, McGlynn EA, Cleary PD: Quality of health care. II. Measuring quality of care.
N Engl J Med
335
:
966
–970,
1996
6
Mortensen HB, Robertson KJ, Aanstoot HJ, Danne T, Holl RW, Hougaard P, Atchison JA, Chiarelli F, Daneman D, Dinesen B, Dorchy H, Garandeau P, Greene S, Hoey H, Kaprio E, Kocova M, Martul P, Matsuura M, Schoenle EJ, Søvik O, Swift PGF, Tsou RM, Vanelli M, Aman J, for the Hvidøre Study Group on Childhood Diabetes: Insulin management and metabolic control of type 1 diabetes mellitus in childhood and adolescence in 18 countries.
Diabet Med
15
:
752
–759,
1998
7
Mortensen HB, Hougaard P, for the Hvidøre Study Group on Childhood Diabetes: Comparison of metabolic control in a cross-sectional study of 2,873 children and adolescents with insulin-dependent diabetes from 18 countries.
Diabetes Care
20
:
714
–720,
1997
8
Daneman D, Knip M, Kaar ML, Sochett E: Comparison of children with type 1 (insulin-dependent) diabetes in northern Finland and southern Ontario: differences at disease onset.
Diabetes Res
14
:
123
–126,
1990
9
Ilonen J, Reijonen H: Special genetic features of the population in Nordic countries as related to risk of IDDM.
Diabetes in the Young
29
:
10
–16,
1993
10
Delamater AM, Albrecht DR, Postellon DC, Gutai JP: Racial differences in metabolic control of children and adolescents with type I diabetes.
Diabetes Care
14
:
20
–25,
1991
11
Holl RW, Hecker W, Bartus B, Heinze E, Holder M, Teller WM: Poor metabolic control in 91 immigrants as compared to 804 German children and adolescents with IDDM (Abstract).
Diabetologia
39
:
A29
,
1996
12
Overstreet S, Holmes CS, Dunlap WP, Frentz J: Sociodemographic risk factors to disease control in children with diabetes.
Diabet Med
14
:
153
–157,
1997
13
Irwin CE, Millstein SG, Ellen JM: Appointment-keeping behaviour in adolescents: factors associated with follow-up appointment-keeping.
Pediatrics
92
:
20
–23,
1993
14
Delamater AM, Shaw KH, Applegate EB, Pratt IA, Eidson M, Lancelotta GX, Gonzalez-Mendoza L, Richton S: Risk for metabolic control problems in minority youth with diabetes.
Diabetes Care
22
:
700
–705,
1999
15
Dorchy H: Quel contrôle glycemique peut être obtenu chez des jeunes diabétiques sans sécrétion résiduelle d’insuline endogène? Quelle est la fréquence des hypoglycémies sévères et des complications subcliniques?
Arch Pediatr
1
:
970
–981,
1994
16
Rosilio M, Cotton JB, Wieliczko MC, Gendrault B, Carel JC, Couvras O, Ser N, Gillet P, Soskin S, Garandeau P, Stuckens C, Le Luyer B, Jos J, Bony-Trifunovic H, Bertrand AM, Leturcq F, Lafuma A, the French Pediatric Diabetes Group, Bougnères PF: Factors associated with glycemic control.
Diabetes Care
21
:
1146
–1153,
1998
17
Zgibor JC, Songer TJ, Kelsey SF, Weissfeld J, Drash AL, Becker DJ, Orchard TJ: The association of diabetes specialist care with health care practices and glycemic control in patients with type 1 diabetes.
Diabetes Care
23
:
472
–476,
2000
18
Kaufman FR, Halvorson M, Carpenter S: Association between diabetes control and visits to a multidisciplinary pediatric diabetes clinic.
Pediatrics
103
:
948
–951,
1999
19
Dorchy H, Roggemanns MP, Willems D: Glycated hemoglobin and related factors in diabetic children and adolescents under 18 years of age: a Belgian experience.
Diabetes Care
18
:
2
–6,
1997
20
Dyrløv K, Poulsen L, Sølvkær L, Marinelli K, Olsen BS, Hougaard P, Mortensen HB: Improving the outcome for children and adolescents with type 1 diabetes: results of a changing service in Copenhagen.
Practical Diabetes International
17
:
217
–225,
2000
21
The Diabetes Control and Complications Trial Research Group: Hypoglycemia in the Diabetes Control and Complications Trial.
Diabetes
46
:
271
–286,
1997
22
Norfeldt S, Ludvigsson J: Severe hypoglycemia in children with IDDM: a prospective population study, 1992–
1994
. Diabetes Care
20
:
497
–503,
1997
23
Diabetes Control and Complications Trial Research Group: Weight gain associated with intensive therapy in the Diabetes Control and Complications Trial.
Diabetes Care
11
:
567
–573,
1988

Address correspondence and reprint requests to Dr. Thomas Danne, Diabetes-Zentrum für Kinder- und Jugendliche, Kinderkrankenhaus auf der Bult, Janusz-Korczak-Allee 12, 30173 Hannover, Germany. E-mail: danne@hka.de.

Received for publication 28 September 2000 and accepted in revised form 17 April 2001.

R.W.H. has received a grant and other funds from Novo Nordisk; K.J.R. has received funds for research from Novo Nordisk; and P.H. and H.L. hold stock in Novo Nordisk.

A table elsewhere in this issue shows conventional and Système International (SI) units and conversion factors for many substances.