© 2005 by the American Diabetes Association, Inc.
Comparison of a Needle-Type and a Microdialysis Continuous Glucose Monitor in Type 1 Diabetic Patients
1 Department of Internal Medicine, Academic Medical Center, Amsterdam, the Netherlands Address correspondence and reprint requests to I.M. Wentholt, MD, Department of Internal Medicine, Academic Medical Center, PO Box 22660, 1100 AD Amsterdam, Netherlands. E-mail: i.m.wentholt{at}amc.uva.nl
OBJECTIVEWe examined the reliability of two continuous glucose sensors in type 1 diabetic patients at night and during rapid glucose excursions and verified the hypothesized nocturnal hypoglycemic drift of the needle-type sensor (CGMSgold) and delay of the microdialysis sensor (GlucoDay). RESEARCH DESIGN AND METHODSBlood was sampled overnight twice per hour in 13 patients. Rapid-acting insulin was given subcutaneously 30 min after breakfast. Sampling once per minute started 45 min after breakfast and 75 min after insulin injection for 30 min, with the aim of determining peak and nadir glucose values. Mean absolute differences (MADs) between sensor and blood glucose values were calculated. Sensor curves were modeled for all patients using linear regression. Horizontal and vertical shifts of sensor curves from the blood glucose curves were assessed. A vertical shift indicates sensor drift and a horizontal shift sensor delay. RESULTSDrift was minimal in the needle-type and microdialysis sensors (0.02 and 0.04 mmol/l). Mean ± SD delay was 7.1 ± 5.5 min for the microdialysis sensor (P < 0.001). MAD was 15.0% for the needle-type sensor and 13.6% for the microdialysis sensor (P = 0.013). After correction for the 7-min delay, the microdialysis MAD improved to 11.7% (P < 0.0001). CONCLUSIONSThe microdialysis sensor was more accurate than the needle-type sensor, with or without correction for a 7-min delay. In contrast to the previous version, the current needle-type sensor did not exhibit nocturnal hypoglycemic drift. Continuous subcutaneous glucose sensors are valuable adjunctive tools for glucose trend analyses. However, considering the large MADs, individual sensor values should be interpreted with caution.
Abbreviations: CG-EGA, continuous glucoseerror grid analysis EGA, error grid analysis MAD, mean absolute difference SMBG, self-measured blood glucose
Continuous glucose sensors have the potential to revolutionize diabetes treatment. Two subcutaneous glucose sensors have been marketed: the needle-type CGMSgold sensor (Medtronic MiniMed, Sylmar, CA) and the microdialysis-based GlucoDay sensor (Menarini Diagnostics, Firenze, Italy). The accuracy of each sensor has been compared with a standard (14), but a direct comparison of both sensors is lacking so far. Previous studies have demonstrated a nocturnal drift into the hypoglycemic area for an earlier version of the CGMSgold, the CGMS, but this issue has not been investigated with the CGMSgold (5,6). For the microdialysis monitor, the exact instrument-related time lag has not been established in vivo. This value is especially important when a microdialysis system is being used online as a hypoglycemia alarm. The aim of this study was to examine the reliability of the two sensors in type 1 diabetic patients during the night and during rapid glucose excursions, with special interest in the hypothesized nocturnal hypoglycemic drift of the needle-type sensor and the delay during rapid glucose changes of the microdialysis sensor.
The study was approved by the local ethics committee, and participants gave written informed consent. Thirteen type 1 diabetic patients (9 men) were enrolled. HbA1c was 8.2 ± 0.8% (mean ± SD), BMI was 23.8 ± 3.0 kg/m2, age was 34.3 ± 10.7 years, and diabetes duration was 17.2 ± 9.5 years. Exclusion criteria were BMI >30 kg/m2; heparin, oral anticoagulant, or corticosteroid use; and skin conditions prohibiting needle insertion.
Continuous subcutaneous glucose sensors
Study protocol The microdialysis sensor was inserted using a Vialon catheter (Insyte). A nylon tube was conducted through the catheter while taking care that both ends of the microdialysis fiber remained visible above the skin. The catheter was removed, and the nylon tube was linked to the sensor and a pump-containing device. Together with two plastic bags containing perfusion buffer and waste product, respectively, the apparatus was carried in a pouch on a belt. The needle-type sensor was inserted using a dedicated spring system (SenSerter; MiniMed). The patient was instructed to enter the first SMBG after 1 h and to perform an extra calibration if the alarm went off. Furthermore, the patient was asked to note every glucose measurement with the corresponding time as seen in both sensor displays and the patients watch, all synchronized with the clock in the clinical trial unit. Thereafter, the patient resumed normal daily activities. At 9:00 P.M. the patient returned to the clinical trial unit. An intravenous catheter was inserted in one arm for blood sampling two times per hour in sodium fluoride tubes. Sampling started at 10:00 P.M. and continued until 8.00 A.M. the next morning. At bedtime, the patient entered another SMBG value into the needle-type sensor. Blood samples were centrifuged immediately at 4°C with 3,000 rpm during 10 min. Plasma (500 µl) was stored at 4°C. The next morning all samples were determined in one run using the HK/G-6PD method (Roche/Hitachi). Sleep disturbance was avoided as much as possible. At 8.00 A.M., the patient performed another calibration for the needle-type sensor. The usual morning insulin injection was postponed, and the patient received a standard breakfast. At 8:30 A.M., an increased rapid-acting insulin analog dose aiming to produce minor hypoglycemia was injected subcutaneously in the thigh. The mean increase compared with the usual morning dose was 5 units. To make sure glucose peak and nadir were recorded and to acquire a set of measurements during a rapid increase and fall in glucose values, sampling frequency increased as illustrated in Fig. 1 (10). At the end of the experiment, the patient performed a final calibration to insert into the needle-type sensor after which both sensors and the intravenous catheter were removed. To ensure optimal comparison with the needle-type sensor, the microdialysis sensor was calibrated concomitantly with the needle-type sensor, using the same three SMBG values.
Statistical analysis Curve fitting. For each patient, morning ( 7:00 A.M.10:30 A.M.) and night ( 10:00 P.M.7:00 A.M.) periods were analyzed separately. Each analysis consisted of two parts. In the first part, each glucose time curve was fitted separately using least-squares regression and natural splines with knots at equal time intervals, with S-Plus software (Fig. 2AD) (11). The intervals were generally 30 min but were 1 h for blood glucose measurements at night. Sometimes the intervals were chosen to be shorter or longer, either because of the sparseness of data or to obtain a better fit. The main outcome of this analysis is the measurement SD for each method, derived from the deviations of the measured glucose values from the fitted values. Measurement SD describes how well the fitted curves overlie the actual measurements. Assuming a good fit, which was always aimed for by an optimal choice of the knot intervals, the measurement SD can also be interpreted as a measure of precision or repeatability of the measurement method (sensor or blood glucose). In the second part, the two sensor curves were assumed to have the same shape as the blood glucose curve, again modeled by natural splines at the same knots for blood glucose, but allowing for a possible horizontal and vertical shift away from the blood glucose curve (Fig. 2EH). This so-called combined fit resulted in a horizontal and vertical shift for both sensors. Vertical and horizontal shifts are the result of shifting the sensor curves across the vertical and horizontal axes, respectively, until they overlie the blood glucose curve as much as possible and indicate drift and delay, respectively.
Paired samples analyses: mean absolute difference, Clarke error grid, and Bland-Altman analysis. For each sensor, all paired samples were pooled and a mean absolute difference (MAD) [(sensor value blood glucose)/blood glucose] was calculated. Nighttime blood glucose measurements were coupled to a concomitant or nearest next sensor value. The high blood glucose sampling frequency in the morning allowed us to use a linearly interpolated blood glucose value to be matched to each reported sensor value for MAD calculation. The samples that were matched for calculation of the MAD were also used to determine sensitivity and positive and negative predictive values for hypoglycemic, normoglycemic, and hyperglycemic values for both monitors.
Paired readings were plotted in a Clarke error grid (12). This grid is divided into five zones. Zones A and B represent values that are clinically acceptable: zone A represents values that differ We calculated the number of paired values in each zone of the Clarke error grid using SPSS version 11.5. By using a purpose-built syntax adapted from Clarke et al., problems as previously reported with definition of the "upper A-line" were avoided (13). In addition to the Clarke error grid analysis (EGA), the recent continuous glucoseerror grid analysis (CG-EGA) was applied. This new method allows evaluation of both point and rate accuracy of the sensor readings compared with blood glucose values (14). Sensor readings are regarded as clinically accurate when they fall into the A and the B zones of both the point and the rate error grid. Clinically benign errors are those with acceptable point accuracy (A or B zones in the point-EGA) and significant errors in rate accuracy (C, D, or E zones in the rate-EGA), which are unlikely to have clinically negative, therapeutic consequences (14). Finally, the differences between sensor readings and blood glucose measurements were plotted against the average of the blood glucose and sensor measurements in a Bland-Altman plot to evaluate variations in accuracy over the range of measured glucose concentrations (15,16).
In the first patient, the needle-type sensor measurement stagnated in the morning because the evening calibration had erroneously been omitted. Therefore, from this patient we could only analyze the nighttime glucose measurements. Otherwise, there were no recording failures. In the second patient, 38% of the nighttime blood glucose values were lost due to coagulation inside the tube after collection. Six of 13 microdialysis sensor measurements were done with two rather than three calibrations, because stability in blood glucose, required for calibration of this monitor, was not reached at the end of the experiment.
Curve fitting The combined morning and night vertical shift was 0.04 ± 0.87 (mean ± SD) mmol/l (one-sample t test, P = 0.89) for the needle-type sensor and 0.02 ± 0.82 mmol/l (P = 0.95) for the microdialysis sensor, with the minus sign indicating an overall lower value. Morning vertical shift was 0.20 ± 1.37 mmol/l in the needle-type sensor and 0.28 ± 1.05 mmol/l in the microdialysis sensor. Nighttime vertical shift was 0.30 ± 1.08 mmol/l in the needle-type sensor and 0.25 ± 0.97 mmol/l in the microdialysis sensor. For both sensors, there was no evidence that the vertical shift, indicating the drift, differed between morning and night (Wilcoxons signed-rank test: needle-type sensor P = 0.28, microdialysis sensor P = 0.23).
Delay.
MAD, hypoglycemia detection, Clarke EGA, CG-EGA, and Bland-Altman analyses
A separate MAD calculation per glucose range for the needle-type, microdialysis, and corrected microdialysis sensors resulted in an MAD in the hypoglycemic range ( Positive predictive values for hypoglycemic values were 56.9% for the needle-type sensor and 68.2% for the microdialysis sensor. Negative predictive values were 96.2% for the needle-type sensor and 98.1% for the microdialysis sensor. Sensitivity and specificity for detecting hypoglycemic blood glucose values were 55.9 and 96.3%, respectively, for the needle-type sensor and 75.0 and 97.4%, respectively, for the microdialysis sensor. Sensitivity for detecting normoglycemic blood glucose values was the same for both sensors (84.8%). During hyperglycemia, sensitivity was 84.7 and 90.1% for the needle-type and microdialysis sensors, respectively. Clarke EGA for needle-type and microdialysis sensors indicated that 72.4% (range 25.096.6%) and 76.0% (52.898.0%) of the paired values were in zone A, 24.4% (058.1%) and 22.3% (2.047.2%) were in zone B, 0 and 0.1% (01.0%) were in zone C, and 4.1% (032.1%) and 1.5% (010.6%) were in zone D. No readings fell in zone E. According to the CG-EGA analysis, both sensors showed no difference in accuracy. The percentages of the needle-type and microdialysis sensor readings that were clinically accurate or resulted in benign errors were 60.0% (60.0% accurate and 0% benign) and 57.2% (57.2% accurate and 0% benign), respectively, at hypoglycemia, 100% (95.8% accurate and 4.2% benign) and 100% (98.1% accurate and 1.9% benign), respectively, at normoglycemia, and 97.6% (95.2% accurate and 2.4% benign) and 97.8% (93.4% accurate and 4.4% benign), respectively, at hyperglycemia. The Bland-Altman plot (Fig. 3) showed that sensor and blood glucose measurements differed considerably and that during hypoglycemia especially, needle-type sensor readings exhibited a more pronounced decline in accuracy than microdialysis sensor readings. This finding corresponds with the substantial difference between the separately calculated MADs in the hypoglycemic range (24.1% for CGMSgold vs. 17.3% for GlucoDay).
We used both classic methods (MAD, Clarke error grid, hypoglycemia detection accuracy, and Bland-Altman analyses) and novel methods (least-squares linear regression analysis including separate and combined curve fitting and CG-EGA) to analyze sensor accuracy, both during periods of stable glycemia and during rapid but physiological glucose excursions.
According to the classic methods, the accuracy of both sensor systems was in line with previously reported values (1,2). The rapid glucose excursions in the morning apparently did not result in deteriorated accuracy for either sensor, because no significant differences were detected between the morning and nighttime vertical shift and MAD. The microdialysis sensor, especially when corrected for the 7-min delay, exceeds the needle-type sensor in accuracy (13.6% [corrected 11.7%] vs. 15.0%). Correction for the 7-min delay resulted in an As indicated by the vertical shift derived from combined curve fitting, the currently available needle-type sensor does not exhibit a nocturnal hypoglycemic drift, in contrast to the previous version. Both sensors perform similarly during the day and night, without significant differences in accuracy. The hypothesized delay for the microdialysis system has been quantified (7 min) by the horizontal shift. This delay can be corrected for retrospectively but has implications for prospective use of microdialysis systems as an alarm for hypo- or hyperglycemia. The advantage of least-squares linear regression analysis with either separate or combined curve fitting is that all measurements are used for analysis without any data exclusion as when paired samples only, such as MAD or EGA, are used. Furthermore, combined curve fitting offers an advantage over MAD and EGA by its ability to assess systematic over- or underestimation and a delay. The vertical shift suggests an almost negligible difference between needle-type and microdialysis sensors (0.04 vs. 0.02 mmol/l), whereas accuracy based on MAD was better in the microdialysis than in the needle-type sensor. This illustrates that both methods are complementary. The least-squares regression method is sensitive to systematic under- or overestimation, whereas it flattens out overestimated and underestimated glucose values. Our method to obtain a rapid rise and fall in glucose level, induced by food intake and delayed subcutaneous insulin injection in an increased dose, is a modification of a test in which insulin was injected intravenously (17). Because intravenous insulin may induce a nonphysiologically rapid decline in glucose level, we feel our method resembles real life circumstances more closely. Despite having used the same sensors and insertion sites for all patients, both sensors showed considerable interpatient variability. For example, the underestimated glucose values reported by the needle-type sensor, falling in zone D of the Clark error grid (4.1%) and corresponding points below the horizontal line in the hyperglycemic part (12.0 mmol/l) of the Bland-Altman plot (Fig. 3A), all originated from one patient. The causes of this interpatient variability need further investigation. The number of patients, i.e., 13, was limited, and the research setting was not in accordance with the daily life situation. Thus, it may not be possible to obtain data of the same quality in clinical practice. In summary, the microdialysis-based sensor exceeds the needle-type sensor in accuracy, with and without correction for a 7-min delay. The accuracy of the needle-type sensor is especially worst during hypoglycemia. The recent version of the needle-type sensor seems to have been improved with respect to the nocturnal hypoglycemic drift, which was not detected in the present study. The current continuous subcutaneous glucose sensors appear to be valuable adjunctive tools for glucose trend analyses. However, taking into account their considerable MADs, one should interpret individual sensor values with caution.
The study was financially supported by Menarini Diagnostics Benelux, Valkenburg, the Netherlands. Sensors were obtained free of charge from Medtronic MiniMed, Heerlen, the Netherlands. We acknowledge Rutger van Haaften for his valuable contribution.
J.H.D. has been a paid consultant for Menarini Diagnostics and has received honoraria for speaking engagements from Menarini Diagnostics and Medtronic MiniMed. A table elsewhere in this issue shows conventional and Système International (SI) units and conversion factors for many substances. Received for publication June 7, 2005. Accepted for publication September 11, 2005.
This article has been cited by other articles:
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||