© 2004 by the American Diabetes Association, Inc.
Accuracy of the GlucoWatch G2 Biographer and the Continuous Glucose Monitoring System During HypoglycemiaExperience of the Diabetes Research in Children Network*The Diabetes Research in Children Network (DirecNet) Study GroupFrom the Jaeb Center for Health Research, Tampa, Florida
OBJECTIVEThe goal of this study was to assess the accuracy of the GlucoWatch G2 Biographer (GW2B) and the continuous glucose monitoring system (CGMS) during hypoglycemia in children and adolescents with type 1 diabetes.
RESEARCH DESIGN AND METHODSDuring a 24-h clinical research center stay, 91 children and adolescents with type 1 diabetes (aged 3.517.7 years) wore one or two CGMSs, and 89 of these subjects wore one or two GW2Bs. Frequent serum glucose determinations were made during the day, overnight, and during insulin-induced hypoglycemia resulting in 192 GW2B reference pairs and 401 CGMS reference pairs during hypoglycemia (reference glucose RESULTSDuring hypoglycemia, the median absolute difference between the 192 GW2B reference glucose pairs was 26 mg/dl and between the 401 CGMS reference glucose pairs was 19 mg/dl with 31 and 42%, respectively, of the sensor values within 15 mg/dl of the reference glucose. Sensitivity to detect hypoglycemia when the GW2B alarm level was set to 60 mg/dl was 23% with a false-alarm rate of 51%. Analyses suggested that modified CGMS sensors that became available in November 2002 might be more accurate than the original CGMS sensors (median absolute difference 15 vs. 20 mg/dl). CONCLUSIONSThese data show that the GW2B and the CGMS do not reliably detect hypoglycemia. Both of these devices perform better at higher glucose levels, suggesting they may be more useful in reducing HbA1c levels than in detecting hypoglycemia.
Abbreviations: CGMS, continuous glucose monitoring system CRC, clinical research center DirecNet, Diabetes Research in Children Network GW2B, GlucoWatch G2 Biographer
Hypoglycemia remains a major obstacle to successful treatment of type 1 diabetes, especially in children. In adolescents with type 1 diabetes, the risk of severe hypoglycemia is greatly increased compared with adults, regardless of the intensity of treatment (1). In young children with type 1 diabetes, there are heightened concerns that hypoglycemia will cause permanent neurologic sequelae (2,3). Across all age-groups, the possibility of a severe hypoglycemic event occurring at school, at play, or at night is one of the greatest fears of patients and parents alike (4). The introduction of near-continuous glucose monitors represents a technologic advance that may be particularly useful in the management of youth with type 1 diabetes. Two such devices are currently FDA approved: the GlucoWatch G2 Biographer (GW2B) (Cygnus, Redwood City, CA), which provides real-time measurements of interstitial glucose concentrations at 10-min intervals, and the continuous glucose monitoring system (CGMS) (Medtronic MiniMed, Northridge, CA), which stores glucose values obtained every 5 min for a retrospective review. The GW2B is equipped with an alarm to signal hypoglycemia and pending hypoglycemia as well as hyperglycemia. The accuracy of the GW2B has been reported in several studies (510), but data in children are limited (11), and prior studies have not systematically evaluated sensor function during acute hypoglycemia. There have been several reports of frequent and prolonged hypoglycemia during the night when using the CGMS (1215). However, recent studies have raised questions regarding the accuracy and reproducibility of the CGMS (1517). The purpose of this study is to report the accuracy of the CGMS and GW2B during hypoglycemia occurring either spontaneously or during an insulin-induced hypoglycemia test in children with type 1 diabetes.
The study was conducted by the Diabetes Research in Children Network (DirecNet). The study protocol, statistical methods, and informed consent procedures have been described in prior publications (18,19) and are briefly summarized herein. The major eligibility criteria for the subjects included age 118 years, a clinical diagnosis of type 1 diabetes, and insulin therapy (either a pump or injections) for at least 1 year. Each subject used the GW2B and CGMS during a 24-h clinical research center (CRC) admission. To assess CGMS function over the entire 72 h of its life span, one-third of the subjects had the CGMS inserted 48 h before admission, one-third 24 h before admission, and one-third on admission to the CRC. Subjects were offered the option of wearing a second CGMS during the inpatient stay. After admission to the CRC, a GW2B sensor was placed and calibrated. A second GW2B sensor was placed at a later time so that there would be a minimum 2-hour overlap between the two GW2Bs and such that at least one GW2B would be functioning for the 24 h of serum glucose measurements. A One Touch Ultra Meter (Lifescan, Milpitas, CA) was used to obtain glucose measurements for calibrating the sensors. Blood samples were obtained hourly during the day, every 30 min overnight, every 5 min for up to 90 min during an insulin-induced hypoglycemia test, and at additional times when the sensors were calibrated or if there were symptoms of hypoglycemia. Glucose measurements were made at the DirecNet Central Biochemistry Laboratory at the University of Minnesota using a hexokinase enzymatic method.
Subjects For analysis, the GW2B glucose values were adjusted for a 17.5-min lag time and matched to reference serum glucose measurements drawn within ±5 min of the sensor reading except during the insulin-induced hypoglycemia test where the matching was within ±2.5 min. The CGMS glucose values were matched to reference serum glucose measurements drawn within 2.5 min of the sensor reading after adjusting for a CGMS lag time of 2.5 min. The lag times for the GW2B and CGMS principally represent the time involved to sample the interstitial fluid and measure the glucose. Thus, the GW2B value, when it appears on the device, represents the glucose level 1520 min earlier.
The absolute difference was defined as the absolute value of sensor glucose value minus the reference glucose value. Sensitivity was defined as the percentage of reference values
Hypoglycemic episodes occurring overnight (11:00 P.M.6:00 A.M.) were defined as periods with at least two sensor glucose readings
The study included 91 subjects ranging in age from 3.5 to 17.7 (mean 9.9) years; 51% were female and 85% were Caucasian.
GW2B
Results were similar for hypoglycemic reference values compared with GW2B values obtained during the intravenous insulin test and those obtained at other times (Table 1). Among 45 subjects undergoing the intravenous insulin test, the reference glucose nadir was
For a hypoglycemia alarm setting of 60 mg/dl, GW2B sensitivity for detection of an actual serum glucose level 60 mg/dl (based on the reference glucose value) would be 23%; 51% of alarms would be false. The reference glucose was >80 mg/dl for 18% of these GW2B alarms 60 mg/dl. As can be seen in Table 2, greater sensitivity for detecting a true glucose value 60 mg/dl would be achieved by raising the alarm setting, but this is at the expense of progressively higher false-alarm rates.
During overnight monitoring (11:00 P.M.6:00 A.M.), the GW2B reported 21 hypoglycemic episodes occurring in 16 subjects. A reference glucose value was obtained during 18 of the episodes. Hypoglycemia (reference value 60 mg/dl) was confirmed in 10 (56%) of the 18 episodes. In the eight nonconfirmed episodes, the lowest reference glucose value ranged between 75 and 108 mg/dl.
CGMS
Results for hypoglycemia occurring during the intravenous test and at other times are presented in Table 1 for the original and modified sensors. During the intravenous insulin test, the reference glucose nadir was
Because the CGMS is retrospectively calibrated, real-time sensitivity for detection of hypoglycemia cannot be assessed. However, we evaluated the data as if the same level of accuracy would be present with prospective calibration. For an alarm setting of 60 mg/dl, the sensor sensitivity for detection of a glucose level
During overnight monitoring (11:00 P.M.6:00 A.M.), the CGMS reported 30 hypoglycemic episodes (as defined in RESEARCH DESIGN AND METHODS) occurring in 25 subjects with original sensors and four episodes in 4 subjects with modified sensors. For 26 of the episodes with the original sensors and for three of the episodes with a modified sensor, a reference glucose value was obtained during the episode. Hypoglycemia (reference value
This study was designed to evaluate the accuracy of the GW2B and CGMS in children and adolescents with type 1 diabetes. Because a critically important function of these sensors is in the detection and prevention of hypoglycemia, the current report focuses on performance of the devices during both induced and spontaneous reductions in serum glucose concentrations. Our results demonstrate that neither the GW2B nor the CGMS is accurate with respect to reporting glucose values in the hypoglycemic range. For reference serum glucose values that were 60 mg/dl, the median absolute differences of the GW2B and the original and modified CGMS sensors were 26, 20, and 15 mg/dl, respectively, and only 31, 41, and 51% of the sensor values, respectively, were within 15 mg/dl of the reference glucose values. Additionally, reference glucose levels did not confirm a substantial fraction of the low sensor values reported by both systems. As we have reported in detail elsewhere (18,19), the accuracy of the GW2B and the CGMS is considerably better when reference glucose levels are >100 mg/dl.
A major benefit of real-time compared with retrospective glucose sensing is the capacity to equip the system with hypoglycemia alarms. Consequently, we also explored the sensitivity and specificity of a range of alarm settings for the detection of hypoglycemia using the GW2B and reference serum glucose values. However, it must be remembered that the glucose value appearing on the device is estimating the serum glucose level 1520 min earlier. As indicated in Table 2, the GW2B alarm would have to be set at 120 mg/dl to capture at least 90% of actual serum glucose concentrations that were The CGMS does not provide data in real time: glucose values are calculated using calibration values from both before and after the glucose sampling. Nevertheless, we evaluated how well the CGMS would alarm for hypoglycemia under the assumption that the accuracy would be similar in real time. It is likely that accuracy would be lower with prospective calibration, so these results should be considered to be the best-case scenario for the CGMS. Similar to our findings with the GW2B, sensitivity was relatively low with an alarm setting of 60 mg/dl, although better with the modified sensors than with the original sensors. As with the GW2B, setting a higher alarm setting increased sensitivity but at the expense of a high false-alarm rate. For hypoglycemic episodes detected overnight by the original CGMS sensors, only 8 of 26 were confirmed by a reference serum glucose obtained during the episode. Although there were only three nocturnal episodes of hypoglycemia with the new sensors, all were confirmed by the reference glucose measurements. Several studies that have used the original CGMS sensors to evaluate metabolic control in children and adolescents with type 1 diabetes have reported an unexpectedly high incidence of asymptomatic hypoglycemia, especially at night (1214). McGowan et al. (15) recently examined CGMS function at night in seven children with type 1 diabetes. In that study, four of five nocturnal hypoglycemic episodes that were detected by the CGMS could not be verified by reference glucose measurements. Guerci reported the CGMSs sensitivity to detect hypoglycemia to be 33% (similar to what we found using original sensors) (21). Our data support the contention that previous clinical studies using the CGMS in children with type 1 diabetes overestimated the true incidence of hypoglycemia. Because the GW2B and CGMS are more accurate in sensing high versus low glucose values, (18,19) the systems are likely to be of value in adjusting bolus and basal insulin doses in individuals with elevated HbA1c levels. For the GW2B, the accuracy for low glucose values limits the feasibility of its alarm function. Whereas some users will accept a high false-alarm rate to detect a high proportion of low glucose values, many will not. Thus, for many users, the greatest value of the GW2B may be for detecting trends and not for serving as a sentinel for hypoglycemia. The accuracy of this early generation of glucose sensors is reminiscent of the early generations of glucose meters, which were less accurate than those currently available. Therefore, an expectation exists that future generations of sensors will have improved accuracy resulting in greater use for the detection of hypoglycemia.
Writing Committee Eva Tsalikian, MD; Roy W. Beck, MD, PhD; William V. Tamborlane, MD; H. Peter Chase, MD; Bruce A. Buckingham, MD; Stuart A. Weinzimer, MD; Nelly Mauras, MD; Katrina J. Ruedy, MSPH; Craig Kollman, PhD; and Dongyuan Xing, MPH.
The DirecNet Study Group
Coordinating center.
Data and Safety Monitoring Board.
University of Minnesota Central Laboratory.
National Institutes of Health.
Appreciation is expressed for the work also performed by the CRC nurses at the five clinical centers.
Address correspondence and reprint requests to Eva Tsalikian, MD, c/o DirecNet Coordinating Center, Jaeb Center for Health Research, 15310 Amberly Dr., Suite 350, Tampa, FL 33647. E-mail: direcnet{at}jaeb.org. Received for publication 3 September 2003 and accepted in revised form 11 November 2003. *A complete list of the DirecNet Study Group appears in the APPENDIX. B.A.B. has received honorarium from Medtronic MiniMed and research support from Medtronic MiniMed and Cygnus. D.M.W. has received consulting fees and research support from and serves as an advisor to Lifescan and MiniMed. J.M.B. is the president elect of the Santa Clara County Chapter of the American Association of Diabetes Educators and as such has attended meetings and dinners sponsored by Lifescan, Medtronic MiniMed, and other such companies; is a paid speaker for Lifescan; was a paid research subject for Cygnus; was a paid consultant for Medtronic MiniMed; and has a consultant agreement with Therasense. E.L.K. was a paid consultant for Medtronic-Minimed; was employed as a research study assistant by Cygnus; and received a stipend for participating in a study for Cygnus. W.V.T. is on the advisory board at and received honorarium and grant support from Medtronic MiniMed. E.A.D. has received honorarium from Medtronic MiniMed. A table elsewhere in this issue shows conventional and Système International (SI) units and conversion factors for many substances. See accompanying editorial, p. 834.
This article has been cited by other articles:
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||