Sensitivity and Specificity of Death Certificates for Diabetes

As good as it gets?

  1. W. Susan Cheng, MPH1,
  2. Deborah L. Wingard, PHD2,
  3. Donna Kritz-Silverstein, PHD2 and
  4. Elizabeth Barrett-Connor, MD2
  1. 1Joint Doctoral Program, University of California, San Diego, San Diego State University, San Diego, California
  2. 2University of California, San Diego, Family and Preventive Medicine
  1. Address correspondence and reprint requests to Deborah Wingard, PhD, University of California, San Diego, Family & Preventive Medicine, 9500 Gilman Dr., La Jolla, CA 92093-0607. E-mail: dwingard{at}ucsd.edu

Abstract

OBJECTIVE—Diabetes is the sixth leading cause of death in U.S adults, which may be an underestimate because of under-reporting on death certificates. In this study we examined death certificate sensitivity and specificity for diabetes, as well as the factors related to better reporting, in a community-based sample.

RESEARCH DESIGN AND METHODS—Death certificates were obtained for 3,209 decedents who were enrolled in the Rancho Bernardo cohort in 1972–1974 and followed through 2003. Diabetes status was reassessed at periodic clinic visits and annual mailed surveys during an average follow-up of 15.2 ± 7.6 years. Diabetes reported anywhere on death certificates was abstracted. Sensitivity and specificity calculations among diabetic participants were stratified by age, sex, year, place, cause of death, and diabetes medication use.

RESULTS—Among 1,641 men and 1,568 women, 378 decedents had a history of diabetes, 168 of whom had diabetes listed anywhere on their death certificates. The sensitivity and specificity were 34.7 and 98.1%. Diabetes reporting on death certificates did not improve over time or vary significantly by age and sex, but sensitivity for diabetes reporting was better for recent (1992–2003) cardiovascular disease (CVD) deaths compared with any other causes of death (48.9 vs. 28.6%, respectively, P < 0.05).

CONCLUSIONS—Although diabetes reporting on death certificates did not improve over time, sensitivity was better for diabetes in the context of CVD deaths, probably reflecting the increasing recognition that diabetes is a major cardiovascular risk factor.

The National Center for Health Statistics rates diabetes as the sixth major cause of death in the U.S. (1,2). However, this may be an underestimate. The American Diabetes Association reported that diabetes is listed anywhere on the death certificate less than half the time and is listed as the underlying cause of death <20% of the time (3). Several factors may contribute to this under-reporting: immediate cause of death masking contributing diseases (4,5), differences between physicians and others in reporting direct and contributing causes on death certificates (69), inaccuracy or variability in criteria for diagnosing diabetes, lack of training in completing death certificates (10,11), and variations in the perception of importance of contributing diseases to the final cause of death (7,12). Because mortality data are frequently used to estimate the burden or cost of disease and needed policy changes, it is important to examine factors related to the validity of diabetes reporting on death certificates.

The few previous longitudinal studies of diabetes reporting on death certificates were conducted in foreign countries, making comparisons with U.S. data difficult (1316), were based on data collected before 1994 (17,18), or were from diabetic populations only (4). In these studies the correct reporting of diabetes on death certificates ranged from 35 to 65%. To our knowledge, the only studies examining whether diabetes reporting on death certificates has improved in the last decade have been restricted to diabetic patients (19,20), for whom the known diabetes status may be a bias toward better reporting on death certificates. Three national studies examining the reporting of diabetes on death certificates using interviews from the decedents’ kin (21,22) or medical history abstraction of diabetes (23) lacked direct access to decedents and were vulnerable to misclassification of diabetes status. Two other U.S. studies relied upon last known physician of the decedent to ascertain diabetes status (4,24), potentially missing earlier diagnoses, or biasing diabetes reporting by oversampling those with higher comorbidity or disease severity. In the present study we examined the changes and determinants of accurate reporting as assessed by the sensitivity and specificity of diabetes on death certificates in a population-based sample whose vital status was ascertained over 32 years.

RESEARCH DESIGN AND METHODS—

Between 1972 and 1974 all adults residing in the middle-class community of Rancho Bernardo, California, were invited to participate in a study of cardiovascular risk factors. A total of 6,339 men and women, representing 82% of all adult residents, were enrolled. Participants were followed since then with yearly mailed questionnaires and periodic clinic visits (25). In 1984–1987, all participants aged ≥40 years were invited to participate in a follow-up visit focused on diabetes; 85% of the eligible men and 78% of the women participated (26). Follow-up clinic visits in 1992–1996 and 1997–1999 also focused on diabetes. Questionnaires requesting information including diagnosis of diabetes were mailed in 1982, 1988, 1993, 1996, and 1998. Cumulative follow-up information from clinic visits and mailed surveys was available before death for >99% of all decedents (<1 year since last follow-up at death).

Vital status was known for 99% of the original cohort through the end of 2003. Death certificates were obtained for 3,209 decedents who died before the end of 2003. This study was approved by the Institutional Review Board of the University of California, San Diego; written informed consent was obtained at all clinic visits.

At each clinic visit and on mailed questionnaires, participants were asked whether they had ever been told by a physician that they had diabetes and whether they had any history of diabetes medication use. During each clinic visit, current medication use, including medications for diabetes, was verified by examination of pills and prescriptions brought to the clinic for that purpose. Information concerning diabetes from any and all visits and/or annual mailers was used to ascertain lifetime diagnosis of diabetes. Use of diabetes medication reported at any visit or mailer was used as a marker for more severe diabetes, which might be more likely to be reported on a death certificate.

Death certificates were coded by a nosologist using ICD-9 criteria. Individuals were identified as having diabetes if the disease was listed anywhere on the death certificate. All sections of the death certificate (underlying cause of death, contributory causes of death, contributory diseases or conditions, and consequences that led up to the underlying cause of death) were examined for mention of diabetes (ICD-9 code 250) and related conditions (e.g., hypoglycemia [251.1 and 251.2], neuropathy in diabetes [357.2], diabetic retinopathy [362.0], diabetic cataract [366.41], or abnormal glucose in diabetes [648.8]).

Variables potentially affecting the accuracy of reporting were abstracted from death certificates and from data collected at clinic visits and mailed questionnaires. Dates of birth and baseline clinic visits and sex were recorded. Date and place of death (home, hospital, or other) and underlying cause of death (diabetes [ICD-9 250], cardiovascular disease [CVD] [ICD9: 390–459], malignancy [ICD9: 179–208], external cause [ICD: 905–909], or other causes of death) were obtained from death certificates.

Statistical analysis

Before and after stratification by diabetes status means and standard deviations were calculated for age variables; rates were calculated for categorical variables. Differences between decedents with and without known diabetes were examined using ANOVA and independent t tests. Sensitivity and specificity were calculated for diabetes listed as the underlying cause of death and, separately, for diabetes listed anywhere on the death certificate. Calculations of sensitivity and specificity were also stratified by sex, age at death in quartiles (<76, 77–82, 83–88, and ≥89 years), cause of death (CVD versus all other causes), place of death (home, hospital, or other), decade of death starting from 1972, and inclusion of use of medication with diagnosis of diabetes. Differences in sensitivity and specificity were examined with z tests for binomial proportions.

Univariate and multivariate logistic regression analyses of data from 378 men and women with diabetes were used to assess potential variables that contributed to diabetes being reported or not reported on the death certificate. This subset included 322 men and women who reported a diagnosis of diabetes at a clinic visit or on a mailed questionnaire plus 56 men and women who had not reported a diagnosis of diabetes during follow-up, but who had diabetes listed anywhere on the death certificate. Variables significantly contributing to univariate logistic regression models (P < 0.10) were used to construct multivariate models predicting diabetes listed on death certificates by age, cause of death, sex, place of death, and/or use of diabetes medication. Potential effect modification of sex or year of death with cause, place, or age at death was examined by creating and testing interaction terms in the multivariate models. Data were examined using age and year of death as continuous and categorical variables. Analyses were performed with SAS statistical software (version 8.1; SAS Institute, Cary, NC); all statistical tests were two-tailed.

RESULTS—

This study examined 3,209 death certificates (>99%) from Rancho Bernardo Study participants who died between 1972 and 2003. As shown in Table 1, mean ± SD age at enrollment was 64.3 ± 8.9 years, and the age at death was 81.9 ± 9.6 years. A total of 322 decedents (10%) had known diabetes based on physician diagnosis or diabetes-specific medication use; of these 139 reported no use of diabetes medication. Approximately equal numbers of men and women (51.1 and. 48.9%, respectively, P > 0.10) had died. Major causes of death were CVD and cancer (41.3 and 23.1%, respectively); two-thirds (66.9%) died in a hospital. Also shown in Table 1, there was a greater percentage of men among those with diabetes than among those without diabetes (60.6 vs. 50.1%, P < 0.05). Those with known diabetes were on average slightly younger at enrollment than those without known diabetes (aged 64.2 vs. 65.4 years, respectively, P < 0.05) and had higher cancer rates (23.8 vs. 17.4%, P < 0.05).

Of the 322 individuals with known diabetes, diabetes was listed as the primary cause of death for only 20 (6%); an additional 92 (29%) had diabetes listed elsewhere on their death certificates (sensitivity). From those individuals with no known history of diabetes or use of medications, 56 individuals had diabetes listed on their death certificates (specificity). As shown in Table 2, the overall sensitivity and specificity of reporting diabetes anywhere on the death certificate were 34.7 and 98.1%, respectively. The sensitivity and specificity for reporting diabetes as the underlying cause of death on the death certificate were 6.2 and 99.8%, respectively.

Table 2 also shows the sensitivity and specificity of diabetes reporting on the death certificate after stratifying by age, sex, cause of death, place and year of death, and diabetes medication use. CVD deaths had greater sensitivity compared with death by all other causes (39.4 vs. 22.5%, P < 0.05). Diabetes sensitivity was better for those who died in hospitals or at home versus other locales but still poor (35.8 and 37.1 vs. 26.3%, P < 0.05). Additionally, sensitivity for diabetes reported on the death certificate was significantly better among diabetic adults using medication for diabetes compared with those not using medication (48.6 vs. 16.6%, P < 0.05). Comparisons by decade of death showed greater sensitivity for deaths in 1972–1981 versus more recent deaths (P < 0.05), although no discernible trends were apparent when death was categorized by decade (data not shown). There were no other significant differences in sensitivity or specificity by sex or age.

Figure 1 shows the sensitivity of diabetes reporting for those who died of CVD compared with all other causes of death after stratification by decade of death. As shown, sensitivity for reporting diabetes in 1992–2003 for CVD-related deaths was significantly better than the sensitivity for all other causes of death (48.9 vs. 26.8%, P < 0.05).

Table 3 presents the association of age, sex, and other characteristics with likelihood of diabetes being reported on death certificates among adults with known diabetes or those with diabetes listed anywhere on the death certificate. Those who used diabetes medications were nearly five times (odds ratio 4.78 95% CI 2.80–8.14) more likely to have diabetes listed on the death certificate than diabetic decedents with no reported diabetes medication use. No other characteristic significantly improved reporting of diabetes on death certificates. Multivariate models examining the combined effects of diagnostic method, sex, and cause, place, age, and year of death does not materially change the observed univariate associations. Interactions of sex, age, decade, cause of death, or follow-up time with diabetes status did not significantly affect the likelihood of reporting diabetes (P > 0.05; data not shown).

CONCLUSIONS—

Previous mortality studies indicated that diabetes is under-reported as a direct cause of death and often is not mentioned anywhere on death certificates (4,5,19,21,22,2731). The present study shows that, among those with known diabetes, overall sensitivity was low (34.7%), but specificity of diabetes reporting was good (98.1%). Diabetes was listed as a direct or contributing cause of death on only 6.2% of death certificates for adults who had known diabetes; specificity was excellent at 99.8%. Compared with nondiabetic adults, the proportion of CVD deaths was higher in diabetic participants, and diabetes reporting was better among those dying of CVD. Additionally, sensitivity for diabetes reporting was higher among hospital deaths and for participants using diabetes-specific medications. Sensitivity did not vary significantly by year or age of death. Greater sensitivity for diabetes reporting was noted when CVD was listed as the cause of death, but only for deaths occurring between 1992 and 2003. This finding may reflect increased awareness of the important association of diabetes with CVD, leading to increased reporting of diabetes as a contributing cause of death among patients with fatal CVD or this may reflect the documented contribution of diabetes toward CVD incidence or mortality. Further, good medical practice now requires that patients hospitalized for CVD be evaluated for diabetes.

Other U.S. studies have also reported poor death certificate sensitivity for diabetes (4,17,18,20,23,32) and documented the resultant bias when mortality data are used to estimate the burden of diabetes in the population. The present study, which is the only longitudinal study to include data from the last decade, shows no improvement of overall diabetes reporting on death certificates. All other U.S. population–based studies were based on data collected before 1992 or small samples (n = <550) and had sensitivity ranging from 35 to 54% (17,2023,27).

In the present study, there was no significant sex difference in sensitivity or specificity. In contrast, two other studies reported somewhat better sensitivity in men (23,28). Better sensitivity was reported in studies with smaller (n = <550) sample sizes (4,14,16,19,20,24,27,28,31) and limited to patients with diabetes (4,14,16,19,31). Studies outside the U.S. tended to report higher sensitivity (51–70%), but differences in diabetes diagnostic criteria and procedures for completion of death certificates make comparisons difficult (13,14,16,28,31,33,34).

In this study we also assessed whether sensitivity improved between 1972 and 2003, with the increasing awareness of the association between CVD and diabetes. Given the significant contribution of diabetes to both the incidence of CVD and mortality (14,16,32,35,36), it is reasonable to expect improved reporting of diabetes for CVD versus all-cause mortality in the last decade, evidenced by the observed improvement in diabetes reporting among those dying of CVD in the third decade of our study. However, the lack of statistical significance argues for conservative interpretation of this observation; consistent with other studies, this study also showed that the overall sensitivity of diabetes reporting did not improve over time (22).

Several factors may decrease diabetes reporting on death certificates (12). Because diabetes is often not the direct cause of death but a major contributing or underlying cause, it may not be mentioned on the death certificate. Differences between physicians with regard to ranking diseases leading up to death may account for some of the variability in diabetes reporting on death certificates (68,37,38). Lack of accurate medical data on decedents may lead to under-reporting of diabetes. Differences in diagnostic criteria for diabetes may account for additional variability in diabetes reporting. Although decedents may have had glucose tolerance tests suggesting hyperinsulinemia or hyperglycemia, physicians may have been reluctant to diagnose diabetes if the condition was controlled without medication.

Plasma glucose measures, available for most participants were not included because the objective was to examine the validity of death certificates in identifying known diabetes status, which is a conservative measure of the underestimation by mortality data. Single episodes of hyperglycemia observed in a research clinic (although reported to participants) may not parallel participant or physician awareness of diabetes status or be confirmed by repeat testing. The presumed best scenario for diabetes on the death certificate would occur if both the patient and doctor knew that the patient had diabetes. Analyses based on glucose levels identified sensitivity of 25% based on World Health Organization guidelines (data not shown).

Several strengths and limitations of this study were considered. For this longitudinal study we had access to participant data from enrollment until death and, therefore, had direct, participant-provided ascertainment of diabetes status. The high specificity rates (>95%) reflect the strength of this study with multiple points of data ascertainment. Several other death certificate studies based diabetes diagnosis on proxy reports from spouses or relatives (19,21,22). Information on diabetes status collected from the surrogates is expected to increase misclassification; medication use served as a confirmation of diabetes diagnosis. Participants in the Rancho Bernardo Study are almost entirely white, relatively well educated and middle to upper middle class, with good access to medical care. Although results from this study may not be generalizable to other populations, they are similar to those from other U.S.-based studies (17,18,21,22). Thus, self-reported physician diagnosis of diabetes was likely reliable.

In conclusion, the overall sensitivity of diabetes on death certificates in this study was only 35%, with no evidence of overall temporal improvement in diabetes reporting on the death certificate. Only within the last decade has reporting improved for those whose death was attributed to CVD. Medication use among diabetic decedents was the only other significant determinant of better diabetes reporting, likely reflecting greater severity of diabetes and greater awareness of the physician and the patient. The persistent under-reporting of diabetes on death certificates underestimates the burden of the disease and the influence of diabetes on death rates. Future studies should be focused on examining the effect of duration of disease, different diagnostic criteria, and more diverse populations on diabetes reporting on death certificates. Improved education on the completion of death certificates is recommended.

Figure 1—

Sensitivity of recording of diabetes on death certificates by cause of death stratified by decade of death: the Rancho Bernardo Study, 1972–2003. *Significant difference in diabetes sensitivity (P < 0.05) between those dying from CVD (□) vs. all other causes of death (▪) from 1992 to 2003. 1972–1981, 42.9% CVD, n = 714; 1982–1991, 42.5% CVD, n = 1,324; 1992–2003, 38.9% CVD, n = 1,171.

Table 1—

Descriptive characteristics of decedents with and without known diabetes: Rancho Bernardo Study, 1972–2003

Table 2—

Comparisons of sensitivity and specificity of death certificates in reporting diabetes after stratification by characteristics: the Rancho Bernardo Study, 1972–2003

Table 3—

Associations of characteristics with likelihood of diabetes being reported on death certificates for those with known diabetes or diabetes listed anywhere on the death certificate: Rancho Bernardo Study, 1972–2003

Acknowledgments

This work was supported by the National Institute of Diabetes and Digestive and Kidney Disorders (research grant DK-31801) and by the National Institute of Aging (Grant AG-07181).

We thank Ricki Bettencourt for her invaluable support.

Footnotes

  • Published ahead of print at http://care.diabetesjournals.org on 24 October 2007. DOI: 10.2337/dc07-1327.

    The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked “advertisement” in accordance with 18 U.S.C Section 1734 solely to indicate this fact.

    • Accepted October 18, 2007.
    • Received July 10, 2007.

References

| Table of Contents

This Article

  1. Diabetes Care vol. 31 no. 2 279-284
  1. All Versions of this Article:
    1. dc07-1327v1
    2. 31/2/279 most recent