Diabetes Care 30:2199-2204, 2007 DOI: 10.2337/dc06-2042 © 2007 by the American Diabetes Association
Development and Validation of a New Measure to Evaluate Psychological Resistance to Insulin Treatment
1 Department for Psychosomatic Medicine and Psychotherapy, LWL-Clinic Dortmund/Ruhr-University of Bochum, Dortmund, Germany Address correspondence and reprint requests to Dr. Frank Petrak, LWL-Klinik Dortmund/Ruhr-Universität Bochum, c/o Schulberg 7-9, 65183 Wiesbaden, Germany. E-mail: mail{at}dr-frank-petrak.de
OBJECTIVE—To develop a psychometric questionnaire to measure psychological barriers to insulin treatment in patients with type 2 diabetes. RESEARCH DESIGN AND METHODS—Scale development was based on principal component analyses in two cross-sectional studies of insulin-naïve patients with type 2 diabetes. The structure of the questionnaire was developed in the first sample of 448 patients and subsequently cross-validated in an independent sample of 449 patients.
RESULTS—Analyses in the first sample yielded five components that accounted for 74.5% of the variance based on 14 items and led to the following subscales: fear of injection and self-testing, expectations regarding positive insulin-related outcomes, expected hardship from insulin treatment, stigmatization by insulin injections, and fear of hypoglycemia. In addition, an overall sum score of all values was calculated. The structure of the questionnaire was cross-validated in the second sample, with almost identical component loadings and an explained variance of 69.4%. An additional confirmatory factor analysis also indicated an acceptable to good model fit with root mean square error of approximation equal to 0.04 and comparative fit index equal to 0.97. Coefficients of reliability (Cronbach's CONCLUSIONS—The Barriers to Insulin Treatment Questionnaire appears to be a reliable and valid measure of psychological insulin resistance in patients with type 2 diabetes. This short instrument is easy to administer and may be used by both clinicians and researchers to assess the psychological barriers to insulin treatment.
Abbreviations: BIT, Barriers to Insulin Treatment CFA, confirmatory factor analysis CFI, comparative fit index OAD, oral antidiabetes treatment RMSEA, root mean square error of approximation
Despite the increasing body of knowledge regarding diabetes treatment (1), a majority of patients with type 2 diabetes are still in persistently poor glycemic control (2), a state that leads to higher risks of poor health outcomes (3). A variety of factors are responsible for poor glycemic control, including the inadequacy of therapeutic regimens (1) as well as various psychosocial aspects (4,5). In recent years, researchers also have focused on the reluctance of patients to take insulin and the resistance of health care providers to prescribe insulin (6). These negative attitudes toward insulin treatment contribute to unnecessarily long delays for initiating insulin treatment and, consequently, to extended periods of hyperglycemia (7,8). This so-called "psychological insulin resistance" (9) includes, among other factors, fear of injection and self-testing, hypoglycemia, and weight gain; a perceived loss of control over one's life; poor self-efficacy concerning insulin treatment; and perceived lack of positive outcomes related to insulin (9,10). To overcome these psychological barriers to insulin treatment, first it is necessary to identify these barriers in specific patients in order to decide which interventions are appropriate. Thus, a well-validated diagnostic tool may be helpful to identify specific obstacles against the initiation of insulin treatment. There are some questionnaires that measure different aspects of satisfaction with treatment or diabetes-related burdens or stress (11–17), but presently, to our knowledge, no specific measurement of the psychological barriers to insulin treatment has been created, validated, and published. This article describes the development and evaluation of the self-administered Barriers to Insulin Treatment (BIT) Questionnaire. The process is based on principal component analyses in two independent samples (n = 448 and 449, respectively). The aim of the BIT Questionnaire is to measure various aspects of psychological obstacles to insulin treatment in patients who have type 2 diabetes.
The development of the BIT Questionnaire was based on data from two independent German studies of insulin-naïve patients with type 2 diabetes. The results of the first study (sample A) formed the basis of the questionnaire development, and the dataset of the second study (sample B) was used for cross-validation of scale structure and consistency. Both studies were approved by the responsible ethical review boards, and written informed consent was obtained from all patients in the studies.
Sample A
Sample B
Psychological measures Psychological barriers to insulin treatment assessed in sample A. A pool of items, 35 regarding different attitudes toward insulin treatment, was created by an expert panel of health care professionals who were experienced in diabetes treatment based on patient interviews and current literature (9,10). The following attitudes toward insulin treatment were identified: positive feelings about the benefits of the treatment, fear of the consequences of diabetes, fear of injections, social barriers to the use of insulin, aversion to dependence on the drug, fear of insulin-related side effects, and negative feelings about one's competence to manage the insulin treatment. Each of the 35 items was presented as a statement, which the patient was asked to score using a 10-point Likert-type scale with the extreme scores labeled "completely disagree" (1) and "completely agree" (10).
Psychological barriers to insulin treatment assessed in sample B. To obtain a validated English version of the BIT Questionnaire, a linguistic validation (from German to English [U.S.]) was performed and certified by the MAPI Research Institute. This validation process included two forward translations; reconciliation; a backward translation, with review and discussion and retranslation as needed; clinician review and further changes as needed; cognitive debriefing with patients; and finalization and proofreading (20). An English and German version of the BIT Questionnaire can be found in an online appendix at http://dx.doi.org/10.2337/dc06-2042.
Statistical analysis Principal component analyses were conducted successively with the items remaining from the previous analysis until all objectives were met. The resulting components represent the subscales of the BIT Questionnaire, whose scale stability was verified in sample B. Finally, a second-order component analysis with oblique rotation was performed including the obtained components that represent the subscales of the BIT Questionnaire in order to analyze if the creation of a BIT Questionnaire sum score will be appropriate.
Using sample B data, a principal component analysis with the final BIT Questionnaire items of sample A was performed. This approach allowed for a demonstrative comparison of component loadings in both independent samples before the aggregated model was tested by a confirmatory factor analysis (CFA). Following current recommendations for a CFA, we report the comparative fit index (CFI) and the root mean square error of approximation (RMSEA) (23). Indicators of a well-fitting model would be evidenced by a CFI
To replicate the test of whether the creation of a BIT Questionnaire sum score will be appropriate, we performed a second-order CFA with the components representing the subscales of the BIT Questionnaire. Pearson's correlations of all subscales were calculated to evaluate interrelations among the subscales, and Cronbach's The predictive validity of the BIT Questionnaire scales was verified by comparision of subgroups of study B in the theoretical treatment choice scenario (described above). Using t tests, we compared the scores of patients who accepted to move on to subcutaneous insulin to those patients who have been offered insulin and decided to continue with the OAD treatment. Effect sizes for the differences between both groups were calculated using Cohen's d with pooled SD (26). Statistical analyses were performed with SPSS 12.0.1 (Chicago, IL), Amos 5.0 (Chicago, IL), and ClinTools (Brain Sciences Institute, Swinburne University, Swinburne, Australia).
Table 1 provides descriptive statistics for socioeconomic, medical, and psychological variables for samples A and B.
Scale development in study A.
Replication of component structure in study B. The principal component analysis in the sample used for cross-validation resulted in a clear replication of the questionnaire's structure. With an explained variance of 69.4%, five components with almost identical component loadings were identified (see Table 2). Results of the CFA also confirmed the structure of the BIT Questionnaire with an acceptable to good model fit with RMSEA = 0.04 (90% CI 0.03–0.05) and CFI = 0.97. The second-order CFA confirmed a good model fit with RMSEA = 0.04 (0.02–0.04) and CFI = 0.97, showing again that it is appropriate to create a total score. The BIT Questionnaire scales were based on the items with the highest component loading in sample B and labeled according to the wording of the items as follows: fear of injection and self-testing, expectations regarding positive insulin-related outcomes, expected hardship from insulin treatment, stigmatization by insulin injections, and fear of hypoglycemia. Mean values were computed for each scale with a value range 1–10 for each scale (Table 3).
In addition, a sum score was created that summed up the values of the items of the BIT Questionnaire (items of the scale "Expectations regarding positive insulin-related outcomes" were inverted first). No ceiling effect could be observed, which was demonstrated by the percentages of patients with maximum values between 0% for the sum score and 3.8–18% for the different BIT Questionnaire scales.
Reliability measure.
Wording and statistical measures of the BIT Questionnaire items.
Intercorrelation of BIT Questionnaire scales.
Validity analysis.
Our report describes the development and evaluation of a questionnaire that measures barriers to the acceptance of insulin treatment in orally treated patients with type 2 diabetes. The BIT Questionnaire was developed first in a sample of 448 patients; the development was based on principal component analyses. Our results yielded an easily interpretable five-component solution based on only 14 items. These components were used to define the following subscales: fear of injection and self-testing, expectations regarding positive insulin-related outcomes, expected hardship from insulin treatment, stigmatization by insulin injections, and fear of hypoglycemia. In addition, an overall sum score of all values was calculated in order to summarize the 14 items of the BIT Questionnaire in a single score. The subscales of the BIT Questionnaire address a wide range of the most important psychological barriers to insulin treatment, as those barriers are described in the current literature (9,10). In a next step, a cross-validation of the structure of the BIT Questionnaire was performed based on data from an independent sample of 449 insulin-naïve patients with type 2 diabetes. This cross-validation used the 14-item BIT Questionnaire developed in the first sample. The results of both the exploratory principal component analyses and the confirmatory factor analysis confirmed the structure of the BIT Questionnaire. The scales demonstrated adequate reliability and validity. The frequency distribution of the scores revealed a fairly normal distribution, with no ceiling effect; this distribution is especially important when assessing changes in retest measures (12). We successfully performed a linguistic validation of the German BIT Questionnaire into the English version presented here in order to makes it possible to pool and/or compare the results obtained in Germany across English-speaking countries. This certifies that the language versions obtained are conceptually equivalent, culturally relevant, and acceptable to the target populations. A possible limitation of our approach is that some of the topics that were excluded from scale construction may be highly relevant for some patients. On the other hand, we chose to keep in the BIT Questionnaire only those items that demonstrated a clear and unambiguous component loading. Another limitation at this stage of development of the BIT Questionnaire is that the test-retest reliability and sensitivity to change of this new instrument still need to be determined. In summary, the 14-item BIT Questionnaire has gone through rigorous empirical development and offers reliable psychometric properties as well as an interpretable and relevant component structure. Our findings suggest that clinicians and researchers now can use this instrument in a valid and reliable way to assess and address psychological barriers to insulin treatment in insulin-naïve patients with type 2 diabetes.
This study was supported by Pfizer. Parts of this study were presented in abstract form at the 66th Scientific Sessions of the American Diabetes Association, 2006; at the 41th Annual Session of the German Diabetes Association, 2006; and at the 42nd European Association for the Study of Diabetes Annual Meeting, 2006.
Published ahead of print at http://care.diabetesjournals.org on 15 June 2007. DOI: 10.2337/dc06-2042. F.P. has received consulting fees from Pfizer Germany. T.F. and A.P. have received honoraria and grant/research support from Pfizer Germany. Additional information for this article can be found in an online appendix at http://dx.doi.org/10.2337/dc06-2042. A table elsewhere in this issue shows conventional and Système International (SI) units and conversion factors for many substances. The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C Section 1734 solely to indicate this fact. Received for publication October 3, 2006. Accepted for publication June 6, 2007.
This article has been cited by other articles:
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||