© 2005 by the American Diabetes Association, Inc.
Implementation and Evaluation of a Low-Literacy Diabetes Education Computer Multimedia Application
1 Department of Medicine, University of Illinois at Chicago, Chicago, Illinois Address correspondence and reprint requests to Ben Gerber, MD, Department of Medicine (M/C 718), University of Illinois, 840 South Wood St., Chicago, IL 60612. E-mail: bgerber{at}uic.edu
OBJECTIVETo evaluate a clinic-based multimedia intervention for diabetes education targeting individuals with low health literacy levels in a diverse population. RESEARCH DESIGN AND METHODSFive public clinics in Chicago, Illinois, participated in the study with computer kiosks installed in waiting room areas. Two hundred forty-four subjects with diabetes were randomized to receive either supplemental computer multimedia use (intervention) or standard of care only (control). The intervention includes audio/video sequences to communicate information, provide psychological support, and promote diabetes self-management skills without extensive text or complex navigation. HbA1c (A1C), BMI, blood pressure, diabetes knowledge, self-efficacy, self-reported medical care, and perceived susceptibility of complications were evaluated at baseline and 1 year. Computer usage patterns and implementation barriers were also examined. RESULTSComplete 1-year data were available for 183 subjects (75%). Overall, there were no significant differences in change in A1C, weight, blood pressure, knowledge, self-efficacy, or self-reported medical care between intervention and control groups. However, there was an increase in perceived susceptibility to diabetes complications in the intervention group. This effect was greatest among subjects with lower health literacy. Within the intervention group, time spent on the computer was greater for subjects with higher health literacy. CONCLUSIONSAccess to multimedia lessons resulted in an increase in perceived susceptibility to diabetes complications, particularly in subjects with lower health literacy. Despite measures to improve informational access for individuals with lower health literacy, there was relatively less use of the computer among these participants.
There is a growing awareness of the impact of low health literacy on diabetes (1,2). Low health literacy poses a major barrier to education and self-management (3). Health literacy directly impacts health outcomes, such as hospitalization risk, particularly in those with chronic diseases (4,5). In one cross-sectional study (5) measuring the health literacy level of type 2 diabetic patients, patients with inadequate health literacy were less likely than those with adequate health literacy to achieve tight glycemic control. However, there is limited data from longitudinal studies regarding the impact of health literacy on changes in clinical outcomes over time (2). Despite increasing concern about the impact of low health literacy on diabetes care, there are few proven interventions available that address low health literacy (6). Recent evidence (6,7) suggests that diabetes education improves self-management and glycemic control in those with limited health literacy. Simultaneously, clinicians are faced with less time and resources for disseminating information. Regular attendance in diabetes education classes is disappointingly low, particularly for those with lower socioeconomic status and those who have yet to develop diabetes complications (8). Additional barriers, including cultural factors and the inability to speak English, further complicate educational initiatives in diverse urban populations (911). To overcome these challenges, a new computer-based multimedia application for individuals with diabetes was created ("Living Well with Diabetes"). The program utilizes extensive audio and video to supply information, provide psychological support, and promote diabetes self-management skills without text or complex navigation. The application was available on touch-screen computers in clinical waiting areas for patients to utilize before appointments. The purpose of this study was to evaluate the impact of computer-based education in the clinical setting through a randomized controlled trial. A secondary objective was to evaluate the barriers and facilitators to implementing computer-based education. Prior research (12,13) designed to improve diabetes self-management often have not been generalizable beyond local environments. Well-controlled trials frequently included selected motivated subjects and did not adequately address lack of system resources, alterations in clinical flow, and clinical staff having competing obligations (14). In this study, subjects and clinical staff identified key considerations important for adopting computer-based learning in the clinical environment.
Setting Five urban outpatient clinics participated from June 2002 through October 2003. Each site received a personal computer with touch screen for patient access (installed to run continuously as a kiosk). Computers were placed in waiting areas with headphones available. Medical assistants routinely asked patients if they had diabetes. During recruitment, patients with diabetes were invited to participate. Eligibility criteria included age 18 years or older, self-reported history of type 1 or type 2 diabetes, and verbal fluency in English or Spanish. Subjects were excluded if they were not directly involved with their own diabetes care. Among the 313 patients referred for participation, 11 were excluded because they never used the study computer, and 58 refused participation, leaving 244 study subjects (Fig. 1). Reasons cited for declining participation included lack of time, lack of interest in computer use, acute illness, and no need for additional diabetes education.
Intervention Before enrollment, 19 computer-based multimedia lessons were created in English and Spanish (Letterpress Software). Lesson content covered an introduction to diabetes, blood glucose management, oral medications and insulin, nutrition and physical activity, depression and stress, oral hygiene, and the prevention of complications (including eye, foot, cardiovascular, and kidney diseases). Users were recommended to begin with the introductory lesson; however, they could choose lessons in any order (visual cues indicated which lessons have been viewed). Each lesson targeted a specific self-care objective according to Gagnés theory of learning and the component design theory (15,16). For each objective, a learning hierarchy was developed based on relevant verbal information (diabetes facts), intellectual skills (procedures for appropriate diabetes care), and cognitive strategies (suggestions for a healthy lifestyle). Each lesson incorporated Gagnés events for instruction, including obtaining the users attention, stating the objective, reviewing previous learning, providing learning guidance, evaluating user performance, and providing feedback (17). The design included intervention tailoring (based on previous computer experience and learning style) as well as message tailoring of information (targeting communication of African Americans and Latinos) (18). Local professional talents provided instructional narration. To develop the software, a separate group of individuals with diabetes were video recorded for unscripted testimonials related to diabetes, emphasizing barriers to care, challenges, and personalized solutions they or family members have encountered. While the lesson plans for the English and Spanish versions were very similar through translation, different testimonials from various subjects were used to relate both language and culturally appropriate information to the users. The program was available on touch-screen personal computers. Navigation was provided through a simplified interface, including forward/backward buttons for user control. Advanced features included "pop-up" supplementary text information or additional testimonials related to the concurrent screen concept. After each lesson, approximately 10 randomly sequenced multiple choice questions were presented for reinforcement. Individuals who incorrectly answered questions received immediate audio feedback. The average time for lesson completion ranged between 10 and 20 min.
Control
Design
Dependent measures
Statistical analysis
Health literacy scores were dichotomized to lowerand higherhealth literacy subgroups, by combining inadequate (016) and marginal (1722) scores together, as both groups share very limited computer experience. A similar threshold has also previously been applied (7,28). At baseline, we compared patients by group assignment and literacy subgroup using t tests or Mann-Whitney U tests for continuous variables and The primary outcome was change in A1C over the 1-year study period. A repeated-measures general linear model analysis was performed. Analyses of the primary outcome included adjustment for baseline covariates if differences were found between groups at baseline (with P < 0.20 criterion). The following covariates were included in the model: age, sex, Latino race, income, insulin therapy, duration of disease, and previous attendance in diabetes class. Receiving information to read about diabetes and visiting a dietitian both correlated with diabetes class attendance and thus were not included in the model. Subject characteristics such as language spoken, insurance, clinical site, and highest education level attained were also associated with other included covariates. Results were very similar for unadjusted and adjusted analyses (the adjusted analyses are presented).
Similar analyses were conducted to evaluate intervention effects on changes in secondary clinical and survey outcomes. Group-by-time interactions were evaluated for all outcomes. A P value of <0.05 was considered statistically significant. To detect a 0.5% difference in A1C level at 1 year, a total sample size of 198 was necessary to retain a power of 0.8 with an
Of 244 enrolled patients, 183 (75%) completed the 1-year trial. Subjects who dropped out had lower self-reported medical care measures at baseline (0.51 vs. 0.029, P = 0.013) and were more likely uninsured (59 vs. 35%, P = 0.001). No differences were detected by baseline A1C, previous computer use by history, or literacy group.
Subject characteristics
Physiologic outcomes Overall, there was no significant change in A1C, BMI, or blood pressure between intervention and control groups (Table 1). Among subjects with higher literacy, there was a small decrease in A1C in the control group (0.5 vs. +0.3%, P = 0.043). Exploratory analysis of low-literacy subjects with poor glycemic control (baseline A1C 9.0% in 26 subjects) showed there was a greater decrease in A1C in the intervention group than control group (2.1 vs. 0.3%, P = 0.036). For high-literacy subjects with poor glycemic control, there was no significant difference (0.9% for intervention and 1.3% for control group, P = 0.548).
Survey outcomes
Computer use
Subject feedback on computer use
The computer-based multimedia intervention was successfully implemented in the clinical environment and resulted in a greater level of perceived susceptibility to diabetes-related complications but without improvement in glycemic control. There are several possible explanations for the latter negative finding. First, the intervention did not address provider factors such as intensification of therapy (or "clinical inertia") (29,30). Second, the average A1C was relatively low at baseline (8.2%). The study did not incorporate a minimum A1C criterion in order to facilitate recruitment of a diverse population in a clinical setting and included individuals recently diagnosed with diabetes but unable to attend classes. In comparison, a similar approach using touch-screen computers in waiting rooms focused on dietary barriers had no effect on A1C or weight (31). Another randomized trial was conducted using tailored diabetes self-management training and support delivered via the Internet (14,32). This study demonstrated no significant change in A1C, though the intervention targeted exercise behavior and not glycemic control.
The intervention in the present study did result in significant improvement in A1C among lowhealth literacy subjects with poor glycemic control (A1C There are several mechanisms by which the multimedia may impact users. Prominent features of the educational application include video-recorded patient testimonials and interactive assessments that provide immediate feedback to users. Realistic role models may encourage vicarious learning through imitation. Also, skill building of glucose monitoring, insulin injection, and lifestyle modification are promoted. The use of video-recorded testimonials including persons with visual defects, kidney disease, amputations, and other complications of diabetes may elevate perceived susceptibility to complications among viewers. These testimonials highlight the benefits of self-care and discuss potential solutions to barriers. The additional use of positive feedback may increase self-efficacy via verbal persuasion through testimonial and narrator encouragement (34,35). The psychological impact of these features may be explained by various social and psychological health behavior change models, including Banduras Social Cognitive Theory and Rosenstocks expanded Health Belief Model (3638). In the setting of high perceived susceptibility to complications, behavioral change may occur if perceived benefits and barriers are subsequently addressed, particularly for those individuals having a greater sense of competence (or self-efficaciousness) to implement change (37). The intervention also addresses the "digital divide." This disparity not only represents differential access to computer technology and the Internet, but it also describes personal characteristics that separate users from nonusers of electronic information (39). In this study, while 34% of individuals with lower health literacy owned a computer, only 5% state that they had previously used a computer (compared with 49% of the higherhealth literacy group). Additionally, 55% of tested subjects had inadequate or marginal health literacy, similar to other estimates of urban populations (3). Access to technology will not effectively enable dissemination of consumer health information if the content is unreadable. The developed multimedia addresses many of the needs and preferences of low-income and underserved Americans concerning content: information provided on a basic health literacy level, content for non-English speakers, and culturally defined content (40). Furthermore, the implementation of touch-screen monitors offers an alternative to keyboard and mouse for computer input, which may hold value for individuals who are older, have lower health literacy, or have less computer experience (41,42). Based on our experience, there are several challenges to moving forward with computer-based interventions. Despite efforts made to improve computer usability, there was less use by lowerhealth literacy participants. As the technology was installed in the clinical setting, unexpected issues arose. The optimal location for computer accessibility was often uncertain. Making the computers visible, freely available, and accessible (meeting the guidelines of the Americans with Disabilities Act) was challenging in crowded waiting areas. Unfortunately, privacy is sacrificed when a computer is more centrally located within a clinic. Finally, the availability of computers may be limited for those waiting for others to finish use or when the computers malfunction. Prompting, instruction, repetition, and support were key factors in computer use. Staff encouragement and initial assistance improved acceptance; however, changing staff behaviors in busy clinical environments is challenging. Bilingual research assistants provided brief initial instruction to users, which has been helpful particularly in locations lacking bilingual staff. Multimedia audiovisual prompting was found to be necessary for continued use. However, repeated sessions may require external prompting by staff, either through verbal reminders or provider recommendations for computer-based learning. Strengths of this study include a randomized controlled study design carried out in a "real-world" setting. In addition, the intervention was evaluated in a population consisting of many individuals with low health literacy and who only speak Spanish. However, there were also several limitations to the study. Despite efforts in improving accessibility using touch-screen hardware and audiovisual media, there was less computer use among elderly and lowerhealth literacy participants, possibly dampening the potential effect of the intervention. More recent experience indicates much greater use and acceptance with a volunteer or family member helping to navigate the computer. Given that the study design involved five different clinical sites, various concurrent organizational-based and public health measures may have affected outcomes. Other studies of independent interventions (including the use of bilingual health educators and promoters/community lay workers) on minority groups are potential effect modifiers. Also, the study design was limited in its inability to include the collection of behaviorally relevant data, such as adherence to clinic visits or annual eye examinations. Thus, specific self-management improvements demonstrating behavioral change in response to specific multimedia lessons are difficult to estimate. In conclusion, a new diabetes education multimedia application has been developed and successfully implemented in clinical waiting areas, targeting a vulnerable population. Individuals using the program had higher perceived susceptibility to complications but no change in glycemic control. Despite measures to improve access to individuals with lower health literacy, there was relatively less use of the computer among these participants. However, the intervention did result in significant improvement in A1C among lowhealth literacy subjects with poor glycemic control. Additional personal and organizational barriers must be addressed in conjunction with provider involvement to improve usability. This may increase the impact of computer-based education on behavioral and clinical outcomes.
Support was provided by the Agency for Healthcare Research and Quality (U18 HS11092). A.M.A. is supported by a research career development grant from the Health Services Research and Development Section of the Department of Veterans Affairs. The authors wish to acknowledge Mariela Girotti, RN; Lourdes Pelaez, MD; Lori Brodsky, FNP, CDE; and Edgar Diaz for their contribution to multimedia development and study protocol.
A table elsewhere in this issue shows conventional and Système International (SI) units and conversion factors for many substances. Received for publication January 3, 2005. Accepted for publication April 6, 2005.
This article has been cited by other articles:
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||