HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Abstract Full Text (PDF) Online Appendix Purchase Article View Shopping Cart Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Request Permissions Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Burgers, J. S. Articles by Feder, G. Search for Related Content PubMed PubMed Citation Articles by Burgers, J. S. Articles by Feder, G. Social Bookmarking                What's this?

Inside Guidelines

Comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries

¹ Centre for Quality of Care Research, University Medical Centre Nijmegen, Nijmegen, the Netherlands
² Department of General Practice and Primary Care, Barts and The London, Queen Mary’s School of Medicine and Dentistry, University of London, London, U.K
³ Department of Social Medicine, Academic Medical Centre, University of Amsterdam, Amsterdam, the Netherlands

	ABSTRACT

TOP ABSTRACT INTRODUCTION RESEARCH DESIGN AND METHODS RESULTS CONCLUSIONS APPENDIX References

 
OBJECTIVE—To compare guidelines on diabetes from different countries in order to examine whether differences in recommendations could be explained by use of different research evidence.

RESEARCH DESIGN AND METHODS—We analyzed 15 clinical guidelines on type 2 diabetes from 13 countries using qualitative methods to compare the recommendations and bibliometric methods to measure the extent of overlap in citations used by different guidelines. A further qualitative analysis of recommendations and cited evidence for two specific issues in diabetes care explored the apparent discrepancy between recommendations and evidence.

RESULTS—The recommendations made in the guidelines were in agreement about the general management of type 2 diabetes, with some important differences in treatment details. There was little overlap in evidence cited by the guidelines, with 18% (185/1,033) of citations shared with any other guideline, and only 10 studies (1%) appearing in six or more guidelines. The measurable overlap in evidence between guidelines increases if multiple publications from the same study and the use of reviews are taken into account. Research originating from the U.S. predominated (40% of citations); however, nearly all (11/12) guidelines were significantly more likely to cite evidence originating from their own countries.

CONCLUSIONS—Despite the variation in cited evidence and preferential citation of evidence from a guideline’s country of origin, we found a high degree of international consensus in recommendations made for the clinical care of type 2 diabetes. The influence of professional bodies such as the American Diabetes Association may be an important factor in explaining international consensus. Globalization of recommended management of diabetes is not a simple consequence of the globalization of research evidence.

Abbreviations: ADA, American Diabetes Association • AGREE, Appraisal of Guidelines for Research and Evaluation • DCCT, Diabetes Control and Complications Trial • UKPDS, U.K. Prospective Diabetes Study

	INTRODUCTION

TOP ABSTRACT INTRODUCTION RESEARCH DESIGN AND METHODS RESULTS CONCLUSIONS APPENDIX References

 
Over the past 20 years, clinical guidelines have been developed to bridge the gap between research and practice (1). There has been a concerted effort to base clinical decisions on research evidence (2) and, particularly through the Cochrane collaboration, to make this evidence available globally (3). Guideline development groups aim to use the totality of relevant research evidence to formulate recommendations (4). Since bibliographic databases (for example Medline and Embase) are easily available, one might expect that this would lead to international consensus on the evidence chosen to underpin recommendations for clinical care and a consequent convergence of recommendations made in guidelines.

Nevertheless, recommendations often differ in guidelines on the same topic, particularly when evidence for treatment decisions is weak. For example, Eisinger et al. (5) found substantial differences between recommendations from the U.S. and France about prophylactic mastectomy or oophorectomy in high-risk women. Differences were attributed to cultural variation in ideas about patient autonomy and involvement in health care, differing national views on esthetics of the breast, and fertility. Even where there is good trial evidence, recommendations vary. For instance, analysis of hypertension guidelines from New Zealand, U.S., Canada, U.K., and the World Health Organization showed wide variation in the criteria for blood pressure treatment decisions (6). Differences persisted between more recent editions of national hypertension guidelines, even with more systematic and transparent methods of guideline development (7).

It is evident that there are disparities in recommendations in guidelines for a range of different clinical conditions. Investigators hypothesize that differences are due to insufficient evidence (6,8,9), differing interpretations of evidence (10), unsystematic guideline development methods (11,12), the influence of professional bodies (13), cultural factors such as differing expectations of apparent risks and benefits (5,6), socioeconomic factors, or characteristics of health care systems (14).

In this study, we compared recommendations among a range of guidelines on the management of type 2 diabetes and analyzed to what extent the variation (or concordance) among recommendations was explained by the evidence cited in the guidelines.

	RESEARCH DESIGN AND METHODS

TOP ABSTRACT INTRODUCTION RESEARCH DESIGN AND METHODS RESULTS CONCLUSIONS APPENDIX References

 
Selection of guidelines
We applied the Institute of Medicine’s definition of clinical guidelines: "systematically developed statements to assist practitioner and patient decisions about appropriate health care for specific clinical circumstances" (15). Systematic reviews and evidence reports that did not contain specific recommendations were not included in this study. Because of the large number of clinical issues related to diabetes, the selection of guidelines was limited to two areas: 1) ambulatory or outpatient care, excluding guidelines exclusively covering type 1 diabetes, complications of diabetes that need specialist care (retinopathy, diabetic foot, nephropathy, and neuropathy), and gestational diabetes; and 2) treatment of diabetes, excluding guidelines on prevention and diagnosis.

The sample consisted of a total of 15 guidelines for the clinical care of type 2 diabetes (Table 1) representing the national guidelines of the Appraisal of Guidelines for Research and Evaluation (AGREE) collaboration. This international group of researchers has investigated variation between guidelines and guideline development models with the aim of advising the European Commission on guideline development, dissemination, and implementation. The east London guideline was chosen because there were no national English guidelines available. Two French guidelines were complementary and were analyzed as one guideline. The guidelines from Australia, New Zealand, Canada, and the U.S. were identified through a web-based search and consultation with colleagues. Four guidelines (CA, NL2, US1, and US2) were updated versions of earlier guidelines. Two guidelines (CA and DK) were funded by pharmaceutical companies, and the others were funded by national or regional government agencies (EN, FR, NZ, SC, and SP) or state health care systems (AU and US2), national professional organizations (FI, IT, NL2, and US1), or hospitals (NL1, SW).

The guidelines were in seven different languages. Members of the study team translated those guidelines written in French or Dutch; relevant sections of guidelines in Finnish, Danish, and Spanish were translated by guideline developers in their respective countries. The Italian guideline was excluded from the analysis of recommendations because of its length and lack of structure.

Extraction and comparison of recommendations
We defined recommendations as any statements that promote or advocate a particular course of action in clinical care. Two investigators with medical training, working independently, extracted the recommendations. We resolved discrepancies through discussion within the study team. A panel of four investigators (J.S.B., J.V.B., G.F., and N.S.K.) judged the extent of accordance or discordance of recommendations across guidelines.

Extraction and measurement of overlap of citations
One member of our team selected all references linked to the relevant sections chosen for study and another cross-checked this selection. Each citation was entered onto a reference manager database (version 8.5), adding a unique identifier code for each guideline. We excluded the Danish, Finnish, and Swiss guidelines from this part of the study because they cited fewer than three references each. We used the reference manager search facility to quantify the numbers of citations in common with other guidelines, the type of citation (e.g., meta-analysis, review, or guideline), and the address of the first author as a proxy for the country of origin of the cited study. The proportion of shared references between guidelines was expressed as a percentage of the maximum possible score according to the publication dates of both the guideline and its linked references.

Examination of link between recommendations and citations
To explore the discrepancy between disparate citations and largely concordant recommendations, we purposively selected (16) two areas for further analysis: use of metformin in obese patients and self-monitoring of blood glucose. We selected citations that were explicitly linked to the recommendations or listed at the end of relevant sections and compared citations between guidelines. For each citation, we tabulated the type of study, country of origin, study subjects, conclusions, and any recommendations made by the authors. Where secondary citations were used (i.e., meta-analyses, systematic reviews, or other guidelines), we included the evidence cited by these documents. We compared the publication dates of citations and the dates of the latest evidence cited by guidelines (censoring dates). We did not appraise the quality of the studies but examined the consistency between the study conclusions and recommendations made in the guidelines.

	RESULTS

TOP ABSTRACT INTRODUCTION RESEARCH DESIGN AND METHODS RESULTS CONCLUSIONS APPENDIX References

 
Guidelines varied considerably in length (range 3–350 pages), format, and number of references (Table 2). Nine guidelines linked their recommendations to citations; four of these (FR, SC, CA, and US2) also used grading systems to appraise the evidence.

Comparison of recommendations
The guidelines largely agreed on general management of patients with type 2 diabetes, which was covered by the following recommendations: 1) all patients should be offered dietary advice and overweight/obese patients should be offered weight management advice; 2) the diet should be low in sugar, fat content, and overall calories and should be combined with exercise; 3) all patients should stop smoking to reduce cardiovascular risk; 4) patient education is necessary to promote good diabetes control; 5) poor glycemic control should be tackled initially with diet alone, followed by oral medication and insulin if necessary, unless the patient is acutely unwell; 6) sulfonylureas or biguanides are recommended in patients with normal BMI, and metformin is recommended in obese patients; 7) a second oral agent should be added to maximum doses of an initial agent in case of poor glygemic control; 8) HbA_1c is suitable for long-term monitoring and should be <8%; 9) if on insulin, self-monitoring of blood glucose is recommended; 10) screening and treatment of raised blood pressure, microalbuminuria, and hyperlipidemia is recommended; 11) ACE inhibitors are recommended in patients with hypertension and renal disease; and 12) aspirin is recommended for secondary prevention of cardiovascular disease.

Differences between the recommendations were found in the following areas: 1) length of trial of diet and exercise before oral treatment ranged from 2 to 9 months—some guidelines recommended a longer period in obese than nonobese patients; 2) BMI used to define obesity ranged from 25 to 30 kg/m²; 3) widely varying indications were suggested for the use of -glucosidase inhibitors; 4) there was no consensus on the value or indications of combination therapy with oral hypoglycemics and insulin; 5) target HbA_1c ranged from 6.5 to 7.5%, and target blood pressure ranged from <130/80 to <160/90 mmHg; 6) frequency of monitoring HbA_1c and blood pressure ranged from one to four times a year and one to six times a year; 7) there was no consensus on self-monitoring of blood glucose in patients on diet alone or on oral medication; 8) there was no consensus on the first-line drug for raised blood pressure; 9) widely differing opinions were given on the value of aspirin use as primary prevention in high-risk patients; 10) widely differing targets were given for lipid control (e.g., total cholesterol 4.5–6.5 mmol/l)—there was no consensus on the use of absolute cardiovascular risk or isolated lipid levels for treatment decisions; and 11) routine annual electrocardiogram was recommended by half of the guidelines, whereas others recommended electrocardiogram for specific indications or did not mention it.

Comparison of linked citations
We selected a total of 1,346 references from 12 guidelines (Table 2); 1,033 of these were different citations. Only 18% (185/1,033) of the unique citations were shared with any of the other 11 guidelines. Considering all of the references made in the guidelines, on average of 37% (498/1,346) of these were shared with any other guideline (range 20–67%). The Diabetes Control and Complications Trial (DCCT) (17) was most frequently cited (in 11 guidelines). A randomized controlled trial addressing intensive insulin therapy with patients with type 2 diabetes was cited by eight guidelines (18). If all 45 publications of the American Diabetes Association (ADA) were analyzed as one document, it would be shared between eight guidelines. Two studies (one randomized controlled trial and one cohort study) were shared among seven guidelines, and six trials were shared among six guidelines. Six guidelines referred to the WHO St. Vincent Declaration. Four of the 12 most frequent citations were from the U.S., 3 were from the U.K. (all three U.K. Prospective Diabetes Study publications), 2 were from Israel, 1 each was from Finland and Japan, and 1 was a WHO document.

The largest proportion of lead authors of papers cited in the guidelines (40%) originated from the U.S. (Table 3). All guidelines, except the Australian, cited a significantly higher proportion of studies from authors of their own countries than the origin overall of citations in the database (P < 0.02). Citations in the English, Scottish, and New Zealand guidelines were predominantly from the U.K., and citations in all other guidelines, except the Dutch general practice guideline (NL2), were predominantly from the U.S.

Examination of link between recommendations and citations (case studies)
Use of metformin in obese patients
Eleven guidelines covered the use of oral medication. Nine explicitly recommended metformin as a first choice oral treatment for hyperglycemia in the obese, while the Canadian and US1 guidelines recommended tailoring treatment for the individual. We compared the citations from six guidelines, and the others had no citations linked to their recommendations on use of metformin (online appendix, http://care.diabetesjournals.org). There was little overlap in the 20 citations given: 1 (U.K. Prospective Diabetes Study [UKPDS] 34) was shared by four of five guidelines with a censoring date that would allow use of this paper (19). The UKPDS 13 paper was shared by three of six guidelines (20), and three other citations were shared by two. Over half of the linked citations (11/20) were randomized controlled trials; 1 was a meta-analysis, and the remainder were nonsystematic reviews. All studies concluded that metformin was useful in obese patients. While the choice of citations varied, publications from one trial (UKPDS) predominated and each guideline cited at least one publication that explicitly supported the recommendation.

Self-monitoring of blood glucose
Nine guidelines covered self-monitoring and were unanimous in recommending the self-monitoring of blood glucose in type 2 diabetes treated with insulin. We compared the citations from seven guidelines (online appendix). Only two citations were present in more than one guideline: the DCCT trial (17) was cited in two and the ADA consensus statement (21) was shared by four. However, when we considered the primary studies in systematic reviews, meta-analyses, or guideline and consensus documents, the overlap between citations increased substantially: 17 of 33 references were then shared by at least two guidelines. For example, the Dutch and French guideline had seven citations in common by virtue of a systematic review conducted by Faas et al. (22). Of the seven citations that specifically addressed self-monitoring in type 2 diabetes, five (two randomized controlled trials, one cross-sectional study, one review, and one comment) concluded that there was no evidence to support its use. The two supportive citations were guidelines (an ADA consensus statement and a Canadian guideline).

	CONCLUSIONS

TOP ABSTRACT INTRODUCTION RESEARCH DESIGN AND METHODS RESULTS CONCLUSIONS APPENDIX References

 
This is the first study comparing both guideline recommendations and cited evidence across national guidelines. Our bibliometric analysis included >1,000 citations. We minimized selection and observer bias by prospective choice of inclusion criteria for recommendations and citations and independent extraction by two researchers.

We found a high degree of international consensus on the clinical care of people with type 2 diabetes, despite differences in detailed recommendations. This was in contrast to what we expected, considering the range of influences on the guideline development process and the variation in organization of care and health care system among countries (23). Yet the citations linked to and presumably justifying the guideline recommendations were widely disparate. The influence of large pragmatic treatment trials (e.g. DCCT [17]) and UKPDS studies (19,24,25) was nevertheless visible in most of the guidelines and apparent even in guidelines without references.

Little use was made of systematic reviews (for example Cochrane reviews), which is consistent with the findings of Silagy et al. (26). National guidelines were significantly more likely to cite research from investigators from the same country, explaining some of the variation in citations between guidelines. Others have found that local sources of evidence are overrepresented in guidelines (27) and that the results of trials conducted in the same country may be given more prominence (28).

We used the case studies to generate hypotheses to explain the small degree of overlap in citations between guidelines. Recommendations for the use of metformin in obese patients drew on supportive trial and review evidence. The different studies linked to these concordant recommendations often had similar conclusions. We also observed a consensus in recommendations for the use of self-monitoring of blood glucose, despite citation of evidence that did not support this position. The overlap in evidence would have been larger if we had aggregated citations from the same study (e.g., UKPDS) and if we had included the primary citations made within reviews and meta-analyses. Even taking this into account, the evidence cited in type 2 diabetes guidelines largely does not overlap. Therefore, we hypothesize that there are other potential influences on guideline developers. For example, the recommendations of the ADA strongly influenced the other guidelines on diabetes, with the exception of the English and Scottish. Similarly, Littlejohns et al. (13) found that professional opinion expressed in a consensus statement from the Royal College of General Practitioners and the Royal College of Physicians influenced the recommendations made in nine U.K. guidelines for the treatment of depression in primary care.

Guideline development is a social as well as technical process that is affected by access to and choice of research evidence and decisions about the interpretation of evidence and formulation of recommendations (29–31). Our study suggests that research evidence is not necessarily the most powerful influence on the content of recommendations in the current generation of guidelines on the management of type 2 diabetes. Guideline developers might first aim to achieve consensus about recommendations and then switch to the evidence as a rhetorical device to support decisions post hoc. Thus, the relationship between choice and interpretation of research evidence and the formulation of guideline recommendations is neither necessarily linear nor unidirectional. However, we are not suggesting a complete epistemological divide between evidence as represented by research papers and guidelines recommendations. As Greenhalgh and McCormack (32) have argued with regards to the UKPDS study, the interpretation of results within primary research studies is also debatable, influenced by prior beliefs, and open to challenge.

There are several sources of imprecision in our analysis. First, the guidelines were partly selected by researchers participating in the AGREE Collaboration. Therefore, the sample might be biased toward guidelines developed with more explicit and robust methods, such as systematic searching and the use of evidence grading systems. Nevertheless, the extent and format of the guidelines differed widely. Six guidelines did not link their recommendations to evidence, which complicated the data extraction.

Second, we did not record the extent of initial agreement on choice of recommendations, judgement on concordance or discordance of recommendations, or linkage between citations and recommendations. However, there were few disagreements and these were easily resolved by panel consensus.

Third, some of the variation in the content of the guidelines might be explained by the different publication dates of the guidelines and the rapid shift of information during the period studied. For instance, nine of the guidelines included in our study could not consider the UKPDS data that were published in 1998. In our analysis of the citations, we dealt with this confounding factor by correcting for publication dates of the guidelines and the cited evidence.

Finally, analysis of shared references is a blunt instrument for exploring the relationship between guideline recommendations and evidence. High-quality and large trials should be given more weight in the analysis. That is why we included two case studies exploring in more detail the relationship between recommendations and evidence in diabetes guidelines. Other clinical issues will need this kind of analysis to test the generalizability of our findings.

The process of formulating guideline recommendations and the social determinants of guidelines require further investigation. Decisions about choice of evidence and the role of international conferences, pharmaceutical companies, and opinion-forming bodies, such as the ADA, on national guidelines is not well understood. The growing availability of high-quality systematic reviews may support more uniformity in the use of research evidence in guidelines (33). Nevertheless, guidelines go beyond simple reviews of available evidence and necessarily reflect value judgements in considering all the issues relevant to clinical decision making. Transparency by guideline developers about how their judgements have been made would allow clinicians to evaluate the applicability of guideline recommendations to their own health care context and to individual patients.

	APPENDIX

TOP ABSTRACT INTRODUCTION RESEARCH DESIGN AND METHODS RESULTS CONCLUSIONS APPENDIX References

 
The AGREE Collaboration
The following individuals participated in the AGREE Collaboration: José Asua, MD, PhD, Basque Office for Health Technology Assessment, Spain; Anne Bataillard, MD, Fédération Nationale des Centers de Lutte Contre le Cancer, Paris, France; Melissa Brouwers, PhD, McMaster University and Cancer Care Ontario, Hamilton, ON, Canada; George Browman, MD, Hamilton Regional Cancer Center, Hamilton, Canada; Jako Burgers, MD, Center for Quality of Care Research, University Medical Center Nijmegen, the Netherlands; Bernard Burnand, MD, MPH, Institut Universitaire de Médecine Sociale et Préventive, Lausanne, Switzerland; Françoise Cluzeau, MSc, PhD, St George’s Hospital Medical School, London, U.K.; Isabelle Durand-Zaleski, PhD, Hôpital Henri Mondor, Cedez, France; Pierre Durieux, MD, Hôpital Européen Georges Pompidou, Paris, France; Cindy Farquhar, MD, PhD, New Zealand Guidelines Group, Auckland, New Zealand; Gene Feder, MD, FRCG, Barts and The London, Queen Mary’s School of Medicine and Dentistry, University of London, U.K.; Béatrice Fervers, MD, Fédération Nationale des Centers de Lutte Contre le Cancer, Paris, France; Roberto Grilli, MD, Agenzia Sanitaria Regionale, Bologna, Italy; Jeremy Grimshaw, MB, PhD, Ottawa Health Services Research Institute, Ottawa, Canada; Richard Grol, PhD, Center for Quality of Care Research, University Medical Center Nijmegen, the Netherlands; Steven Hanna, PhD, McMaster University, Hamilton, ON, Canada; Pieter ten Have, MD, Dutch Institute for Healthcare Improvement CBO, Utrecht, the Netherlands; Rod Jackson, PhD, Effective Practice Institute, University of Auckland, New Zealand; Albert Jovell, MD, PhD, Fundacio Biblioteca Josep Laporte, Barcelona, Spain; Niek Klazinga, MD, PhD, Academic Medical Center, University of Amsterdam, the Netherlands; Finn Kristensen, MD, PhD, Danish Institute for Health Technology Assessment, Copenhagen, Denmark; Peter Littlejohns, MBBS, MD, National Institute for Clinical Excellence, London, U.K.; Pia Bruun Madsen, Danish Institute for Health Technology Assessment, Copenhagen, Denmark; Marjukka Mäkelä, MD, PhD, MSc, Finnish Office for Health Care Technology Assessment, Helsinki, Finland; Juliet Miller, MA, MBA, Scottish Intercollegiate Guidelines Network (SIGN), Edinburgh, U.K.; Günter Ollenschläger, MD, PhD, Agency for Quality in Medicine, Cologne, Germany; Camilla Palmhøj-Nielsen, Danish Institute for Health Technology Assessment, Copenhagen, Denmark; Loes Pijnenborg, MD, PhD, Dutch College of General Practitioners, Utrecht, the Netherlands; Safia Qureshi, PhD, Scottish Intercollegiate Guidelines Network (SIGN), Edinburgh, U.K.; Rosa Rico-Iturrioz, MD, MSc, Basque Office for Health Technology Assessment, Spain; Kitty Rosenbrand, MD, Dutch Institute for Healthcare Improvement CBO, Utrecht, the Netherlands; Jean Slutsky, Agency for Healthcare Research and Quality, Rockville, MD; John-Paul Vader, MD, MPH, Institut Universitaire de Médecine Sociale et Préventive, Lausanne, Switzerland; and Joost Zaat, MD, PhD, Center for Quality of Care Research, University Medical Center Nijmegen, the Netherlands.

	Acknowledgments

 
The research was funded by a grant From the EU BIOMED2 Programme (BMH4-98-3669).

We thank Jean Ramsay, Rachel Kerr, and Emily Hallgarten for entering data into the reference manager database, Sudip Nandy for piloting the study methodology, and Rob Dijkstra for contributing to the data collection of the Dutch recommendations.

	Footnotes

 
Address correspondence and reprint requests to Jako S. Burgers, MD, Centre for Quality of Care Research, University Medical Centre Nijmegen, PO Box 9101, 6500 HB Nijmegen, The Netherlands. E-mail: burgersj{at}knmg.nl.

Received for publication 21 April 2002 and accepted in revised form 5 August 2002.

The AGREE Collaboration coordinating center is the Department of Public Health Sciences, St. George’s Hospital Medical School, University of London, London, U.K. (see APPENDIX).

Additional information for the article can be found in an online appendix at http://care.diabetesjournals.org.

A table elsewhere in this issue shows conventional and Système International (SI) units and conversion factors for many substances.

	References

TOP ABSTRACT INTRODUCTION RESEARCH DESIGN AND METHODS RESULTS CONCLUSIONS APPENDIX References

 

1. Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings: the Cochrane Effective Practice and Organization of Care Review Group. BMJ 317:465–468, 1998[Free Full Text]
   
2. Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS: Evidence-based medicine: what it is and what it isn’t (Editorial). BMJ 312:71–72, 1996[Free Full Text]
   
3. Cochrane Collaboration: The Cochrane Library. Database available on disk and CD-ROM. Oxford, U.K., Update Software 2002 (updated quarterly)
   
4. National Health and Medical Research Council: A Guide to the Development, Implementation and Evaluation of Clinical Practice Guidelines. Canberra, Australia, National Health and Medical Research Council, 1998
   
5. Eisinger F, Geller G, Burke W, Holtzman NA: Cultural basis of differences between US and French clinical recommendations for women at increased risk of breast and ovarian cancer. Lancet 353:919–920, 1999[Medline]
   
6. Fahey TP, Peters TJ: What constitutes controlled hypertension? Patient based comparison of hypertension guidelines. BMJ 313:93–96, 1996[Abstract/Free Full Text]
   
7. Psaty BM, Furberg CD: British guidelines on managing hypertension: provide evidence, progress, and an occasional missed opportunity (Editorial). BMJ 319:589–590, 1999[Free Full Text]
   
8. Dinkevitch E, Hupert J, Moyer VA: Evidence based paediatrics: evidence based well child care. BMJ 323:846–849, 2001[Free Full Text]
   
9. Vogel N, Burnand B, Vial Y, Ruiz J, Paccaud F, Hohlfeld P: Screening for gestational diabetes: variation in guidelines. Eur J Obstet Gynecol Reprod Biol 91:29–36, 2000[Medline]
   
10. Ravago TS, Mosniam J, Alem F: Evaluation of community acquired pneumonia guidelines. J Med Sys 24:289–296, 2000
    
11. Thomson R, McElroy H, Sudlow M: Guidelines on anticoagulant treatment in atrial fibrillation in Great Britain: variation in content and implications for treatment. BMJ 316:509–513, 1998[Abstract/Free Full Text]
    
12. Beck C, Cody M, Souder E, Zhang M, Small GW: Dementia diagnostic guidelines: methodologies, results and implementation costs. J Am Geriatr Soc 48:1195–1203, 2000[Medline]
    
13. Littlejohns P, Cluzeau F, Bale R, Grimshaw J, Feder G, Moran S: The quality and quantity of clinical practice guidelines for the management of depression in primary care in the UK. Br J Gen Pract 49:205–210, 1999[Medline]
    
14. DeMaeseneer J, Derese A: European general practice guidelines: a step too far? Eur J Gen Pract 5:86–87, 1999
    
15. Field MJ, Lohr KN (Eds.): Clinical Practice Guidelines: Directions for a New Agency. Washington, DC, National Academy Press, 1990
    
16. Patton MQ: Qualitative evaluation and research methods. In Designing Qualitative Studies. Newbury Park, CA, Sage, 1990, p. 145–198
    
17. Diabetes Control and Complications Trial (DCCT) Research Group: The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med 329:977–986, 1993[Abstract/Free Full Text]
    
18. Ohkubo Y, Kishikawa H, Araki E, Miyata T, Isami S, Motoyoshi S, Kojima Y, Furuyoshi N, Shichiri M: Intensive insulin therapy prevents the progression of diabetic microvascular complications in Japanese patients with non-insulin-dependent diabetes mellitus: a randomized prospective 6-year study. Diabetes Res Clin Pract 28:103–117, 1995[Medline]
    
19. UK Prospective Diabetes Study Group: Effect of intensive blood-glucose control with metformin on complications in overweight patients with type 2 diabetes (UKPDS 34). Lancet 352:854–865, 1998[Medline]
    
20. UK Prospective Diabetes Study: Relative efficacy of randomly allocated diet, sulphonylurea, insulin, or metformin in patients with newly diagnosed non-insulin dependent diabetes followed for three years (UKPDS 13). BMJ 310:83–88, 1995[Abstract/Free Full Text]
    
21. American Diabetes Association: Self-monitoring of blood glucose (Consensus Statement). Diabetes Care 17:81–86, 1994[Medline]
    
22. Faas A, Schellevis FG, Eijk JT van: The efficacy of self-monitoring of blood glucose in NIDDM subjects: a criteria-based literature review. Diabetes Care 20:1482–1486, 1997[Abstract]
    
23. Payer L: Medicine and Culture: Varieties of Treatment in the United States, England, West Germany, and France. New York, Penguin Books, 1989
    
24. UK Prospective Diabetes Study Group: Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes (UKPDS 38). BMJ 317:703–713, 1998[Abstract/Free Full Text]
    
25. UK Prospective Diabetes Study Group: Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). Lancet 352:837–853, 1998[Medline]
    
26. Silagy CA, Stead LF, Lancaster T: Use of systematic review in clinical practice guidelines: case study of smoking cessation. BMJ 323:833–836, 2001[Abstract/Free Full Text]
    
27. Grant J, Cottrell R, Cluzeau F, Fawcett G: Evaluating "payback" on biomedical research from papers cited in clinical guidelines: applied bibliometric study. BMJ 320:1107–1111, 2000[Abstract/Free Full Text]
    
28. Ramsay LE, Wallis EJ, Yeo WW, Jackson PR: The rationale for differing national recommendations for the treatment of hypertension. Am J Hypertens 11:79S–88S, 1998[Medline]
    
29. McIntosh A: Guidance: what role should consensus play in guideline development? In Making Use of Guidelines in Clinical Practice. Hutchinson A, Baker R, Eds. Abingdon, U.K., Radcliffe Medical Press, 1999, p. 63–81
    
30. Berg M, Meulen RT, Burg M van den: Guidelines for appropriate care: the importance of empirical normative analysis. Health Care Anal 9:77–99, 2001[Medline]
    
31. Hayward RSA, Wilson MC, Tunis SR, Bass EC, Guyatt G: Users guides to the medical literature. VIII. How to use clinical guidelines. A. Are the recommendations valid? JAMA 274:570–574, 1995[Medline]
    
32. McCormack J, Greenhalgh T: Seeing what you want to see in randomised controlled trials: versions and perversions of UKPDS data. BMJ 320:1720–1723, 2000[Free Full Text]
    
33. Cook DJ, Greengold NL, Gray Ellrodt A, Weingarten SR: The relation between systematic reviews and practice guidelines. Ann Intern Med 127:210–216, 1993
    

CiteULike

Del.icio.us

Digg

Reddit

Technorati

This article has been cited by other articles:

				E. P. Whitlock, J. S. Lin, R. Chou, P. Shekelle, and K. A. Robinson Using Existing Systematic Reviews in Complex Systematic Reviews Ann Intern Med, May 20, 2008; 148(10): 776 - 782. [Abstract] [Full Text] [PDF]

				The International SMBG Working Group Self-Monitoring of Blood Glucose in Type 2 Diabetes: Steps toward consensus Diabetes Care, October 1, 2007; 30(10): e105 - e105. [Full Text] [PDF]

				J. Matthys, M. De Meyere, M. L. van Driel, and A. De Sutter Differences Among International Pharyngitis Guidelines: Not Just Academic Ann. Fam. Med, September 1, 2007; 5(5): 436 - 443. [Abstract] [Full Text] [PDF]

				S. Korsatko, W. Habacher, I. Rakovac, J. Plank, S. Seereiner, P. Beck, R. Gfrerer, P. Mrak, B. Bauer, M. Grossschadl, et al. Evaluation of a Teaching and Treatment Program in Over 4,000 Type 2 Diabetic Patients After Introduction of Reimbursement Policy for Physicians Diabetes Care, June 1, 2007; 30(6): 1584 - 1586. [Full Text] [PDF]

				W. A. Davis, D. G. Bruce, and T. M.E. Davis Is Self-Monitoring of Blood Glucose Appropriate for All Type 2 Diabetic Patients?: The Fremantle Diabetes Study Diabetes Care, August 1, 2006; 29(8): 1764 - 1770. [Abstract] [Full Text] [PDF]

				E.C. Haagen, R.P.M.G. Hermens, W.L.D.M. Nelen, D.D.M. Braat, R.P.T.M. Grol, and J.A.M. Kremer Subfertility guidelines in Europe: the quantity and quality of intrauterine insemination guidelines Hum. Reprod., August 1, 2006; 21(8): 2103 - 2109. [Abstract] [Full Text] [PDF]

				I. P. Bridevaux, A.-M. Silaghi, J.-P. Vader, F. Froehlich, J.-J. Gonvers, and B. Burnand Appropriateness of colorectal cancer screening: appraisal of evidence by experts Int. J. Qual. Health Care, June 1, 2006; 18(3): 177 - 182. [Abstract] [Full Text] [PDF]

				G. Woodward, C. van Walraven, and J. E. Hux Utilization and outcomes of HbA1c testing: a population-based study Can. Med. Assoc. J., January 31, 2006; 174(3): 327 - 329. [Full Text] [PDF]

				J. Watine, B. Friedberg, E. Nagy, R. Onody, W. Oosterhuis, P. S. Bunting, J.-C. Charet, and A. R. Horvath Conflict between Guideline Methodologic Quality and Recommendation Validity: A Potential Problem for Practitioners Clin. Chem., January 1, 2006; 52(1): 65 - 72. [Abstract] [Full Text] [PDF]

				S. Skeie, C. Perich, C. Ricos, A. Araczki, A. R. Horvath, W. P. Oosterhuis, T. Bubner, G. Nordin, R. Delport, G. Thue, et al. Postanalytical External Quality Assessment of Blood Glucose and Hemoglobin A1c: An International Survey Clin. Chem., July 1, 2005; 51(7): 1145 - 1153. [Abstract] [Full Text] [PDF]

				W. N. Kasje, P. Denig, P. A. de Graeff, and F. M. Haaijer-Ruskamp Physicians' views on joint treatment guidelines for primary and secondary care Int. J. Qual. Health Care, June 1, 2004; 16(3): 229 - 236. [Abstract] [Full Text] [PDF]

				C. F. Schaars, P. Denig, W. N. Kasje, R. E. Stewart, B. H.R. Wolffenbuttel, and F. M. Haaijer-Ruskamp Physician, Organizational, and Patient Factors Associated With Suboptimal Blood Pressure Management in Type 2 Diabetic Patients in Primary Care Diabetes Care, January 1, 2004; 27(1): 123 - 128. [Abstract] [Full Text] [PDF]

				P. J. Saturno, F. Medina, F. Valera, J. Montilla, P. Escolar, and J. J. Gascon Validity and reliability of guidelines for neck pain treatment in primary health care. A nationwide empirical analysis in Spain Int. J. Qual. Health Care, December 1, 2003; 15(6): 487 - 493. [Abstract] [Full Text] [PDF]

This Article Abstract Full Text (PDF) Online Appendix Purchase Article View Shopping Cart Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Request Permissions Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Burgers, J. S. Articles by Feder, G. Search for Related Content PubMed PubMed Citation Articles by Burgers, J. S. Articles by Feder, G. Social Bookmarking                What's this?