Advertisement

Hidden Complexities in Assessment of Glycemic Outcomes: Are Quality Rankings Aligned with Treatment?

  1. Leonard M Pogach, MBA (Leonard.Pogach{at}va.gov)1,2,
  2. Mangala Rajan, MBA1,
  3. Miriam Maney, MA1,
  4. Chin-Lin Tseng, DrPH1,2 and
  5. David C. Aron, MD, MS3,4
  1. (1) Department of Veterans Affairs New Jersey Healthcare System, East Orange, NJ
  2. (2) University of Medicine and Dentistry of New Jersey-New Jersey Medical School, Newark, NJ
  3. (3) Louis Stokes Cleveland Veterans Affairs Medical Center
  4. (4) Case Western Reserve University, Cleveland, OH

Abstract

Objectives: To evaluate facility rankings in achieving <7% A1c levels based upon the complexity of glycemic treatment regimens (CGR) using threshold and continuous measures.

Research Design and Methods: Retrospective administrative data analysis of Veterans Health Administration Medical Centers in 2003-2004. Eligible patients were identified using National Committee for Quality Assurance (NCQA) measure specifications. CGR was defined as receipt of insulin or three oral agents. Facilities were ranked using 5 ordinal categories based upon both Z score distribution and statistical significance (P<0.05). Rankings using the NCQA definition were compared to a subset receiving CGR using both a <7% threshold and a continuous measure awarding proportional credit for values between 7.9% and <7.0%. Ranking correlation was assessed using the Spearman correlation coefficient.

Results: 203,302 patients (mean age 55.2 years) were identified from 127 facilities (range 480-5411, mean 1601); 26.7%(17.9%-35.2%) were on CGR, including 22.0% receiving insulin. Mean A1c and percent achieving <7% were 7.48% and 48% overall and 8.32% and 24.8% for those on CGR using the threshold measure; proportion achieved was 60.1% and 37.2%, respectively, using the continuous measure. Rank correlation between the overall and CGR subset was 0.61; 8 of 24 of the highest or lowest ranked facilities changed to non-significance status; an additional 5 sites changed rankings.

Conclusions: Facility rankings in achieving the NCQA <7% measure as specified differ markedly from rankings using the CGR subset. Measurement for public reporting or payment should stratify rankings by CGR. A continuous measure may better align incentives with treatment intensity.

Footnotes

    • Received September 12, 2009.
    • Accepted June 26, 2010.
    Advertisement