HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text (PDF) All Versions of this Article: dc07-1312v1 31/2/193    most recent Purchase Article View Shopping Cart Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Request Permissions Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Abràmoff, M. D. Articles by van Ginneken, B. Search for Related Content PubMed PubMed Citation Articles by Abràmoff, M. D. Articles by van Ginneken, B. Social Bookmarking                What's this?

Evaluation of a system for automatic detection of diabetic retinopathy from color fundus photographs in a large population of patients with diabetes.

¹Retina Service, Department of Ophthalmology and Visual Sciences, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, Iowa City, IA 52242, USA
²Department of Veterans Affairs, Iowa City VA Medical Center, 601 Highway 6 West, Iowa City, IA 55242, USA
³Department of Electrical and Computer Engineering, University of Iowa, Iowa City, IA 52242, USA
⁴Image Sciences Institute, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
⁵Ophthalmology Service, OLVG, Oosterpark 9, 1091 AC Amsterdam, Amsterdam, The Netherlands

michael-abramoff{at}uiowa.edu

ABSTRACT

Objective: evaluate the performance of a system for automated detection of diabetic retinopathy in digital retinal photographs, built from published algorithms, on a large, representative, screening population.

Research design and methods: Retrospective analysis of 10,000 consecutive patient visits = exams (4 retinal photographs, two left and two right) from 5,692 unique patients from the EyeCheck diabetic retinopathy screening project imaged with three types of cameras at ten centers. Inclusion criteria: no previous diagnosis of diabetic retinopathy, no previous visit to ophthalmologist for dilated eye exam, both eyes photographed. One of three retinal specialists evaluated each exam as unacceptable quality, no referable retinopathy, or referable retinopathy. The system selected exams with sufficient image quality, on those, determined presence or absence of referable retinopathy. Outcome measures: area under ROC curve (AROC), ‘number needed to miss one case’ (NNM), type of false negative.

Results: Total AROC was 0.84, NNM was 80 at a sensitivity of 0.84 and a specificity of 0.64. At this point, 7689/10000 exams had sufficient image quality, 4648/7689 (60%) were true negatives, 59/7689 (0.8%) false negatives, 319/7689 (4%) true positives, and 2581/7689 (33%) false positives. 27% of false negatives contained large hemorrhages and/or neovascularizations.

Conclusion: automated detection of diabetic retinopathy using published algorithms cannot yet be recommended for clinical practice. However, performance is such that evaluation on validated, publicly available datasets should be pursued. If algorithms can be improved, such a system may in the future lead to improved prevention of blindness and visual loss in patients with diabetes.

CiteULike    Del.icio.us    Digg    Reddit    Technorati    What's this?

This article has been cited by other articles:

				J. A. Olson, P. F. Sharp, A. Fleming, and S. Philip Evaluation of a System for Automatic Detection of Diabetic Retinopathy From Color Fundus Photographs in a Large Population of Patients With Diabetes: Response to Abramoff et al. Diabetes Care, August 1, 2008; 31(8): e63 - e63. [Full Text] [PDF]

				M. D. Abramoff, M. Niemeijer, M. S.A. Suttorp-Schulten, M. A. Viergever, S. R. Russell, and B. van Ginneken Evaluation of a System for Automatic Detection of Diabetic Retinopathy From Color Fundus Photographs in a Large Population of Patients With Diabetes: Response to Olson et al. Diabetes Care, August 1, 2008; 31(8): e64 - e64. [Full Text] [PDF]