An improved objective evaluation measure for border detection in dermoscopy images

M. Emre Celebi, Gerald Schaefer, Hitoshi Iyatomi, William V. Stoecker, Joseph M. Malters, James M Grichnik

Research output: Contribution to journalArticle

29 Citations (Scopus)

Abstract

Background: Dermoscopy is one of the major imaging modalities used in the diagnosis of melanoma and other pigmented skin lesions. Owing to the difficulty and subjectivity of human interpretation, dermoscopy image analysis has become an important research area. One of the most important steps in dermoscopy image analysis is the automated detection of lesion borders. Although numerous methods have been developed for the detection of lesion borders, very few studies were comprehensive in the evaluation of their results. Methods: In this paper, we evaluate five recent border detection methods on a set of 90 dermoscopy images using three sets of dermatologist-drawn borders as the ground truth. In contrast to previous work, we utilize an objective measure, the normalized probabilistic rand index, which takes into account the variations in the ground-truth images. Conclusion: The results demonstrate that the differences between four of the evaluated border detection methods are in fact smaller than those predicted by the commonly used exclusive-OR measure.

Original languageEnglish
Pages (from-to)444-450
Number of pages7
JournalSkin Research and Technology
Volume15
Issue number4
DOIs
StatePublished - Nov 1 2009
Externally publishedYes

Fingerprint

Dermoscopy
Melanoma
Skin
Research

Keywords

  • Border detection
  • Dermoscopy
  • Evaluation measure
  • Melanoma

ASJC Scopus subject areas

  • Dermatology

Cite this

Celebi, M. E., Schaefer, G., Iyatomi, H., Stoecker, W. V., Malters, J. M., & Grichnik, J. M. (2009). An improved objective evaluation measure for border detection in dermoscopy images. Skin Research and Technology, 15(4), 444-450. https://doi.org/10.1111/j.1600-0846.2009.00387.x

An improved objective evaluation measure for border detection in dermoscopy images. / Celebi, M. Emre; Schaefer, Gerald; Iyatomi, Hitoshi; Stoecker, William V.; Malters, Joseph M.; Grichnik, James M.

In: Skin Research and Technology, Vol. 15, No. 4, 01.11.2009, p. 444-450.

Research output: Contribution to journalArticle

Celebi, ME, Schaefer, G, Iyatomi, H, Stoecker, WV, Malters, JM & Grichnik, JM 2009, 'An improved objective evaluation measure for border detection in dermoscopy images', Skin Research and Technology, vol. 15, no. 4, pp. 444-450. https://doi.org/10.1111/j.1600-0846.2009.00387.x
Celebi, M. Emre ; Schaefer, Gerald ; Iyatomi, Hitoshi ; Stoecker, William V. ; Malters, Joseph M. ; Grichnik, James M. / An improved objective evaluation measure for border detection in dermoscopy images. In: Skin Research and Technology. 2009 ; Vol. 15, No. 4. pp. 444-450.
@article{7e32e089eedd4067b6a5689fc4990b15,
title = "An improved objective evaluation measure for border detection in dermoscopy images",
abstract = "Background: Dermoscopy is one of the major imaging modalities used in the diagnosis of melanoma and other pigmented skin lesions. Owing to the difficulty and subjectivity of human interpretation, dermoscopy image analysis has become an important research area. One of the most important steps in dermoscopy image analysis is the automated detection of lesion borders. Although numerous methods have been developed for the detection of lesion borders, very few studies were comprehensive in the evaluation of their results. Methods: In this paper, we evaluate five recent border detection methods on a set of 90 dermoscopy images using three sets of dermatologist-drawn borders as the ground truth. In contrast to previous work, we utilize an objective measure, the normalized probabilistic rand index, which takes into account the variations in the ground-truth images. Conclusion: The results demonstrate that the differences between four of the evaluated border detection methods are in fact smaller than those predicted by the commonly used exclusive-OR measure.",
keywords = "Border detection, Dermoscopy, Evaluation measure, Melanoma",
author = "Celebi, {M. Emre} and Gerald Schaefer and Hitoshi Iyatomi and Stoecker, {William V.} and Malters, {Joseph M.} and Grichnik, {James M}",
year = "2009",
month = "11",
day = "1",
doi = "10.1111/j.1600-0846.2009.00387.x",
language = "English",
volume = "15",
pages = "444--450",
journal = "Skin Research and Technology",
issn = "0909-752X",
publisher = "Wiley-Blackwell",
number = "4",

}

TY - JOUR

T1 - An improved objective evaluation measure for border detection in dermoscopy images

AU - Celebi, M. Emre

AU - Schaefer, Gerald

AU - Iyatomi, Hitoshi

AU - Stoecker, William V.

AU - Malters, Joseph M.

AU - Grichnik, James M

PY - 2009/11/1

Y1 - 2009/11/1

N2 - Background: Dermoscopy is one of the major imaging modalities used in the diagnosis of melanoma and other pigmented skin lesions. Owing to the difficulty and subjectivity of human interpretation, dermoscopy image analysis has become an important research area. One of the most important steps in dermoscopy image analysis is the automated detection of lesion borders. Although numerous methods have been developed for the detection of lesion borders, very few studies were comprehensive in the evaluation of their results. Methods: In this paper, we evaluate five recent border detection methods on a set of 90 dermoscopy images using three sets of dermatologist-drawn borders as the ground truth. In contrast to previous work, we utilize an objective measure, the normalized probabilistic rand index, which takes into account the variations in the ground-truth images. Conclusion: The results demonstrate that the differences between four of the evaluated border detection methods are in fact smaller than those predicted by the commonly used exclusive-OR measure.

AB - Background: Dermoscopy is one of the major imaging modalities used in the diagnosis of melanoma and other pigmented skin lesions. Owing to the difficulty and subjectivity of human interpretation, dermoscopy image analysis has become an important research area. One of the most important steps in dermoscopy image analysis is the automated detection of lesion borders. Although numerous methods have been developed for the detection of lesion borders, very few studies were comprehensive in the evaluation of their results. Methods: In this paper, we evaluate five recent border detection methods on a set of 90 dermoscopy images using three sets of dermatologist-drawn borders as the ground truth. In contrast to previous work, we utilize an objective measure, the normalized probabilistic rand index, which takes into account the variations in the ground-truth images. Conclusion: The results demonstrate that the differences between four of the evaluated border detection methods are in fact smaller than those predicted by the commonly used exclusive-OR measure.

KW - Border detection

KW - Dermoscopy

KW - Evaluation measure

KW - Melanoma

UR - http://www.scopus.com/inward/record.url?scp=70350754235&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350754235&partnerID=8YFLogxK

U2 - 10.1111/j.1600-0846.2009.00387.x

DO - 10.1111/j.1600-0846.2009.00387.x

M3 - Article

C2 - 19832956

AN - SCOPUS:70350754235

VL - 15

SP - 444

EP - 450

JO - Skin Research and Technology

JF - Skin Research and Technology

SN - 0909-752X

IS - 4

ER -