SU‐C‐WAB‐03: Assessing the Correlation Between Quantitative Measures of Contour Variability and Physician's Qualitative Measure for Clinical Usefulness of Auto‐Segmentation in Prostate Cancer Radiotherapy

A. Gautam, E. Weiss, J. Williamson, John Ford, W. Sleeman, N. Jan, S. Saraiya, M. Orton, L. Zhang, M. Murphy

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Purpose: To assess the correlation between quantitative measures of contour variability and physician's qualitative measure for clinical usefulness of auto‐segmentation in prostate cancer radiotherapy Methods: Our study was based on three serial CT images (one planning and two under‐treatment image sets) for each of five prostate cancer patients. On each CT image, bladder, prostate and rectum were manually contoured by three experienced physicians. Deformable image registration (ITK Demons) was used to register each of the under‐treatment CT images to the planning CT image. The resultant displacement vector fields were used to automatically segment planning CT organs by deformably mapping manual contours on the treatment CT's to the planning CT. For qualitative assessment of automatic and manual contours, trial was conducted with four radiation oncology residents. Each resident was shown sets of randomly chosen manual or automatic bladder, prostate and rectum contours overlaid on the planning CT image in Pinnacle (Philips TPS) using a total of hundred‐thirty‐five contours. Residents were asked to accept/reject contour based on its clinical usability. Quantitatively, surface distances and DICE coefficient were computed between inter‐observer manual contours (manual/manual) and between each automatic and its corresponding manual contour (auto/manual). Results: No statistically significant differences were found in mean surface distances between manual/manual and auto/manual contours for bladder and rectum while manual/manual contour distances were significantly smaller for prostate. The distribution of DICE values between manual/manual and auto/manual contours were also similar. Qualitatively, acceptance rates for manual contours were significantly higher than that for automatic contours. Conclusion: No correspondence was found between qualitative and quantitative measure for manual and automatic contours for rectum and bladder while the two measures appear to be related for prostate. This study suggests that using quantitative measures for evaluating auto‐segmentation without a qualitative calibration might not always be predictive of its clinical usefulness.(Supported by NIH P01CA166602) This work was supported by NIH Grant P01 CA 166602 E. Weiss and J. Williamson have grants from Varian medical systems and Philips Radiation Oncology Systems.

Original languageEnglish (US)
Number of pages1
JournalMedical Physics
Volume40
Issue number6
DOIs
StatePublished - 2013
Externally publishedYes

Fingerprint

Prostatic Neoplasms
Radiotherapy
Physicians
Rectum
Prostate
Urinary Bladder
Radiation Oncology
Organized Financing
Calibration

ASJC Scopus subject areas

  • Biophysics
  • Radiology Nuclear Medicine and imaging

Cite this

SU‐C‐WAB‐03 : Assessing the Correlation Between Quantitative Measures of Contour Variability and Physician's Qualitative Measure for Clinical Usefulness of Auto‐Segmentation in Prostate Cancer Radiotherapy. / Gautam, A.; Weiss, E.; Williamson, J.; Ford, John; Sleeman, W.; Jan, N.; Saraiya, S.; Orton, M.; Zhang, L.; Murphy, M.

In: Medical Physics, Vol. 40, No. 6, 2013.

Research output: Contribution to journalArticle

@article{116d722dc6c24702bc69f5f3e89676cf,
title = "SU‐C‐WAB‐03: Assessing the Correlation Between Quantitative Measures of Contour Variability and Physician's Qualitative Measure for Clinical Usefulness of Auto‐Segmentation in Prostate Cancer Radiotherapy",
abstract = "Purpose: To assess the correlation between quantitative measures of contour variability and physician's qualitative measure for clinical usefulness of auto‐segmentation in prostate cancer radiotherapy Methods: Our study was based on three serial CT images (one planning and two under‐treatment image sets) for each of five prostate cancer patients. On each CT image, bladder, prostate and rectum were manually contoured by three experienced physicians. Deformable image registration (ITK Demons) was used to register each of the under‐treatment CT images to the planning CT image. The resultant displacement vector fields were used to automatically segment planning CT organs by deformably mapping manual contours on the treatment CT's to the planning CT. For qualitative assessment of automatic and manual contours, trial was conducted with four radiation oncology residents. Each resident was shown sets of randomly chosen manual or automatic bladder, prostate and rectum contours overlaid on the planning CT image in Pinnacle (Philips TPS) using a total of hundred‐thirty‐five contours. Residents were asked to accept/reject contour based on its clinical usability. Quantitatively, surface distances and DICE coefficient were computed between inter‐observer manual contours (manual/manual) and between each automatic and its corresponding manual contour (auto/manual). Results: No statistically significant differences were found in mean surface distances between manual/manual and auto/manual contours for bladder and rectum while manual/manual contour distances were significantly smaller for prostate. The distribution of DICE values between manual/manual and auto/manual contours were also similar. Qualitatively, acceptance rates for manual contours were significantly higher than that for automatic contours. Conclusion: No correspondence was found between qualitative and quantitative measure for manual and automatic contours for rectum and bladder while the two measures appear to be related for prostate. This study suggests that using quantitative measures for evaluating auto‐segmentation without a qualitative calibration might not always be predictive of its clinical usefulness.(Supported by NIH P01CA166602) This work was supported by NIH Grant P01 CA 166602 E. Weiss and J. Williamson have grants from Varian medical systems and Philips Radiation Oncology Systems.",
author = "A. Gautam and E. Weiss and J. Williamson and John Ford and W. Sleeman and N. Jan and S. Saraiya and M. Orton and L. Zhang and M. Murphy",
year = "2013",
doi = "10.1118/1.4813955",
language = "English (US)",
volume = "40",
journal = "Medical Physics",
issn = "0094-2405",
publisher = "AAPM - American Association of Physicists in Medicine",
number = "6",

}

TY - JOUR

T1 - SU‐C‐WAB‐03

T2 - Assessing the Correlation Between Quantitative Measures of Contour Variability and Physician's Qualitative Measure for Clinical Usefulness of Auto‐Segmentation in Prostate Cancer Radiotherapy

AU - Gautam, A.

AU - Weiss, E.

AU - Williamson, J.

AU - Ford, John

AU - Sleeman, W.

AU - Jan, N.

AU - Saraiya, S.

AU - Orton, M.

AU - Zhang, L.

AU - Murphy, M.

PY - 2013

Y1 - 2013

N2 - Purpose: To assess the correlation between quantitative measures of contour variability and physician's qualitative measure for clinical usefulness of auto‐segmentation in prostate cancer radiotherapy Methods: Our study was based on three serial CT images (one planning and two under‐treatment image sets) for each of five prostate cancer patients. On each CT image, bladder, prostate and rectum were manually contoured by three experienced physicians. Deformable image registration (ITK Demons) was used to register each of the under‐treatment CT images to the planning CT image. The resultant displacement vector fields were used to automatically segment planning CT organs by deformably mapping manual contours on the treatment CT's to the planning CT. For qualitative assessment of automatic and manual contours, trial was conducted with four radiation oncology residents. Each resident was shown sets of randomly chosen manual or automatic bladder, prostate and rectum contours overlaid on the planning CT image in Pinnacle (Philips TPS) using a total of hundred‐thirty‐five contours. Residents were asked to accept/reject contour based on its clinical usability. Quantitatively, surface distances and DICE coefficient were computed between inter‐observer manual contours (manual/manual) and between each automatic and its corresponding manual contour (auto/manual). Results: No statistically significant differences were found in mean surface distances between manual/manual and auto/manual contours for bladder and rectum while manual/manual contour distances were significantly smaller for prostate. The distribution of DICE values between manual/manual and auto/manual contours were also similar. Qualitatively, acceptance rates for manual contours were significantly higher than that for automatic contours. Conclusion: No correspondence was found between qualitative and quantitative measure for manual and automatic contours for rectum and bladder while the two measures appear to be related for prostate. This study suggests that using quantitative measures for evaluating auto‐segmentation without a qualitative calibration might not always be predictive of its clinical usefulness.(Supported by NIH P01CA166602) This work was supported by NIH Grant P01 CA 166602 E. Weiss and J. Williamson have grants from Varian medical systems and Philips Radiation Oncology Systems.

AB - Purpose: To assess the correlation between quantitative measures of contour variability and physician's qualitative measure for clinical usefulness of auto‐segmentation in prostate cancer radiotherapy Methods: Our study was based on three serial CT images (one planning and two under‐treatment image sets) for each of five prostate cancer patients. On each CT image, bladder, prostate and rectum were manually contoured by three experienced physicians. Deformable image registration (ITK Demons) was used to register each of the under‐treatment CT images to the planning CT image. The resultant displacement vector fields were used to automatically segment planning CT organs by deformably mapping manual contours on the treatment CT's to the planning CT. For qualitative assessment of automatic and manual contours, trial was conducted with four radiation oncology residents. Each resident was shown sets of randomly chosen manual or automatic bladder, prostate and rectum contours overlaid on the planning CT image in Pinnacle (Philips TPS) using a total of hundred‐thirty‐five contours. Residents were asked to accept/reject contour based on its clinical usability. Quantitatively, surface distances and DICE coefficient were computed between inter‐observer manual contours (manual/manual) and between each automatic and its corresponding manual contour (auto/manual). Results: No statistically significant differences were found in mean surface distances between manual/manual and auto/manual contours for bladder and rectum while manual/manual contour distances were significantly smaller for prostate. The distribution of DICE values between manual/manual and auto/manual contours were also similar. Qualitatively, acceptance rates for manual contours were significantly higher than that for automatic contours. Conclusion: No correspondence was found between qualitative and quantitative measure for manual and automatic contours for rectum and bladder while the two measures appear to be related for prostate. This study suggests that using quantitative measures for evaluating auto‐segmentation without a qualitative calibration might not always be predictive of its clinical usefulness.(Supported by NIH P01CA166602) This work was supported by NIH Grant P01 CA 166602 E. Weiss and J. Williamson have grants from Varian medical systems and Philips Radiation Oncology Systems.

UR - http://www.scopus.com/inward/record.url?scp=85024779809&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85024779809&partnerID=8YFLogxK

U2 - 10.1118/1.4813955

DO - 10.1118/1.4813955

M3 - Article

AN - SCOPUS:85024779809

VL - 40

JO - Medical Physics

JF - Medical Physics

SN - 0094-2405

IS - 6

ER -