Plus Disease in Retinopathy of Prematurity: Diagnostic Trends in 2016 Versus 2007

Chace Moleta, J. Peter Campbell, Jayashree Kalpathy-Cramer, R. V Paul Chan, Susan Ostmo, Karyn Jonas, Michael F. Chiang, Michael F. Chiang, Susan Ostmo, Kemal Sonmez, J. Peter Campbell, R. V Paul Chan, Karyn Jonas, Jason Horowitz, Osode Coki, Cheryl Ann Eccles, Leora Sarna, Audina Berrocal, Catherin Negron, Kimberly DenserKristi Cumming, Tammy Osentoski, Tammy Check, Mary Zajechowski, Thomas Lee, Evan Kruger, Kathryn McGovern, Charles Simmons, Raghu Murthy, Sharon Galvis, Jerome Rotter, Ida Chen, Xiaohui Li, Kent Taylor, Kaye Roll, Jayashree Kalpathy-Cramer, Deniz Erdogmus, Stratis Ioannidis, Maria Ana Martinez-Castellanos, Samantha Salinas-Longoria, Rafael Romero, Andrea Arriola, Francisco Olguin-Manriquez, Miroslava Meraz-Gutierrez, Carlos M. Dulanto-Reinoso, Cristina Montero-Mendoza, & Informatics in ROP Research Consortium Imaging & Informatics in ROP Research Consortium, & Informatics in ROP Research Consortium Imaging & Informatics in ROP Research Consortium

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Purpose To identify any temporal trends in the diagnosis of plus disease in retinopathy of prematurity (ROP) by experts. Design Reliability analysis. Methods ROP experts were recruited in 2007 and 2016 to classify 34 wide-field fundus images of ROP as plus, pre-plus, or normal, coded as “3,” “2,” and “1,” respectively, in the database. The main outcome was the average calculated score for each image in each cohort. Secondary outcomes included correlation on the relative ordering of the images in 2016 vs 2007, interexpert agreement, and intraexpert agreement. Results The average score for each image was higher for 30 of 34 (88%) images in 2016 compared with 2007, influenced by fewer images classified as normal (P < .01), a similar number of pre-plus (P = .52), and more classified as plus (P < .01). The mean weighted kappa values in 2006 were 0.36 (range 0.21–0.60), compared with 0.22 (range 0–0.40) in 2016. There was good correlation between rankings of disease severity between the 2 cohorts (Spearman rank correlation ρ = 0.94), indicating near-perfect agreement on relative disease severity. Conclusions Despite good agreement between cohorts on relative disease severity ranking, the higher average score and classifications for each image demonstrate that experts are diagnosing pre-plus and plus disease at earlier stages of disease severity in 2016, compared with 2007. This has implications for patient care, research, and teaching, and additional studies are needed to better understand this temporal trend in image-based plus disease diagnosis.

Original languageEnglish (US)
Pages (from-to)70-76
Number of pages7
JournalAmerican Journal of Ophthalmology
Volume176
DOIs
StatePublished - Apr 1 2017

Fingerprint

Retinopathy of Prematurity
Patient Care
Teaching
Databases
Research

ASJC Scopus subject areas

  • Ophthalmology

Cite this

Moleta, C., Campbell, J. P., Kalpathy-Cramer, J., Chan, R. V. P., Ostmo, S., Jonas, K., ... Imaging & Informatics in ROP Research Consortium, . I. I. ROP. R. C. (2017). Plus Disease in Retinopathy of Prematurity: Diagnostic Trends in 2016 Versus 2007. American Journal of Ophthalmology, 176, 70-76. https://doi.org/10.1016/j.ajo.2016.12.025

Plus Disease in Retinopathy of Prematurity : Diagnostic Trends in 2016 Versus 2007. / Moleta, Chace; Campbell, J. Peter; Kalpathy-Cramer, Jayashree; Chan, R. V Paul; Ostmo, Susan; Jonas, Karyn; Chiang, Michael F.; Chiang, Michael F.; Ostmo, Susan; Sonmez, Kemal; Campbell, J. Peter; Chan, R. V Paul; Jonas, Karyn; Horowitz, Jason; Coki, Osode; Eccles, Cheryl Ann; Sarna, Leora; Berrocal, Audina; Negron, Catherin; Denser, Kimberly; Cumming, Kristi; Osentoski, Tammy; Check, Tammy; Zajechowski, Mary; Lee, Thomas; Kruger, Evan; McGovern, Kathryn; Simmons, Charles; Murthy, Raghu; Galvis, Sharon; Rotter, Jerome; Chen, Ida; Li, Xiaohui; Taylor, Kent; Roll, Kaye; Kalpathy-Cramer, Jayashree; Erdogmus, Deniz; Ioannidis, Stratis; Martinez-Castellanos, Maria Ana; Salinas-Longoria, Samantha; Romero, Rafael; Arriola, Andrea; Olguin-Manriquez, Francisco; Meraz-Gutierrez, Miroslava; Dulanto-Reinoso, Carlos M.; Montero-Mendoza, Cristina; Imaging & Informatics in ROP Research Consortium, & Informatics in ROP Research Consortium; Imaging & Informatics in ROP Research Consortium, & Informatics in ROP Research Consortium.

In: American Journal of Ophthalmology, Vol. 176, 01.04.2017, p. 70-76.

Research output: Contribution to journalArticle

Moleta, C, Campbell, JP, Kalpathy-Cramer, J, Chan, RVP, Ostmo, S, Jonas, K, Chiang, MF, Chiang, MF, Ostmo, S, Sonmez, K, Campbell, JP, Chan, RVP, Jonas, K, Horowitz, J, Coki, O, Eccles, CA, Sarna, L, Berrocal, A, Negron, C, Denser, K, Cumming, K, Osentoski, T, Check, T, Zajechowski, M, Lee, T, Kruger, E, McGovern, K, Simmons, C, Murthy, R, Galvis, S, Rotter, J, Chen, I, Li, X, Taylor, K, Roll, K, Kalpathy-Cramer, J, Erdogmus, D, Ioannidis, S, Martinez-Castellanos, MA, Salinas-Longoria, S, Romero, R, Arriola, A, Olguin-Manriquez, F, Meraz-Gutierrez, M, Dulanto-Reinoso, CM, Montero-Mendoza, C, Imaging & Informatics in ROP Research Consortium, IIROPRC & Imaging & Informatics in ROP Research Consortium, IIROPRC 2017, 'Plus Disease in Retinopathy of Prematurity: Diagnostic Trends in 2016 Versus 2007', American Journal of Ophthalmology, vol. 176, pp. 70-76. https://doi.org/10.1016/j.ajo.2016.12.025
Moleta, Chace ; Campbell, J. Peter ; Kalpathy-Cramer, Jayashree ; Chan, R. V Paul ; Ostmo, Susan ; Jonas, Karyn ; Chiang, Michael F. ; Chiang, Michael F. ; Ostmo, Susan ; Sonmez, Kemal ; Campbell, J. Peter ; Chan, R. V Paul ; Jonas, Karyn ; Horowitz, Jason ; Coki, Osode ; Eccles, Cheryl Ann ; Sarna, Leora ; Berrocal, Audina ; Negron, Catherin ; Denser, Kimberly ; Cumming, Kristi ; Osentoski, Tammy ; Check, Tammy ; Zajechowski, Mary ; Lee, Thomas ; Kruger, Evan ; McGovern, Kathryn ; Simmons, Charles ; Murthy, Raghu ; Galvis, Sharon ; Rotter, Jerome ; Chen, Ida ; Li, Xiaohui ; Taylor, Kent ; Roll, Kaye ; Kalpathy-Cramer, Jayashree ; Erdogmus, Deniz ; Ioannidis, Stratis ; Martinez-Castellanos, Maria Ana ; Salinas-Longoria, Samantha ; Romero, Rafael ; Arriola, Andrea ; Olguin-Manriquez, Francisco ; Meraz-Gutierrez, Miroslava ; Dulanto-Reinoso, Carlos M. ; Montero-Mendoza, Cristina ; Imaging & Informatics in ROP Research Consortium, & Informatics in ROP Research Consortium ; Imaging & Informatics in ROP Research Consortium, & Informatics in ROP Research Consortium. / Plus Disease in Retinopathy of Prematurity : Diagnostic Trends in 2016 Versus 2007. In: American Journal of Ophthalmology. 2017 ; Vol. 176. pp. 70-76.
@article{1727ad05484e482ab1e673f2c51d4482,
title = "Plus Disease in Retinopathy of Prematurity: Diagnostic Trends in 2016 Versus 2007",
abstract = "Purpose To identify any temporal trends in the diagnosis of plus disease in retinopathy of prematurity (ROP) by experts. Design Reliability analysis. Methods ROP experts were recruited in 2007 and 2016 to classify 34 wide-field fundus images of ROP as plus, pre-plus, or normal, coded as “3,” “2,” and “1,” respectively, in the database. The main outcome was the average calculated score for each image in each cohort. Secondary outcomes included correlation on the relative ordering of the images in 2016 vs 2007, interexpert agreement, and intraexpert agreement. Results The average score for each image was higher for 30 of 34 (88{\%}) images in 2016 compared with 2007, influenced by fewer images classified as normal (P < .01), a similar number of pre-plus (P = .52), and more classified as plus (P < .01). The mean weighted kappa values in 2006 were 0.36 (range 0.21–0.60), compared with 0.22 (range 0–0.40) in 2016. There was good correlation between rankings of disease severity between the 2 cohorts (Spearman rank correlation ρ = 0.94), indicating near-perfect agreement on relative disease severity. Conclusions Despite good agreement between cohorts on relative disease severity ranking, the higher average score and classifications for each image demonstrate that experts are diagnosing pre-plus and plus disease at earlier stages of disease severity in 2016, compared with 2007. This has implications for patient care, research, and teaching, and additional studies are needed to better understand this temporal trend in image-based plus disease diagnosis.",
author = "Chace Moleta and Campbell, {J. Peter} and Jayashree Kalpathy-Cramer and Chan, {R. V Paul} and Susan Ostmo and Karyn Jonas and Chiang, {Michael F.} and Chiang, {Michael F.} and Susan Ostmo and Kemal Sonmez and Campbell, {J. Peter} and Chan, {R. V Paul} and Karyn Jonas and Jason Horowitz and Osode Coki and Eccles, {Cheryl Ann} and Leora Sarna and Audina Berrocal and Catherin Negron and Kimberly Denser and Kristi Cumming and Tammy Osentoski and Tammy Check and Mary Zajechowski and Thomas Lee and Evan Kruger and Kathryn McGovern and Charles Simmons and Raghu Murthy and Sharon Galvis and Jerome Rotter and Ida Chen and Xiaohui Li and Kent Taylor and Kaye Roll and Jayashree Kalpathy-Cramer and Deniz Erdogmus and Stratis Ioannidis and Martinez-Castellanos, {Maria Ana} and Samantha Salinas-Longoria and Rafael Romero and Andrea Arriola and Francisco Olguin-Manriquez and Miroslava Meraz-Gutierrez and Dulanto-Reinoso, {Carlos M.} and Cristina Montero-Mendoza and {Imaging & Informatics in ROP Research Consortium}, {& Informatics in ROP Research Consortium} and {Imaging & Informatics in ROP Research Consortium}, {& Informatics in ROP Research Consortium}",
year = "2017",
month = "4",
day = "1",
doi = "10.1016/j.ajo.2016.12.025",
language = "English (US)",
volume = "176",
pages = "70--76",
journal = "American Journal of Ophthalmology",
issn = "0002-9394",
publisher = "Elsevier USA",

}

TY - JOUR

T1 - Plus Disease in Retinopathy of Prematurity

T2 - Diagnostic Trends in 2016 Versus 2007

AU - Moleta, Chace

AU - Campbell, J. Peter

AU - Kalpathy-Cramer, Jayashree

AU - Chan, R. V Paul

AU - Ostmo, Susan

AU - Jonas, Karyn

AU - Chiang, Michael F.

AU - Chiang, Michael F.

AU - Ostmo, Susan

AU - Sonmez, Kemal

AU - Campbell, J. Peter

AU - Chan, R. V Paul

AU - Jonas, Karyn

AU - Horowitz, Jason

AU - Coki, Osode

AU - Eccles, Cheryl Ann

AU - Sarna, Leora

AU - Berrocal, Audina

AU - Negron, Catherin

AU - Denser, Kimberly

AU - Cumming, Kristi

AU - Osentoski, Tammy

AU - Check, Tammy

AU - Zajechowski, Mary

AU - Lee, Thomas

AU - Kruger, Evan

AU - McGovern, Kathryn

AU - Simmons, Charles

AU - Murthy, Raghu

AU - Galvis, Sharon

AU - Rotter, Jerome

AU - Chen, Ida

AU - Li, Xiaohui

AU - Taylor, Kent

AU - Roll, Kaye

AU - Kalpathy-Cramer, Jayashree

AU - Erdogmus, Deniz

AU - Ioannidis, Stratis

AU - Martinez-Castellanos, Maria Ana

AU - Salinas-Longoria, Samantha

AU - Romero, Rafael

AU - Arriola, Andrea

AU - Olguin-Manriquez, Francisco

AU - Meraz-Gutierrez, Miroslava

AU - Dulanto-Reinoso, Carlos M.

AU - Montero-Mendoza, Cristina

AU - Imaging & Informatics in ROP Research Consortium, & Informatics in ROP Research Consortium

AU - Imaging & Informatics in ROP Research Consortium, & Informatics in ROP Research Consortium

PY - 2017/4/1

Y1 - 2017/4/1

N2 - Purpose To identify any temporal trends in the diagnosis of plus disease in retinopathy of prematurity (ROP) by experts. Design Reliability analysis. Methods ROP experts were recruited in 2007 and 2016 to classify 34 wide-field fundus images of ROP as plus, pre-plus, or normal, coded as “3,” “2,” and “1,” respectively, in the database. The main outcome was the average calculated score for each image in each cohort. Secondary outcomes included correlation on the relative ordering of the images in 2016 vs 2007, interexpert agreement, and intraexpert agreement. Results The average score for each image was higher for 30 of 34 (88%) images in 2016 compared with 2007, influenced by fewer images classified as normal (P < .01), a similar number of pre-plus (P = .52), and more classified as plus (P < .01). The mean weighted kappa values in 2006 were 0.36 (range 0.21–0.60), compared with 0.22 (range 0–0.40) in 2016. There was good correlation between rankings of disease severity between the 2 cohorts (Spearman rank correlation ρ = 0.94), indicating near-perfect agreement on relative disease severity. Conclusions Despite good agreement between cohorts on relative disease severity ranking, the higher average score and classifications for each image demonstrate that experts are diagnosing pre-plus and plus disease at earlier stages of disease severity in 2016, compared with 2007. This has implications for patient care, research, and teaching, and additional studies are needed to better understand this temporal trend in image-based plus disease diagnosis.

AB - Purpose To identify any temporal trends in the diagnosis of plus disease in retinopathy of prematurity (ROP) by experts. Design Reliability analysis. Methods ROP experts were recruited in 2007 and 2016 to classify 34 wide-field fundus images of ROP as plus, pre-plus, or normal, coded as “3,” “2,” and “1,” respectively, in the database. The main outcome was the average calculated score for each image in each cohort. Secondary outcomes included correlation on the relative ordering of the images in 2016 vs 2007, interexpert agreement, and intraexpert agreement. Results The average score for each image was higher for 30 of 34 (88%) images in 2016 compared with 2007, influenced by fewer images classified as normal (P < .01), a similar number of pre-plus (P = .52), and more classified as plus (P < .01). The mean weighted kappa values in 2006 were 0.36 (range 0.21–0.60), compared with 0.22 (range 0–0.40) in 2016. There was good correlation between rankings of disease severity between the 2 cohorts (Spearman rank correlation ρ = 0.94), indicating near-perfect agreement on relative disease severity. Conclusions Despite good agreement between cohorts on relative disease severity ranking, the higher average score and classifications for each image demonstrate that experts are diagnosing pre-plus and plus disease at earlier stages of disease severity in 2016, compared with 2007. This has implications for patient care, research, and teaching, and additional studies are needed to better understand this temporal trend in image-based plus disease diagnosis.

UR - http://www.scopus.com/inward/record.url?scp=85010285162&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85010285162&partnerID=8YFLogxK

U2 - 10.1016/j.ajo.2016.12.025

DO - 10.1016/j.ajo.2016.12.025

M3 - Article

C2 - 28087400

AN - SCOPUS:85010285162

VL - 176

SP - 70

EP - 76

JO - American Journal of Ophthalmology

JF - American Journal of Ophthalmology

SN - 0002-9394

ER -