Reproducibility of the NEPTUNE descriptor-based scoring system on whole-slide images and histologic and ultrastructural digital images

Laura Barisoni, Jonathan P. Troost, Cynthia Nast, Serena Bagnasco, Carmen Avila-Casado, Jeffrey Hodgin, Matthew Palmer, Avi Rosenberg, Adil Gasim, Chrysta Liensziewski, Lino Merlino, Hui Ping Chien, Anthony Chang, Shane M. Meehan, Joseph Gaut, Peter Song, Lawrence Holzman, Debbie Gibson, Matthias Kretzler, Brenda W. GillespieStephen M. Hewitt

Research output: Contribution to journalArticle

19 Scopus citations

Abstract

The multicenter Nephrotic Syndrome Study Network (NEPTUNE) digital pathology scoring system employs a novel and comprehensive methodology to document pathologic features from whole-slide images, immunofluorescence and ultrastructural digital images. To estimate inter-and intra-reader concordance of this descriptor-based approach, data from 12 pathologists (eight NEPTUNE and four non-NEPTUNE) with experience from training to 30 years were collected. A descriptor reference manual was generated and a webinar-based protocol for consensus/cross-Training implemented. Intra-reader concordance for 51 glomerular descriptors was evaluated on jpeg images by seven NEPTUNE pathologists scoring 131 glomeruli three times (Tests I, II, and III), each test following a consensus webinar review. Inter-reader concordance of glomerular descriptors was evaluated in 315 glomeruli by all pathologists; interstitial fibrosis and tubular atrophy (244 cases, whole-slide images) and four ultrastructural podocyte descriptors (178 cases, jpeg images) were evaluated once by six and five pathologists, respectively. Cohen's kappa for inter-reader concordance for 48/51 glomerular descriptors with sufficient observations was moderate (0.40<kappa≤0.60) for 17 and good (0.60<kappa≤0.80) for 8, for 52% with moderate or better kappas. Clustering of glomerular descriptors based on similar pathologic features improved concordance. Concordance was independent of years of experience, and increased with webinar cross-Training. Excellent concordance was achieved for interstitial fibrosis and tubular atrophy. Moderate-To-excellent concordance was achieved for all ultrastructural podocyte descriptors, with good-To-excellent concordance for descriptors commonly used in clinical practice, foot process effacement, and microvillous transformation. NEPTUNE digital pathology scoring system enables novel morphologic profiling of renal structures. For all histologic and ultrastructural descriptors tested with sufficient observations, moderate-To-excellent concordance was seen for 31/54 (57%). Descriptors not sufficiently represented will require further testing. This study proffers the NEPTUNE digital pathology scoring system as a model for standardization of renal biopsy interpretation extendable outside the NEPTUNE consortium, enabling international collaborations.

Original languageEnglish (US)
Pages (from-to)671-684
Number of pages14
JournalModern Pathology
Volume29
Issue number7
DOIs
StatePublished - Jul 1 2016

ASJC Scopus subject areas

  • Pathology and Forensic Medicine

Fingerprint Dive into the research topics of 'Reproducibility of the NEPTUNE descriptor-based scoring system on whole-slide images and histologic and ultrastructural digital images'. Together they form a unique fingerprint.

  • Cite this

    Barisoni, L., Troost, J. P., Nast, C., Bagnasco, S., Avila-Casado, C., Hodgin, J., Palmer, M., Rosenberg, A., Gasim, A., Liensziewski, C., Merlino, L., Chien, H. P., Chang, A., Meehan, S. M., Gaut, J., Song, P., Holzman, L., Gibson, D., Kretzler, M., ... Hewitt, S. M. (2016). Reproducibility of the NEPTUNE descriptor-based scoring system on whole-slide images and histologic and ultrastructural digital images. Modern Pathology, 29(7), 671-684. https://doi.org/10.1038/modpathol.2016.58