Reliability and initial validation of the ulcerative colitis endoscopic index of severity

Simon P L Travis, Dan Schnell, Piotr Krzeski, Maria T Abreu, Douglas G. Altman, Jean Frédéric Colombel, Brian G. Feagan, Stephen B. Hanauer, Gary R. Lichtenstein, Philippe R. Marteau, Walter Reinisch, Bruce E. Sands, Bruce R. Yacyshyn, Patrick Schnell, Christian A. Bernhardt, Jean Yves Mary, William J. Sandborn

Research output: Contribution to journalArticle

130 Citations (Scopus)

Abstract

Background & Aims We studied the reliability of the previously described Ulcerative Colitis Endoscopic Index of Severity (UCEIS) and validated it with an independent cohort of investigators. Methods We created a new library of 57 videos of flexible sigmoidoscopy and stratified them based on disease severity. Twenty-five investigators were each randomly assigned to assess 28 videos (which included 4 duplicates to assess intraobserver reliability). Investigators were blinded to clinical details except for 2 of 4 duplicated videos (to assess the impact of knowledge of symptoms on assessment). Three descriptors ("vascular pattern", "bleeding", and "erosions and ulcers") comprising the UCEIS were scored with a visual analogue scale (VAS) to assess overall severity. Intrainvestigator and interinvestigator agreement was characterized by κ statistical analysis; reliability ratios were used to compare VAS and UCEIS scores. Results There was a high level of correlation between UCEIS scores and overall assessment of severity (correlation coefficient, 0.93). Internal consistency (Cronbach α analysis) was 0.86. Intrainvestigator and interinvestigator reliability ratios for UCEIS scores were 0.96 and 0.88, respectively. Intrainvestigator agreement in determination of the UCEIS score was good (κ = 0.72), with individual descriptors ranging from a κ of 0.47 (for bleeding) to 0.87 (for vascular pattern). Interinvestigator agreement in determination of UCEIS scores was moderate (κ = 0.50), with descriptors ranging from a κ of 0.48 (for bleeding) to 0.54 (for vascular pattern). Intrainvestigator variability in determining UCEIS scores did not change appreciably when a video was presented with clinical details. Conclusions The UCEIS and its components show satisfactory intrainvestigator and interinvestigator reliability. Among investigators, the UCEIS accounted for a median of 86% of the variability in evaluation of overall severity on the VAS when assessing the endoscopic severity of UC and was unaffected by knowledge of clinical details.

Original languageEnglish
Pages (from-to)987-995
Number of pages9
JournalGastroenterology
Volume145
Issue number5
DOIs
StatePublished - Nov 1 2013

Fingerprint

Ulcerative Colitis
Visual Analog Scale
Research Personnel
Blood Vessels
Hemorrhage
Sigmoidoscopy
Symptom Assessment
Libraries
Ulcer

Keywords

  • Disease Activity
  • Endoscopic Score
  • Endoscopic Severity
  • Inflammatory Bowel Disease

ASJC Scopus subject areas

  • Gastroenterology

Cite this

Travis, S. P. L., Schnell, D., Krzeski, P., Abreu, M. T., Altman, D. G., Colombel, J. F., ... Sandborn, W. J. (2013). Reliability and initial validation of the ulcerative colitis endoscopic index of severity. Gastroenterology, 145(5), 987-995. https://doi.org/10.1053/j.gastro.2013.07.024

Reliability and initial validation of the ulcerative colitis endoscopic index of severity. / Travis, Simon P L; Schnell, Dan; Krzeski, Piotr; Abreu, Maria T; Altman, Douglas G.; Colombel, Jean Frédéric; Feagan, Brian G.; Hanauer, Stephen B.; Lichtenstein, Gary R.; Marteau, Philippe R.; Reinisch, Walter; Sands, Bruce E.; Yacyshyn, Bruce R.; Schnell, Patrick; Bernhardt, Christian A.; Mary, Jean Yves; Sandborn, William J.

In: Gastroenterology, Vol. 145, No. 5, 01.11.2013, p. 987-995.

Research output: Contribution to journalArticle

Travis, SPL, Schnell, D, Krzeski, P, Abreu, MT, Altman, DG, Colombel, JF, Feagan, BG, Hanauer, SB, Lichtenstein, GR, Marteau, PR, Reinisch, W, Sands, BE, Yacyshyn, BR, Schnell, P, Bernhardt, CA, Mary, JY & Sandborn, WJ 2013, 'Reliability and initial validation of the ulcerative colitis endoscopic index of severity', Gastroenterology, vol. 145, no. 5, pp. 987-995. https://doi.org/10.1053/j.gastro.2013.07.024
Travis, Simon P L ; Schnell, Dan ; Krzeski, Piotr ; Abreu, Maria T ; Altman, Douglas G. ; Colombel, Jean Frédéric ; Feagan, Brian G. ; Hanauer, Stephen B. ; Lichtenstein, Gary R. ; Marteau, Philippe R. ; Reinisch, Walter ; Sands, Bruce E. ; Yacyshyn, Bruce R. ; Schnell, Patrick ; Bernhardt, Christian A. ; Mary, Jean Yves ; Sandborn, William J. / Reliability and initial validation of the ulcerative colitis endoscopic index of severity. In: Gastroenterology. 2013 ; Vol. 145, No. 5. pp. 987-995.
@article{177401705a284829a5a7bb1c362573e2,
title = "Reliability and initial validation of the ulcerative colitis endoscopic index of severity",
abstract = "Background & Aims We studied the reliability of the previously described Ulcerative Colitis Endoscopic Index of Severity (UCEIS) and validated it with an independent cohort of investigators. Methods We created a new library of 57 videos of flexible sigmoidoscopy and stratified them based on disease severity. Twenty-five investigators were each randomly assigned to assess 28 videos (which included 4 duplicates to assess intraobserver reliability). Investigators were blinded to clinical details except for 2 of 4 duplicated videos (to assess the impact of knowledge of symptoms on assessment). Three descriptors ({"}vascular pattern{"}, {"}bleeding{"}, and {"}erosions and ulcers{"}) comprising the UCEIS were scored with a visual analogue scale (VAS) to assess overall severity. Intrainvestigator and interinvestigator agreement was characterized by κ statistical analysis; reliability ratios were used to compare VAS and UCEIS scores. Results There was a high level of correlation between UCEIS scores and overall assessment of severity (correlation coefficient, 0.93). Internal consistency (Cronbach α analysis) was 0.86. Intrainvestigator and interinvestigator reliability ratios for UCEIS scores were 0.96 and 0.88, respectively. Intrainvestigator agreement in determination of the UCEIS score was good (κ = 0.72), with individual descriptors ranging from a κ of 0.47 (for bleeding) to 0.87 (for vascular pattern). Interinvestigator agreement in determination of UCEIS scores was moderate (κ = 0.50), with descriptors ranging from a κ of 0.48 (for bleeding) to 0.54 (for vascular pattern). Intrainvestigator variability in determining UCEIS scores did not change appreciably when a video was presented with clinical details. Conclusions The UCEIS and its components show satisfactory intrainvestigator and interinvestigator reliability. Among investigators, the UCEIS accounted for a median of 86{\%} of the variability in evaluation of overall severity on the VAS when assessing the endoscopic severity of UC and was unaffected by knowledge of clinical details.",
keywords = "Disease Activity, Endoscopic Score, Endoscopic Severity, Inflammatory Bowel Disease",
author = "Travis, {Simon P L} and Dan Schnell and Piotr Krzeski and Abreu, {Maria T} and Altman, {Douglas G.} and Colombel, {Jean Fr{\'e}d{\'e}ric} and Feagan, {Brian G.} and Hanauer, {Stephen B.} and Lichtenstein, {Gary R.} and Marteau, {Philippe R.} and Walter Reinisch and Sands, {Bruce E.} and Yacyshyn, {Bruce R.} and Patrick Schnell and Bernhardt, {Christian A.} and Mary, {Jean Yves} and Sandborn, {William J.}",
year = "2013",
month = "11",
day = "1",
doi = "10.1053/j.gastro.2013.07.024",
language = "English",
volume = "145",
pages = "987--995",
journal = "Gastroenterology",
issn = "0016-5085",
publisher = "W.B. Saunders Ltd",
number = "5",

}

TY - JOUR

T1 - Reliability and initial validation of the ulcerative colitis endoscopic index of severity

AU - Travis, Simon P L

AU - Schnell, Dan

AU - Krzeski, Piotr

AU - Abreu, Maria T

AU - Altman, Douglas G.

AU - Colombel, Jean Frédéric

AU - Feagan, Brian G.

AU - Hanauer, Stephen B.

AU - Lichtenstein, Gary R.

AU - Marteau, Philippe R.

AU - Reinisch, Walter

AU - Sands, Bruce E.

AU - Yacyshyn, Bruce R.

AU - Schnell, Patrick

AU - Bernhardt, Christian A.

AU - Mary, Jean Yves

AU - Sandborn, William J.

PY - 2013/11/1

Y1 - 2013/11/1

N2 - Background & Aims We studied the reliability of the previously described Ulcerative Colitis Endoscopic Index of Severity (UCEIS) and validated it with an independent cohort of investigators. Methods We created a new library of 57 videos of flexible sigmoidoscopy and stratified them based on disease severity. Twenty-five investigators were each randomly assigned to assess 28 videos (which included 4 duplicates to assess intraobserver reliability). Investigators were blinded to clinical details except for 2 of 4 duplicated videos (to assess the impact of knowledge of symptoms on assessment). Three descriptors ("vascular pattern", "bleeding", and "erosions and ulcers") comprising the UCEIS were scored with a visual analogue scale (VAS) to assess overall severity. Intrainvestigator and interinvestigator agreement was characterized by κ statistical analysis; reliability ratios were used to compare VAS and UCEIS scores. Results There was a high level of correlation between UCEIS scores and overall assessment of severity (correlation coefficient, 0.93). Internal consistency (Cronbach α analysis) was 0.86. Intrainvestigator and interinvestigator reliability ratios for UCEIS scores were 0.96 and 0.88, respectively. Intrainvestigator agreement in determination of the UCEIS score was good (κ = 0.72), with individual descriptors ranging from a κ of 0.47 (for bleeding) to 0.87 (for vascular pattern). Interinvestigator agreement in determination of UCEIS scores was moderate (κ = 0.50), with descriptors ranging from a κ of 0.48 (for bleeding) to 0.54 (for vascular pattern). Intrainvestigator variability in determining UCEIS scores did not change appreciably when a video was presented with clinical details. Conclusions The UCEIS and its components show satisfactory intrainvestigator and interinvestigator reliability. Among investigators, the UCEIS accounted for a median of 86% of the variability in evaluation of overall severity on the VAS when assessing the endoscopic severity of UC and was unaffected by knowledge of clinical details.

AB - Background & Aims We studied the reliability of the previously described Ulcerative Colitis Endoscopic Index of Severity (UCEIS) and validated it with an independent cohort of investigators. Methods We created a new library of 57 videos of flexible sigmoidoscopy and stratified them based on disease severity. Twenty-five investigators were each randomly assigned to assess 28 videos (which included 4 duplicates to assess intraobserver reliability). Investigators were blinded to clinical details except for 2 of 4 duplicated videos (to assess the impact of knowledge of symptoms on assessment). Three descriptors ("vascular pattern", "bleeding", and "erosions and ulcers") comprising the UCEIS were scored with a visual analogue scale (VAS) to assess overall severity. Intrainvestigator and interinvestigator agreement was characterized by κ statistical analysis; reliability ratios were used to compare VAS and UCEIS scores. Results There was a high level of correlation between UCEIS scores and overall assessment of severity (correlation coefficient, 0.93). Internal consistency (Cronbach α analysis) was 0.86. Intrainvestigator and interinvestigator reliability ratios for UCEIS scores were 0.96 and 0.88, respectively. Intrainvestigator agreement in determination of the UCEIS score was good (κ = 0.72), with individual descriptors ranging from a κ of 0.47 (for bleeding) to 0.87 (for vascular pattern). Interinvestigator agreement in determination of UCEIS scores was moderate (κ = 0.50), with descriptors ranging from a κ of 0.48 (for bleeding) to 0.54 (for vascular pattern). Intrainvestigator variability in determining UCEIS scores did not change appreciably when a video was presented with clinical details. Conclusions The UCEIS and its components show satisfactory intrainvestigator and interinvestigator reliability. Among investigators, the UCEIS accounted for a median of 86% of the variability in evaluation of overall severity on the VAS when assessing the endoscopic severity of UC and was unaffected by knowledge of clinical details.

KW - Disease Activity

KW - Endoscopic Score

KW - Endoscopic Severity

KW - Inflammatory Bowel Disease

UR - http://www.scopus.com/inward/record.url?scp=84886775628&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84886775628&partnerID=8YFLogxK

U2 - 10.1053/j.gastro.2013.07.024

DO - 10.1053/j.gastro.2013.07.024

M3 - Article

VL - 145

SP - 987

EP - 995

JO - Gastroenterology

JF - Gastroenterology

SN - 0016-5085

IS - 5

ER -