Inter- and Intrarater Reliability in Computed Axial Tomographic Grading of Splenic Injury: Why so Many Grading Scales?

Erik S. Barquist, Louis R Pizano, William J Feuer, Peter A. Pappas, Kimberly A. McKenney, Suzanne D. LeBlang, Robert P. Henry, Luis Rivas, Stephen M. Cohn

Research output: Contribution to journalArticle

23 Citations (Scopus)

Abstract

Objective: After splenic trauma, critical decisions regarding operative intervention are often made with the aid of computed axial tomographic (CT) scan findings. No CT scan-based grading scale has been demonstrated to predict accurately which patients require operative or radiologic intervention for their splenic injuries. We hypothesized that use of the most common grading scale, the American Association for the Surgery of Trauma scale, would be associated with low intra- and interreliability scores. We assessed the ability of experienced trauma radiologists to differentiate grade III from grade IV splenic injuries. Methods: The films of patients who had undergone abdominal CT scanning before splenectomy for grade III or IV injuries were serially evaluated by four trauma radiology faculty weekly for 3 weeks. We assessed intra- and interrater reliability for grading and for presence of contrast blush. Results: Intrarater reproducibility yielded a weighted kappa score of 0.15 to 0.77. Interrater reliability weighted kappa scores ranged from 0 to 0.84, with a mean value of 0.23. Conclusion: CT imaging is not reliable for identifying grades III and IV splenic injury, as experienced radiologists often underestimate the magnitude of injury. Interrater reliability is poor. Factors other than the CT grade of splenic injury should determine whether patients require operative or angiographic therapy.

Original languageEnglish
Pages (from-to)334-338
Number of pages5
JournalJournal of Trauma - Injury, Infection and Critical Care
Volume56
Issue number2
StatePublished - Mar 16 2004

Fingerprint

Wounds and Injuries
Splenectomy
Radiology
Reproducibility of Results
Radiologists

Keywords

  • Abdominal trauma
  • Computed axial tomographic (CT) scan
  • Injury grading
  • Spleen
  • Splenic injury

ASJC Scopus subject areas

  • Surgery

Cite this

Inter- and Intrarater Reliability in Computed Axial Tomographic Grading of Splenic Injury : Why so Many Grading Scales? / Barquist, Erik S.; Pizano, Louis R; Feuer, William J; Pappas, Peter A.; McKenney, Kimberly A.; LeBlang, Suzanne D.; Henry, Robert P.; Rivas, Luis; Cohn, Stephen M.

In: Journal of Trauma - Injury, Infection and Critical Care, Vol. 56, No. 2, 16.03.2004, p. 334-338.

Research output: Contribution to journalArticle

Barquist, ES, Pizano, LR, Feuer, WJ, Pappas, PA, McKenney, KA, LeBlang, SD, Henry, RP, Rivas, L & Cohn, SM 2004, 'Inter- and Intrarater Reliability in Computed Axial Tomographic Grading of Splenic Injury: Why so Many Grading Scales?', Journal of Trauma - Injury, Infection and Critical Care, vol. 56, no. 2, pp. 334-338.
Barquist, Erik S. ; Pizano, Louis R ; Feuer, William J ; Pappas, Peter A. ; McKenney, Kimberly A. ; LeBlang, Suzanne D. ; Henry, Robert P. ; Rivas, Luis ; Cohn, Stephen M. / Inter- and Intrarater Reliability in Computed Axial Tomographic Grading of Splenic Injury : Why so Many Grading Scales?. In: Journal of Trauma - Injury, Infection and Critical Care. 2004 ; Vol. 56, No. 2. pp. 334-338.
@article{df0135a3ddc84609baa60ece19d4c6aa,
title = "Inter- and Intrarater Reliability in Computed Axial Tomographic Grading of Splenic Injury: Why so Many Grading Scales?",
abstract = "Objective: After splenic trauma, critical decisions regarding operative intervention are often made with the aid of computed axial tomographic (CT) scan findings. No CT scan-based grading scale has been demonstrated to predict accurately which patients require operative or radiologic intervention for their splenic injuries. We hypothesized that use of the most common grading scale, the American Association for the Surgery of Trauma scale, would be associated with low intra- and interreliability scores. We assessed the ability of experienced trauma radiologists to differentiate grade III from grade IV splenic injuries. Methods: The films of patients who had undergone abdominal CT scanning before splenectomy for grade III or IV injuries were serially evaluated by four trauma radiology faculty weekly for 3 weeks. We assessed intra- and interrater reliability for grading and for presence of contrast blush. Results: Intrarater reproducibility yielded a weighted kappa score of 0.15 to 0.77. Interrater reliability weighted kappa scores ranged from 0 to 0.84, with a mean value of 0.23. Conclusion: CT imaging is not reliable for identifying grades III and IV splenic injury, as experienced radiologists often underestimate the magnitude of injury. Interrater reliability is poor. Factors other than the CT grade of splenic injury should determine whether patients require operative or angiographic therapy.",
keywords = "Abdominal trauma, Computed axial tomographic (CT) scan, Injury grading, Spleen, Splenic injury",
author = "Barquist, {Erik S.} and Pizano, {Louis R} and Feuer, {William J} and Pappas, {Peter A.} and McKenney, {Kimberly A.} and LeBlang, {Suzanne D.} and Henry, {Robert P.} and Luis Rivas and Cohn, {Stephen M.}",
year = "2004",
month = "3",
day = "16",
language = "English",
volume = "56",
pages = "334--338",
journal = "Journal of Trauma and Acute Care Surgery",
issn = "2163-0755",
publisher = "Lippincott Williams and Wilkins",
number = "2",

}

TY - JOUR

T1 - Inter- and Intrarater Reliability in Computed Axial Tomographic Grading of Splenic Injury

T2 - Why so Many Grading Scales?

AU - Barquist, Erik S.

AU - Pizano, Louis R

AU - Feuer, William J

AU - Pappas, Peter A.

AU - McKenney, Kimberly A.

AU - LeBlang, Suzanne D.

AU - Henry, Robert P.

AU - Rivas, Luis

AU - Cohn, Stephen M.

PY - 2004/3/16

Y1 - 2004/3/16

N2 - Objective: After splenic trauma, critical decisions regarding operative intervention are often made with the aid of computed axial tomographic (CT) scan findings. No CT scan-based grading scale has been demonstrated to predict accurately which patients require operative or radiologic intervention for their splenic injuries. We hypothesized that use of the most common grading scale, the American Association for the Surgery of Trauma scale, would be associated with low intra- and interreliability scores. We assessed the ability of experienced trauma radiologists to differentiate grade III from grade IV splenic injuries. Methods: The films of patients who had undergone abdominal CT scanning before splenectomy for grade III or IV injuries were serially evaluated by four trauma radiology faculty weekly for 3 weeks. We assessed intra- and interrater reliability for grading and for presence of contrast blush. Results: Intrarater reproducibility yielded a weighted kappa score of 0.15 to 0.77. Interrater reliability weighted kappa scores ranged from 0 to 0.84, with a mean value of 0.23. Conclusion: CT imaging is not reliable for identifying grades III and IV splenic injury, as experienced radiologists often underestimate the magnitude of injury. Interrater reliability is poor. Factors other than the CT grade of splenic injury should determine whether patients require operative or angiographic therapy.

AB - Objective: After splenic trauma, critical decisions regarding operative intervention are often made with the aid of computed axial tomographic (CT) scan findings. No CT scan-based grading scale has been demonstrated to predict accurately which patients require operative or radiologic intervention for their splenic injuries. We hypothesized that use of the most common grading scale, the American Association for the Surgery of Trauma scale, would be associated with low intra- and interreliability scores. We assessed the ability of experienced trauma radiologists to differentiate grade III from grade IV splenic injuries. Methods: The films of patients who had undergone abdominal CT scanning before splenectomy for grade III or IV injuries were serially evaluated by four trauma radiology faculty weekly for 3 weeks. We assessed intra- and interrater reliability for grading and for presence of contrast blush. Results: Intrarater reproducibility yielded a weighted kappa score of 0.15 to 0.77. Interrater reliability weighted kappa scores ranged from 0 to 0.84, with a mean value of 0.23. Conclusion: CT imaging is not reliable for identifying grades III and IV splenic injury, as experienced radiologists often underestimate the magnitude of injury. Interrater reliability is poor. Factors other than the CT grade of splenic injury should determine whether patients require operative or angiographic therapy.

KW - Abdominal trauma

KW - Computed axial tomographic (CT) scan

KW - Injury grading

KW - Spleen

KW - Splenic injury

UR - http://www.scopus.com/inward/record.url?scp=1542316691&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=1542316691&partnerID=8YFLogxK

M3 - Article

C2 - 14960976

AN - SCOPUS:1542316691

VL - 56

SP - 334

EP - 338

JO - Journal of Trauma and Acute Care Surgery

JF - Journal of Trauma and Acute Care Surgery

SN - 2163-0755

IS - 2

ER -