Self-assessment of team performance using T-NOTECHS in simulated pediatric trauma resuscitation is not consistent with expert assessment

Minna M. Wieck, Cory McLaughlin, Todd P. Chang, Alyssa Rake, Caron Park, Christianne Lane, Rita V. Burke, L. Caulette Young, Elizabeth A. Cleek, Inge Morton, Catherine J. Goodhue, Randall S. Burd, Henri Ford, Jeffrey S. Upperman, Aaron R. Jensen

Research output: Contribution to journalArticle

4 Scopus citations

Abstract

Background: The Trauma NOn-TECHnical Skills (T-NOTECHS) tool has been used to assess teamwork in trauma resuscitation, but its reliability and validity for self-assessment is unknown. Our purpose was to determine the reliability and validity of self-administered T-NOTECHS in pediatric trauma resuscitation. Methods: Simulated in situ resuscitations were evaluated using T-NOTECHS in real time by experts and immediately afterwards by team members. Reliability was analyzed with linear-weighted kappa and intra-class correlation. T-NOTECHS scores were compared between expert (gold-standard) and self-assessment. Results: Fifteen simulations were examined. T-NOTECHS scores were similar between self- and expert assessment for leadership. Self-assessment scores were higher than expert for the other domains and total composite score. Inter-rater reliability for total score was similar between the two groups, but differences were observed in the domains. Conclusions: Self-assessment is not interchangeable with expert rating when using T-NOTECHS. Future studies need to determine how self-assessment can be best utilized. Level of evidence: Studies of diagnostic accuracy – Level 2.

Original languageEnglish (US)
Pages (from-to)630-635
Number of pages6
JournalAmerican Journal of Surgery
Volume216
Issue number3
DOIs
StatePublished - Sep 1 2018
Externally publishedYes

    Fingerprint

ASJC Scopus subject areas

  • Surgery

Cite this

Wieck, M. M., McLaughlin, C., Chang, T. P., Rake, A., Park, C., Lane, C., Burke, R. V., Young, L. C., Cleek, E. A., Morton, I., Goodhue, C. J., Burd, R. S., Ford, H., Upperman, J. S., & Jensen, A. R. (2018). Self-assessment of team performance using T-NOTECHS in simulated pediatric trauma resuscitation is not consistent with expert assessment. American Journal of Surgery, 216(3), 630-635. https://doi.org/10.1016/j.amjsurg.2018.01.010