Development and Validation of the Cochlear Implant Surgical Competency Assessment Instrument

Thomas Balkany, Kaming Lo, Howard Francis, Simon I Angeli, Michael Novak, William Luxford, Rodney Lusk, Heather Strader

Research output: Contribution to journalArticle

Abstract

Objective: We present a new instrument for evaluation of cochlear implant (CI) surgical skills and review its validation process. Methods: An instrument to assess CI surgical competency incorporated results of structured surveys of comprehensiveness sent to 30 international CI experts and US trainees. One-hundred evaluations of 28 residents, fellows, and practicing CI surgeons were completed. Surgical skills were evaluated by four experienced neurotologists (two raters per subject) using two temporal bones per subject. A training session was completed by 24 subjects between the first and second procedure. Comparison of two blinded rater's scores per subject provided information on interrater reliability. Correlation of competency scores with degree of training and with improvement after a training session provided information on construct validity. Results: High levels of interrater reliability were confirmed by using the intraclass correlation coefficient. Construct validity was demonstrated by correlation of higher performance scores with increasing years of training, board certification, and fellowship training. Construct validity is also supported by improvement in scores after a CI training session as well as by acceptability surveys. Discussion: Data indicate that this instrument is an objective, accurate, and dependable procedure-specific instrument for evaluating CI surgical competency. Conclusion: The cochlear implant surgical competency assessment (CI-SCA) can be used to establish CI surgical competency, identify surgical skills that require remediation and demonstrate progress during training.

Original languageEnglish (US)
Pages (from-to)504-509
Number of pages6
JournalOtology and Neurotology
Volume38
Issue number4
DOIs
StatePublished - Apr 1 2017

Fingerprint

Cochlear Implants
Temporal Bone
Certification

Keywords

  • Cochlear implant
  • Cochlear implant competency
  • Cochlear implant surgery
  • Deafness
  • Ear surgery
  • OSATS
  • Surgical competency
  • Surgical training
  • Validated surgical competency instrument

ASJC Scopus subject areas

  • Otorhinolaryngology
  • Sensory Systems
  • Clinical Neurology

Cite this

Development and Validation of the Cochlear Implant Surgical Competency Assessment Instrument. / Balkany, Thomas; Lo, Kaming; Francis, Howard; Angeli, Simon I; Novak, Michael; Luxford, William; Lusk, Rodney; Strader, Heather.

In: Otology and Neurotology, Vol. 38, No. 4, 01.04.2017, p. 504-509.

Research output: Contribution to journalArticle

Balkany, T, Lo, K, Francis, H, Angeli, SI, Novak, M, Luxford, W, Lusk, R & Strader, H 2017, 'Development and Validation of the Cochlear Implant Surgical Competency Assessment Instrument', Otology and Neurotology, vol. 38, no. 4, pp. 504-509. https://doi.org/10.1097/MAO.0000000000001349
Balkany, Thomas ; Lo, Kaming ; Francis, Howard ; Angeli, Simon I ; Novak, Michael ; Luxford, William ; Lusk, Rodney ; Strader, Heather. / Development and Validation of the Cochlear Implant Surgical Competency Assessment Instrument. In: Otology and Neurotology. 2017 ; Vol. 38, No. 4. pp. 504-509.
@article{108607cd189944e299d4f46b706d872d,
title = "Development and Validation of the Cochlear Implant Surgical Competency Assessment Instrument",
abstract = "Objective: We present a new instrument for evaluation of cochlear implant (CI) surgical skills and review its validation process. Methods: An instrument to assess CI surgical competency incorporated results of structured surveys of comprehensiveness sent to 30 international CI experts and US trainees. One-hundred evaluations of 28 residents, fellows, and practicing CI surgeons were completed. Surgical skills were evaluated by four experienced neurotologists (two raters per subject) using two temporal bones per subject. A training session was completed by 24 subjects between the first and second procedure. Comparison of two blinded rater's scores per subject provided information on interrater reliability. Correlation of competency scores with degree of training and with improvement after a training session provided information on construct validity. Results: High levels of interrater reliability were confirmed by using the intraclass correlation coefficient. Construct validity was demonstrated by correlation of higher performance scores with increasing years of training, board certification, and fellowship training. Construct validity is also supported by improvement in scores after a CI training session as well as by acceptability surveys. Discussion: Data indicate that this instrument is an objective, accurate, and dependable procedure-specific instrument for evaluating CI surgical competency. Conclusion: The cochlear implant surgical competency assessment (CI-SCA) can be used to establish CI surgical competency, identify surgical skills that require remediation and demonstrate progress during training.",
keywords = "Cochlear implant, Cochlear implant competency, Cochlear implant surgery, Deafness, Ear surgery, OSATS, Surgical competency, Surgical training, Validated surgical competency instrument",
author = "Thomas Balkany and Kaming Lo and Howard Francis and Angeli, {Simon I} and Michael Novak and William Luxford and Rodney Lusk and Heather Strader",
year = "2017",
month = "4",
day = "1",
doi = "10.1097/MAO.0000000000001349",
language = "English (US)",
volume = "38",
pages = "504--509",
journal = "Otology and Neurotology",
issn = "1531-7129",
publisher = "Lippincott Williams and Wilkins",
number = "4",

}

TY - JOUR

T1 - Development and Validation of the Cochlear Implant Surgical Competency Assessment Instrument

AU - Balkany, Thomas

AU - Lo, Kaming

AU - Francis, Howard

AU - Angeli, Simon I

AU - Novak, Michael

AU - Luxford, William

AU - Lusk, Rodney

AU - Strader, Heather

PY - 2017/4/1

Y1 - 2017/4/1

N2 - Objective: We present a new instrument for evaluation of cochlear implant (CI) surgical skills and review its validation process. Methods: An instrument to assess CI surgical competency incorporated results of structured surveys of comprehensiveness sent to 30 international CI experts and US trainees. One-hundred evaluations of 28 residents, fellows, and practicing CI surgeons were completed. Surgical skills were evaluated by four experienced neurotologists (two raters per subject) using two temporal bones per subject. A training session was completed by 24 subjects between the first and second procedure. Comparison of two blinded rater's scores per subject provided information on interrater reliability. Correlation of competency scores with degree of training and with improvement after a training session provided information on construct validity. Results: High levels of interrater reliability were confirmed by using the intraclass correlation coefficient. Construct validity was demonstrated by correlation of higher performance scores with increasing years of training, board certification, and fellowship training. Construct validity is also supported by improvement in scores after a CI training session as well as by acceptability surveys. Discussion: Data indicate that this instrument is an objective, accurate, and dependable procedure-specific instrument for evaluating CI surgical competency. Conclusion: The cochlear implant surgical competency assessment (CI-SCA) can be used to establish CI surgical competency, identify surgical skills that require remediation and demonstrate progress during training.

AB - Objective: We present a new instrument for evaluation of cochlear implant (CI) surgical skills and review its validation process. Methods: An instrument to assess CI surgical competency incorporated results of structured surveys of comprehensiveness sent to 30 international CI experts and US trainees. One-hundred evaluations of 28 residents, fellows, and practicing CI surgeons were completed. Surgical skills were evaluated by four experienced neurotologists (two raters per subject) using two temporal bones per subject. A training session was completed by 24 subjects between the first and second procedure. Comparison of two blinded rater's scores per subject provided information on interrater reliability. Correlation of competency scores with degree of training and with improvement after a training session provided information on construct validity. Results: High levels of interrater reliability were confirmed by using the intraclass correlation coefficient. Construct validity was demonstrated by correlation of higher performance scores with increasing years of training, board certification, and fellowship training. Construct validity is also supported by improvement in scores after a CI training session as well as by acceptability surveys. Discussion: Data indicate that this instrument is an objective, accurate, and dependable procedure-specific instrument for evaluating CI surgical competency. Conclusion: The cochlear implant surgical competency assessment (CI-SCA) can be used to establish CI surgical competency, identify surgical skills that require remediation and demonstrate progress during training.

KW - Cochlear implant

KW - Cochlear implant competency

KW - Cochlear implant surgery

KW - Deafness

KW - Ear surgery

KW - OSATS

KW - Surgical competency

KW - Surgical training

KW - Validated surgical competency instrument

UR - http://www.scopus.com/inward/record.url?scp=85012937177&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85012937177&partnerID=8YFLogxK

U2 - 10.1097/MAO.0000000000001349

DO - 10.1097/MAO.0000000000001349

M3 - Article

C2 - 28195997

AN - SCOPUS:85012937177

VL - 38

SP - 504

EP - 509

JO - Otology and Neurotology

JF - Otology and Neurotology

SN - 1531-7129

IS - 4

ER -