Fundamentals of endoscopic surgery cognitive examination

Development and validity evidence

Benjamin K. Poulose, Melina C. Vassiliou, Brian J. Dunkin, John D. Mellinger, Robert D. Fanelli, Jose M Martinez, Jeffrey W. Hazey, Lelan F. Sillin, Conor P. Delaney, Vic Velanovich, Gerald M. Fried, James R. Korndorffer, Jeffrey M. Marks

Research output: Contribution to journalArticle

30 Citations (Scopus)

Abstract

Background: Flexible endoscopy is an integral part of surgical care. Exposure to endoscopic procedures varies greatly in surgical training. The Society of American Gastrointestinal and Endoscopic Surgeons has developed the Fundamentals of Endoscopic Surgery (FES), which serves to teach and assess the fundamental knowledge and skills required to practice flexible endoscopy of the gastrointestinal tract. This report describes the validity evidence in the development of the FES cognitive examination. Methods: Core areas in the practice of gastrointestinal endoscopy were identified through facilitated expert focus groups to establish validity evidence for the test content. Test items then were developed based on the content areas. Prospective enrollment of participants at various levels of training and experience was used for beta testing. Two FES cognitive test versions then were developed based on beta testing data. The Angoff and contrasting group methods were used to determine the passing score. Validity evidence was established through correlation of experience level with examination score. Results: A total of 220 test items were developed in accordance with the defined test blueprint and formulated into two versions of 120 questions each. The versions were administered randomly to 363 participants. The correlation between test scores and training level was high (r = 0.69), with similar results noted for contrasting groups based on endoscopic rotation and endoscopic procedural experience. Items then were selected for two test forms of 75 items each, and a passing score was established. Conclusions: The FES cognitive examination is the first test with validity evidence to assess the basic knowledge needed to perform flexible endoscopy. Combined with the hands-on skills examination, this assessment tool is a key component for FES certification.

Original languageEnglish
Pages (from-to)631-638
Number of pages8
JournalSurgical Endoscopy and Other Interventional Techniques
Volume28
Issue number2
DOIs
StatePublished - Jan 1 2014

Fingerprint

Endoscopy
Gastrointestinal Endoscopy
Certification
Focus Groups
Gastrointestinal Tract

Keywords

  • Flexible endoscopy
  • Fundamentals
  • Surgery
  • Training
  • Validation

ASJC Scopus subject areas

  • Surgery

Cite this

Fundamentals of endoscopic surgery cognitive examination : Development and validity evidence. / Poulose, Benjamin K.; Vassiliou, Melina C.; Dunkin, Brian J.; Mellinger, John D.; Fanelli, Robert D.; Martinez, Jose M; Hazey, Jeffrey W.; Sillin, Lelan F.; Delaney, Conor P.; Velanovich, Vic; Fried, Gerald M.; Korndorffer, James R.; Marks, Jeffrey M.

In: Surgical Endoscopy and Other Interventional Techniques, Vol. 28, No. 2, 01.01.2014, p. 631-638.

Research output: Contribution to journalArticle

Poulose, BK, Vassiliou, MC, Dunkin, BJ, Mellinger, JD, Fanelli, RD, Martinez, JM, Hazey, JW, Sillin, LF, Delaney, CP, Velanovich, V, Fried, GM, Korndorffer, JR & Marks, JM 2014, 'Fundamentals of endoscopic surgery cognitive examination: Development and validity evidence', Surgical Endoscopy and Other Interventional Techniques, vol. 28, no. 2, pp. 631-638. https://doi.org/10.1007/s00464-013-3220-0
Poulose, Benjamin K. ; Vassiliou, Melina C. ; Dunkin, Brian J. ; Mellinger, John D. ; Fanelli, Robert D. ; Martinez, Jose M ; Hazey, Jeffrey W. ; Sillin, Lelan F. ; Delaney, Conor P. ; Velanovich, Vic ; Fried, Gerald M. ; Korndorffer, James R. ; Marks, Jeffrey M. / Fundamentals of endoscopic surgery cognitive examination : Development and validity evidence. In: Surgical Endoscopy and Other Interventional Techniques. 2014 ; Vol. 28, No. 2. pp. 631-638.
@article{2b3160e552a94a5ea924ecf85594a7bb,
title = "Fundamentals of endoscopic surgery cognitive examination: Development and validity evidence",
abstract = "Background: Flexible endoscopy is an integral part of surgical care. Exposure to endoscopic procedures varies greatly in surgical training. The Society of American Gastrointestinal and Endoscopic Surgeons has developed the Fundamentals of Endoscopic Surgery (FES), which serves to teach and assess the fundamental knowledge and skills required to practice flexible endoscopy of the gastrointestinal tract. This report describes the validity evidence in the development of the FES cognitive examination. Methods: Core areas in the practice of gastrointestinal endoscopy were identified through facilitated expert focus groups to establish validity evidence for the test content. Test items then were developed based on the content areas. Prospective enrollment of participants at various levels of training and experience was used for beta testing. Two FES cognitive test versions then were developed based on beta testing data. The Angoff and contrasting group methods were used to determine the passing score. Validity evidence was established through correlation of experience level with examination score. Results: A total of 220 test items were developed in accordance with the defined test blueprint and formulated into two versions of 120 questions each. The versions were administered randomly to 363 participants. The correlation between test scores and training level was high (r = 0.69), with similar results noted for contrasting groups based on endoscopic rotation and endoscopic procedural experience. Items then were selected for two test forms of 75 items each, and a passing score was established. Conclusions: The FES cognitive examination is the first test with validity evidence to assess the basic knowledge needed to perform flexible endoscopy. Combined with the hands-on skills examination, this assessment tool is a key component for FES certification.",
keywords = "Flexible endoscopy, Fundamentals, Surgery, Training, Validation",
author = "Poulose, {Benjamin K.} and Vassiliou, {Melina C.} and Dunkin, {Brian J.} and Mellinger, {John D.} and Fanelli, {Robert D.} and Martinez, {Jose M} and Hazey, {Jeffrey W.} and Sillin, {Lelan F.} and Delaney, {Conor P.} and Vic Velanovich and Fried, {Gerald M.} and Korndorffer, {James R.} and Marks, {Jeffrey M.}",
year = "2014",
month = "1",
day = "1",
doi = "10.1007/s00464-013-3220-0",
language = "English",
volume = "28",
pages = "631--638",
journal = "Surgical Endoscopy and Other Interventional Techniques",
issn = "0930-2794",
publisher = "Springer New York",
number = "2",

}

TY - JOUR

T1 - Fundamentals of endoscopic surgery cognitive examination

T2 - Development and validity evidence

AU - Poulose, Benjamin K.

AU - Vassiliou, Melina C.

AU - Dunkin, Brian J.

AU - Mellinger, John D.

AU - Fanelli, Robert D.

AU - Martinez, Jose M

AU - Hazey, Jeffrey W.

AU - Sillin, Lelan F.

AU - Delaney, Conor P.

AU - Velanovich, Vic

AU - Fried, Gerald M.

AU - Korndorffer, James R.

AU - Marks, Jeffrey M.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Background: Flexible endoscopy is an integral part of surgical care. Exposure to endoscopic procedures varies greatly in surgical training. The Society of American Gastrointestinal and Endoscopic Surgeons has developed the Fundamentals of Endoscopic Surgery (FES), which serves to teach and assess the fundamental knowledge and skills required to practice flexible endoscopy of the gastrointestinal tract. This report describes the validity evidence in the development of the FES cognitive examination. Methods: Core areas in the practice of gastrointestinal endoscopy were identified through facilitated expert focus groups to establish validity evidence for the test content. Test items then were developed based on the content areas. Prospective enrollment of participants at various levels of training and experience was used for beta testing. Two FES cognitive test versions then were developed based on beta testing data. The Angoff and contrasting group methods were used to determine the passing score. Validity evidence was established through correlation of experience level with examination score. Results: A total of 220 test items were developed in accordance with the defined test blueprint and formulated into two versions of 120 questions each. The versions were administered randomly to 363 participants. The correlation between test scores and training level was high (r = 0.69), with similar results noted for contrasting groups based on endoscopic rotation and endoscopic procedural experience. Items then were selected for two test forms of 75 items each, and a passing score was established. Conclusions: The FES cognitive examination is the first test with validity evidence to assess the basic knowledge needed to perform flexible endoscopy. Combined with the hands-on skills examination, this assessment tool is a key component for FES certification.

AB - Background: Flexible endoscopy is an integral part of surgical care. Exposure to endoscopic procedures varies greatly in surgical training. The Society of American Gastrointestinal and Endoscopic Surgeons has developed the Fundamentals of Endoscopic Surgery (FES), which serves to teach and assess the fundamental knowledge and skills required to practice flexible endoscopy of the gastrointestinal tract. This report describes the validity evidence in the development of the FES cognitive examination. Methods: Core areas in the practice of gastrointestinal endoscopy were identified through facilitated expert focus groups to establish validity evidence for the test content. Test items then were developed based on the content areas. Prospective enrollment of participants at various levels of training and experience was used for beta testing. Two FES cognitive test versions then were developed based on beta testing data. The Angoff and contrasting group methods were used to determine the passing score. Validity evidence was established through correlation of experience level with examination score. Results: A total of 220 test items were developed in accordance with the defined test blueprint and formulated into two versions of 120 questions each. The versions were administered randomly to 363 participants. The correlation between test scores and training level was high (r = 0.69), with similar results noted for contrasting groups based on endoscopic rotation and endoscopic procedural experience. Items then were selected for two test forms of 75 items each, and a passing score was established. Conclusions: The FES cognitive examination is the first test with validity evidence to assess the basic knowledge needed to perform flexible endoscopy. Combined with the hands-on skills examination, this assessment tool is a key component for FES certification.

KW - Flexible endoscopy

KW - Fundamentals

KW - Surgery

KW - Training

KW - Validation

UR - http://www.scopus.com/inward/record.url?scp=84899082431&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84899082431&partnerID=8YFLogxK

U2 - 10.1007/s00464-013-3220-0

DO - 10.1007/s00464-013-3220-0

M3 - Article

VL - 28

SP - 631

EP - 638

JO - Surgical Endoscopy and Other Interventional Techniques

JF - Surgical Endoscopy and Other Interventional Techniques

SN - 0930-2794

IS - 2

ER -