TY - JOUR
T1 - The value of videotape in mock oral board examinations
AU - Kozol, Robert A.
AU - Giles, Matthew
AU - Voytovich, Anthony
PY - 2004/9/1
Y1 - 2004/9/1
N2 - Objective: To determine the impact on self-perception, of having residents view their own performance (taped) on mock oral board examinations. Design: Self-evaluation - intervention - self-evaluation design. Third-, fourth-, and fifth-year residents evaluated themselves after each examination(room) during mock oral examinations. Residents reviewed the examination on videotape and re-evaluated themselves. Setting: University Medical Center. Participants: Twenty surgical residents from the third, fourth, and fifth years of training. Main outcome measures: Mean scores in 6 categories based on a 5-point Likert scale. Scores by examiners plus pre- and post-video viewing self-scores were compared. Results: We found that residents consistently underestimated their performance on the examination. Viewing their videotapes resulted in revised self-scores, which were more consistent with scores of the examiners. All scores will be presented in sequence as follows: Mean score by examiners, mean self-score pre-tape viewing and mean self-score post-tape viewing. For professionalism, scores were 4.63, 4.15, and 4.43, p = 0.047. For organization, 3.91, 3.27, and 3.63, p = 0.007. For decision making, 4.02, 3.42, and 3.72, p = 0.033. P-values reflect the comparison of resident self-scores pre- and post-tape viewing. Analysis of variance comparison of scores in various rooms (different examiners) revealed no significant difference in scores based on rooms (different examiners). Evaluations according to rooms (different examiners) were not statistically different, supporting inter-rater reliability. There was consistent improvement in knowledge and decision making with advanced years of training, supporting internal validity of the examination. Conclusions: Videotape viewing results in revised resident self-scores, which are more consistent with scores given by the examiners. Tape viewing significantly affected resident self-scores in professionalism, organization, and decision-making.
AB - Objective: To determine the impact on self-perception, of having residents view their own performance (taped) on mock oral board examinations. Design: Self-evaluation - intervention - self-evaluation design. Third-, fourth-, and fifth-year residents evaluated themselves after each examination(room) during mock oral examinations. Residents reviewed the examination on videotape and re-evaluated themselves. Setting: University Medical Center. Participants: Twenty surgical residents from the third, fourth, and fifth years of training. Main outcome measures: Mean scores in 6 categories based on a 5-point Likert scale. Scores by examiners plus pre- and post-video viewing self-scores were compared. Results: We found that residents consistently underestimated their performance on the examination. Viewing their videotapes resulted in revised self-scores, which were more consistent with scores of the examiners. All scores will be presented in sequence as follows: Mean score by examiners, mean self-score pre-tape viewing and mean self-score post-tape viewing. For professionalism, scores were 4.63, 4.15, and 4.43, p = 0.047. For organization, 3.91, 3.27, and 3.63, p = 0.007. For decision making, 4.02, 3.42, and 3.72, p = 0.033. P-values reflect the comparison of resident self-scores pre- and post-tape viewing. Analysis of variance comparison of scores in various rooms (different examiners) revealed no significant difference in scores based on rooms (different examiners). Evaluations according to rooms (different examiners) were not statistically different, supporting inter-rater reliability. There was consistent improvement in knowledge and decision making with advanced years of training, supporting internal validity of the examination. Conclusions: Videotape viewing results in revised resident self-scores, which are more consistent with scores given by the examiners. Tape viewing significantly affected resident self-scores in professionalism, organization, and decision-making.
KW - Oral examinations
KW - Surgical education
KW - Videotape
UR - http://www.scopus.com/inward/record.url?scp=4844225643&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=4844225643&partnerID=8YFLogxK
U2 - 10.1016/j.cursur.2004.06.004
DO - 10.1016/j.cursur.2004.06.004
M3 - Article
C2 - 15475107
AN - SCOPUS:4844225643
VL - 61
SP - 511
EP - 514
JO - Journal of Surgical Education
JF - Journal of Surgical Education
SN - 1931-7204
IS - 5
ER -