The value of videotape in mock oral board examinations

Objective: To determine the impact on self-perception, of having residents view their own performance (taped) on mock oral board examinations. Design: Self-evaluation - intervention - self-evaluation design. Third-, fourth-, and fifth-year residents evaluated themselves after each examination(room) during mock oral examinations. Residents reviewed the examination on videotape and re-evaluated themselves. Setting: University Medical Center. Participants: Twenty surgical residents from the third, fourth, and fifth years of training. Main outcome measures: Mean scores in 6 categories based on a 5-point Likert scale. Scores by examiners plus pre- and post-video viewing self-scores were compared. Results: We found that residents consistently underestimated their performance on the examination. Viewing their videotapes resulted in revised self-scores, which were more consistent with scores of the examiners. All scores will be presented in sequence as follows: Mean score by examiners, mean self-score pre-tape viewing and mean self-score post-tape viewing. For professionalism, scores were 4.63, 4.15, and 4.43, p = 0.047. For organization, 3.91, 3.27, and 3.63, p = 0.007. For decision making, 4.02, 3.42, and 3.72, p = 0.033. P-values reflect the comparison of resident self-scores pre- and post-tape viewing. Analysis of variance comparison of scores in various rooms (different examiners) revealed no significant difference in scores based on rooms (different examiners). Evaluations according to rooms (different examiners) were not statistically different, supporting inter-rater reliability. There was consistent improvement in knowledge and decision making with advanced years of training, supporting internal validity of the examination. Conclusions: Videotape viewing results in revised resident self-scores, which are more consistent with scores given by the examiners. Tape viewing significantly affected resident self-scores in professionalism, organization, and decision-making.