Assessing cardiac physical examination skills using simulation technology and real patients: A comparison study

Rose Hatala, S. Barry Issenberg, Barry Kassen, Gary Cole, C. Maria Bacchus, Ross J. Scalese

Research output: Contribution to journalArticle

29 Scopus citations

Abstract

Objective: High-stakes assessments of doctors' physical examination skills often employ standardised patients (SPs) who lack physical abnormalities. Simulation technology provides additional opportunities to assess these skills by mimicking physical abnormalities. The current study examined the relationship between internists' cardiac physical examination competence as assessed with simulation technology compared with that assessed with real patients (RPs). Methods: The cardiac physical examination skills and bedside diagnostic accuracy of 28 internists were assessed during an objective structured clinical examination (OSCE). The OSCE included 3 modalities of cardiac patients: RPs with cardiac abnormalities; SPs combined with computer-based, audio-video simulations of auscultatory abnormalities, and a cardiac patient simulator (CPS) manikin. Four cardiac diagnoses and their associated cardiac findings were matched across modalities. At each station, 2 examiners independently rated a participant's physical examination technique and global clinical competence. Two investigators separately scored diagnostic accuracy. Results: Inter-rater reliability between examiners for global ratings (GRs) ranged from 0.75-0.78 for the different modalities. Although there was no significant difference between participants' mean GRs for each modality, the correlations between participants' performances on each modality were low to modest: RP versus SP, r = 0.19; RP versus CPS, r = 0.22; SP versus CPS, r = 0.57 (P < 0.01). Conclusions: Methodological limitations included variability between modalities in the components contributing to examiners' GRs, a paucity of objective outcome measures and restricted case sampling. No modality provided a clear 'gold standard' for the assessment of cardiac physical examination competence. These limitations need to be addressed before determining the optimal patient modality for high-stakes assessment purposes.

Original languageEnglish (US)
Pages (from-to)628-636
Number of pages9
JournalMedical education
Volume42
Issue number6
DOIs
StatePublished - Jun 1 2008

Keywords

  • *internship and residency
  • Cardiology/*education
  • Clinical competence/*standards
  • Comparative study [publication type]
  • Multicentre study [publication type]
  • Observer variation
  • Patient simulation
  • Physical examination/*standards

ASJC Scopus subject areas

  • Nursing(all)
  • Education
  • Public Health, Environmental and Occupational Health

Fingerprint Dive into the research topics of 'Assessing cardiac physical examination skills using simulation technology and real patients: A comparison study'. Together they form a unique fingerprint.

  • Cite this