Development and Psychometric Analysis of a Tool to Evaluate Confederates

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Background Confederates defined as an individual other than the (standardized/simulated) patient who is scripted in a simulation to provide realism, additional challenges, or additional information for the participant are considered important for the success of simulation encounters; however, these support people are only as good as the quality of their contribution to the overall educational experience. Assessment of confederates is important in the establishment of consistent and high-quality educational experiences. The Actions, Communication, and Teaching in Simulation tool is a single-factor, five-item measure, utilizing a seven-point behaviorally anchored scale rating structure developed to tap into important attributes of confederates’ role portrayal in simulation encounters. The assessed items include acting, verbal, and nonverbal characterization; flexibility and adaptability; use of props and attire; and interactions with participants and other confederates. Methods Eight experts compiled an inventory of attributes and skills thought important for confederates to possess and, or acquire. Content and face validity established using an iterative process were utilized to review and modify each version of the measure until it was felt that the included items correctly measured the construct. Following this, psychometric evaluation of the tool was undertaken. Results Nine experts reviewed and scored seven confederate performances, 58 cases were included in the final analysis. Initial reliability of the tool was established with findings of 0.91 Cronbach's alpha. Internal consistency was good with all total item correlations above 0.50. Conclusion The results of this study provide initial evidence to support the validity and reliability of a tool to measure confederate's contribution to simulation-based learning. It is the first of its kind to be published and establishes a convention for assessing and ultimately improving confederate performances.

Original languageEnglish (US)
Pages (from-to)475-481
Number of pages7
JournalClinical Simulation in Nursing
Volume12
Issue number11
DOIs
StatePublished - Nov 1 2016

Fingerprint

Psychometrics
Reproducibility of Results
psychometrics
simulation
Evaluate
Teaching
Simulation
Communication
Attribute
Learning
Internal Consistency
Equipment and Supplies
expert
Iterative Process
Simulation Tool
Adaptability
rating scale
realism
Flexibility
performance

Keywords

  • ACTs tool
  • confederates’ assessment
  • confederates’ evaluation
  • embedded actor
  • portrayal accuracy

ASJC Scopus subject areas

  • Nursing (miscellaneous)
  • Education
  • Modeling and Simulation

Cite this

Development and Psychometric Analysis of a Tool to Evaluate Confederates. / Sanko, Jill S; Shekhter, Ilya; Gattamorta, Karina; Birnbach, David.

In: Clinical Simulation in Nursing, Vol. 12, No. 11, 01.11.2016, p. 475-481.

Research output: Contribution to journalArticle

@article{7b73cb0c305a481ca3cd1a5f53fab997,
title = "Development and Psychometric Analysis of a Tool to Evaluate Confederates",
abstract = "Background Confederates defined as an individual other than the (standardized/simulated) patient who is scripted in a simulation to provide realism, additional challenges, or additional information for the participant are considered important for the success of simulation encounters; however, these support people are only as good as the quality of their contribution to the overall educational experience. Assessment of confederates is important in the establishment of consistent and high-quality educational experiences. The Actions, Communication, and Teaching in Simulation tool is a single-factor, five-item measure, utilizing a seven-point behaviorally anchored scale rating structure developed to tap into important attributes of confederates’ role portrayal in simulation encounters. The assessed items include acting, verbal, and nonverbal characterization; flexibility and adaptability; use of props and attire; and interactions with participants and other confederates. Methods Eight experts compiled an inventory of attributes and skills thought important for confederates to possess and, or acquire. Content and face validity established using an iterative process were utilized to review and modify each version of the measure until it was felt that the included items correctly measured the construct. Following this, psychometric evaluation of the tool was undertaken. Results Nine experts reviewed and scored seven confederate performances, 58 cases were included in the final analysis. Initial reliability of the tool was established with findings of 0.91 Cronbach's alpha. Internal consistency was good with all total item correlations above 0.50. Conclusion The results of this study provide initial evidence to support the validity and reliability of a tool to measure confederate's contribution to simulation-based learning. It is the first of its kind to be published and establishes a convention for assessing and ultimately improving confederate performances.",
keywords = "ACTs tool, confederates’ assessment, confederates’ evaluation, embedded actor, portrayal accuracy",
author = "Sanko, {Jill S} and Ilya Shekhter and Karina Gattamorta and David Birnbach",
year = "2016",
month = "11",
day = "1",
doi = "10.1016/j.ecns.2016.07.006",
language = "English (US)",
volume = "12",
pages = "475--481",
journal = "Clinical Simulation in Nursing",
issn = "1876-1399",
publisher = "Elsevier Inc.",
number = "11",

}

TY - JOUR

T1 - Development and Psychometric Analysis of a Tool to Evaluate Confederates

AU - Sanko, Jill S

AU - Shekhter, Ilya

AU - Gattamorta, Karina

AU - Birnbach, David

PY - 2016/11/1

Y1 - 2016/11/1

N2 - Background Confederates defined as an individual other than the (standardized/simulated) patient who is scripted in a simulation to provide realism, additional challenges, or additional information for the participant are considered important for the success of simulation encounters; however, these support people are only as good as the quality of their contribution to the overall educational experience. Assessment of confederates is important in the establishment of consistent and high-quality educational experiences. The Actions, Communication, and Teaching in Simulation tool is a single-factor, five-item measure, utilizing a seven-point behaviorally anchored scale rating structure developed to tap into important attributes of confederates’ role portrayal in simulation encounters. The assessed items include acting, verbal, and nonverbal characterization; flexibility and adaptability; use of props and attire; and interactions with participants and other confederates. Methods Eight experts compiled an inventory of attributes and skills thought important for confederates to possess and, or acquire. Content and face validity established using an iterative process were utilized to review and modify each version of the measure until it was felt that the included items correctly measured the construct. Following this, psychometric evaluation of the tool was undertaken. Results Nine experts reviewed and scored seven confederate performances, 58 cases were included in the final analysis. Initial reliability of the tool was established with findings of 0.91 Cronbach's alpha. Internal consistency was good with all total item correlations above 0.50. Conclusion The results of this study provide initial evidence to support the validity and reliability of a tool to measure confederate's contribution to simulation-based learning. It is the first of its kind to be published and establishes a convention for assessing and ultimately improving confederate performances.

AB - Background Confederates defined as an individual other than the (standardized/simulated) patient who is scripted in a simulation to provide realism, additional challenges, or additional information for the participant are considered important for the success of simulation encounters; however, these support people are only as good as the quality of their contribution to the overall educational experience. Assessment of confederates is important in the establishment of consistent and high-quality educational experiences. The Actions, Communication, and Teaching in Simulation tool is a single-factor, five-item measure, utilizing a seven-point behaviorally anchored scale rating structure developed to tap into important attributes of confederates’ role portrayal in simulation encounters. The assessed items include acting, verbal, and nonverbal characterization; flexibility and adaptability; use of props and attire; and interactions with participants and other confederates. Methods Eight experts compiled an inventory of attributes and skills thought important for confederates to possess and, or acquire. Content and face validity established using an iterative process were utilized to review and modify each version of the measure until it was felt that the included items correctly measured the construct. Following this, psychometric evaluation of the tool was undertaken. Results Nine experts reviewed and scored seven confederate performances, 58 cases were included in the final analysis. Initial reliability of the tool was established with findings of 0.91 Cronbach's alpha. Internal consistency was good with all total item correlations above 0.50. Conclusion The results of this study provide initial evidence to support the validity and reliability of a tool to measure confederate's contribution to simulation-based learning. It is the first of its kind to be published and establishes a convention for assessing and ultimately improving confederate performances.

KW - ACTs tool

KW - confederates’ assessment

KW - confederates’ evaluation

KW - embedded actor

KW - portrayal accuracy

UR - http://www.scopus.com/inward/record.url?scp=84984973493&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84984973493&partnerID=8YFLogxK

U2 - 10.1016/j.ecns.2016.07.006

DO - 10.1016/j.ecns.2016.07.006

M3 - Article

AN - SCOPUS:84984973493

VL - 12

SP - 475

EP - 481

JO - Clinical Simulation in Nursing

JF - Clinical Simulation in Nursing

SN - 1876-1399

IS - 11

ER -