A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy

Project FACTS study protocol

Rinad S. Beidas, Johanna Catherine Maclean, Jessica Fishman, Shannon Dorsey, Sonja K. Schoenwald, David S. Mandell, Judy A. Shea, Bryce D. McLeod, Michael French, Aaron Hogue, Danielle R. Adams, Adina Lieberman, Emily M. Becker-Haimes, Steven C. Marcus

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Background: This randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods. Methods/design: This trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews. Discussion: Results will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice. Trial registration:NCT02820623 , June 3rd, 2016.

Original languageEnglish (US)
Article number323
JournalBMC Psychiatry
Volume16
Issue number1
DOIs
StatePublished - Sep 15 2016

Fingerprint

Cognitive Therapy
Costs and Cost Analysis
Self Report
Observation
Interviews
Psychotherapy
Gold

Keywords

  • Cost-effectiveness
  • Evidence-based practice
  • Implementation
  • Treatment fidelity

ASJC Scopus subject areas

  • Psychiatry and Mental health

Cite this

A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy : Project FACTS study protocol. / Beidas, Rinad S.; Maclean, Johanna Catherine; Fishman, Jessica; Dorsey, Shannon; Schoenwald, Sonja K.; Mandell, David S.; Shea, Judy A.; McLeod, Bryce D.; French, Michael; Hogue, Aaron; Adams, Danielle R.; Lieberman, Adina; Becker-Haimes, Emily M.; Marcus, Steven C.

In: BMC Psychiatry, Vol. 16, No. 1, 323, 15.09.2016.

Research output: Contribution to journalArticle

Beidas, RS, Maclean, JC, Fishman, J, Dorsey, S, Schoenwald, SK, Mandell, DS, Shea, JA, McLeod, BD, French, M, Hogue, A, Adams, DR, Lieberman, A, Becker-Haimes, EM & Marcus, SC 2016, 'A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: Project FACTS study protocol', BMC Psychiatry, vol. 16, no. 1, 323. https://doi.org/10.1186/s12888-016-1034-z
Beidas, Rinad S. ; Maclean, Johanna Catherine ; Fishman, Jessica ; Dorsey, Shannon ; Schoenwald, Sonja K. ; Mandell, David S. ; Shea, Judy A. ; McLeod, Bryce D. ; French, Michael ; Hogue, Aaron ; Adams, Danielle R. ; Lieberman, Adina ; Becker-Haimes, Emily M. ; Marcus, Steven C. / A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy : Project FACTS study protocol. In: BMC Psychiatry. 2016 ; Vol. 16, No. 1.
@article{c0b3d2b1ff6c42718821c7de996393c7,
title = "A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: Project FACTS study protocol",
abstract = "Background: This randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods. Methods/design: This trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews. Discussion: Results will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice. Trial registration:NCT02820623 , June 3rd, 2016.",
keywords = "Cost-effectiveness, Evidence-based practice, Implementation, Treatment fidelity",
author = "Beidas, {Rinad S.} and Maclean, {Johanna Catherine} and Jessica Fishman and Shannon Dorsey and Schoenwald, {Sonja K.} and Mandell, {David S.} and Shea, {Judy A.} and McLeod, {Bryce D.} and Michael French and Aaron Hogue and Adams, {Danielle R.} and Adina Lieberman and Becker-Haimes, {Emily M.} and Marcus, {Steven C.}",
year = "2016",
month = "9",
day = "15",
doi = "10.1186/s12888-016-1034-z",
language = "English (US)",
volume = "16",
journal = "BMC Psychiatry",
issn = "1471-244X",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy

T2 - Project FACTS study protocol

AU - Beidas, Rinad S.

AU - Maclean, Johanna Catherine

AU - Fishman, Jessica

AU - Dorsey, Shannon

AU - Schoenwald, Sonja K.

AU - Mandell, David S.

AU - Shea, Judy A.

AU - McLeod, Bryce D.

AU - French, Michael

AU - Hogue, Aaron

AU - Adams, Danielle R.

AU - Lieberman, Adina

AU - Becker-Haimes, Emily M.

AU - Marcus, Steven C.

PY - 2016/9/15

Y1 - 2016/9/15

N2 - Background: This randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods. Methods/design: This trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews. Discussion: Results will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice. Trial registration:NCT02820623 , June 3rd, 2016.

AB - Background: This randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods. Methods/design: This trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews. Discussion: Results will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice. Trial registration:NCT02820623 , June 3rd, 2016.

KW - Cost-effectiveness

KW - Evidence-based practice

KW - Implementation

KW - Treatment fidelity

UR - http://www.scopus.com/inward/record.url?scp=84987853252&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84987853252&partnerID=8YFLogxK

U2 - 10.1186/s12888-016-1034-z

DO - 10.1186/s12888-016-1034-z

M3 - Article

VL - 16

JO - BMC Psychiatry

JF - BMC Psychiatry

SN - 1471-244X

IS - 1

M1 - 323

ER -