Continuous evaluation of evolving behavioral intervention technologies

David C. Mohr, Ken Cheung, Stephen M. Schueller, C. Hendricks Brown, Naihua Duan

Research output: Contribution to journalArticle

61 Citations (Scopus)

Abstract

Behavioral intervention technologies (BITs) are web-based and mobile interventions intended to support patients and consumers in changing behaviors related to health, mental health, and well-being. BITs are provided to patients and consumers in clinical care settings and commercial marketplaces, frequently with little or no evaluation. Current evaluation methods, including RCTs and implementation studies, can require years to validate an intervention. This timeline is fundamentally incompatible with the BIT environment, where technology advancement and changes in consumer expectations occur quickly, necessitating rapidly evolving interventions. However, BITs can routinely and iteratively collect data in a planned and strategic manner and generate evidence through systematic prospective analyses, thereby creating a system that can "learn." A methodologic framework, Continuous Evaluation of Evolving Behavioral Intervention Technologies (CEEBIT), is proposed that can support the evaluation of multiple BITs or evolving versions, eliminating those that demonstrate poorer outcomes, while allowing new BITs to be entered at any time. CEEBIT could be used to ensure the effectiveness of BITs provided through deployment platforms in clinical care organizations or BIT marketplaces. The features of CEEBIT are described, including criteria for the determination of inferiority, determination of BIT inclusion, methods of assigning consumers to BITs, definition of outcomes, and evaluation of the usefulness of the system. CEEBIT offers the potential to collapse initial evaluation and postmarketing surveillance, providing ongoing assurance of safety and efficacy to patients and consumers, payers, and policymakers.

Original languageEnglish
Pages (from-to)517-523
Number of pages7
JournalAmerican Journal of Preventive Medicine
Volume45
Issue number4
DOIs
StatePublished - Oct 1 2013

Fingerprint

Technology
Mental Health
Safety
Health

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health
  • Epidemiology

Cite this

Continuous evaluation of evolving behavioral intervention technologies. / Mohr, David C.; Cheung, Ken; Schueller, Stephen M.; Brown, C. Hendricks; Duan, Naihua.

In: American Journal of Preventive Medicine, Vol. 45, No. 4, 01.10.2013, p. 517-523.

Research output: Contribution to journalArticle

Mohr, David C. ; Cheung, Ken ; Schueller, Stephen M. ; Brown, C. Hendricks ; Duan, Naihua. / Continuous evaluation of evolving behavioral intervention technologies. In: American Journal of Preventive Medicine. 2013 ; Vol. 45, No. 4. pp. 517-523.
@article{6972ef98b9544c7197f97461f48948e4,
title = "Continuous evaluation of evolving behavioral intervention technologies",
abstract = "Behavioral intervention technologies (BITs) are web-based and mobile interventions intended to support patients and consumers in changing behaviors related to health, mental health, and well-being. BITs are provided to patients and consumers in clinical care settings and commercial marketplaces, frequently with little or no evaluation. Current evaluation methods, including RCTs and implementation studies, can require years to validate an intervention. This timeline is fundamentally incompatible with the BIT environment, where technology advancement and changes in consumer expectations occur quickly, necessitating rapidly evolving interventions. However, BITs can routinely and iteratively collect data in a planned and strategic manner and generate evidence through systematic prospective analyses, thereby creating a system that can {"}learn.{"} A methodologic framework, Continuous Evaluation of Evolving Behavioral Intervention Technologies (CEEBIT), is proposed that can support the evaluation of multiple BITs or evolving versions, eliminating those that demonstrate poorer outcomes, while allowing new BITs to be entered at any time. CEEBIT could be used to ensure the effectiveness of BITs provided through deployment platforms in clinical care organizations or BIT marketplaces. The features of CEEBIT are described, including criteria for the determination of inferiority, determination of BIT inclusion, methods of assigning consumers to BITs, definition of outcomes, and evaluation of the usefulness of the system. CEEBIT offers the potential to collapse initial evaluation and postmarketing surveillance, providing ongoing assurance of safety and efficacy to patients and consumers, payers, and policymakers.",
author = "Mohr, {David C.} and Ken Cheung and Schueller, {Stephen M.} and Brown, {C. Hendricks} and Naihua Duan",
year = "2013",
month = "10",
day = "1",
doi = "10.1016/j.amepre.2013.06.006",
language = "English",
volume = "45",
pages = "517--523",
journal = "American Journal of Preventive Medicine",
issn = "0749-3797",
publisher = "Elsevier Inc.",
number = "4",

}

TY - JOUR

T1 - Continuous evaluation of evolving behavioral intervention technologies

AU - Mohr, David C.

AU - Cheung, Ken

AU - Schueller, Stephen M.

AU - Brown, C. Hendricks

AU - Duan, Naihua

PY - 2013/10/1

Y1 - 2013/10/1

N2 - Behavioral intervention technologies (BITs) are web-based and mobile interventions intended to support patients and consumers in changing behaviors related to health, mental health, and well-being. BITs are provided to patients and consumers in clinical care settings and commercial marketplaces, frequently with little or no evaluation. Current evaluation methods, including RCTs and implementation studies, can require years to validate an intervention. This timeline is fundamentally incompatible with the BIT environment, where technology advancement and changes in consumer expectations occur quickly, necessitating rapidly evolving interventions. However, BITs can routinely and iteratively collect data in a planned and strategic manner and generate evidence through systematic prospective analyses, thereby creating a system that can "learn." A methodologic framework, Continuous Evaluation of Evolving Behavioral Intervention Technologies (CEEBIT), is proposed that can support the evaluation of multiple BITs or evolving versions, eliminating those that demonstrate poorer outcomes, while allowing new BITs to be entered at any time. CEEBIT could be used to ensure the effectiveness of BITs provided through deployment platforms in clinical care organizations or BIT marketplaces. The features of CEEBIT are described, including criteria for the determination of inferiority, determination of BIT inclusion, methods of assigning consumers to BITs, definition of outcomes, and evaluation of the usefulness of the system. CEEBIT offers the potential to collapse initial evaluation and postmarketing surveillance, providing ongoing assurance of safety and efficacy to patients and consumers, payers, and policymakers.

AB - Behavioral intervention technologies (BITs) are web-based and mobile interventions intended to support patients and consumers in changing behaviors related to health, mental health, and well-being. BITs are provided to patients and consumers in clinical care settings and commercial marketplaces, frequently with little or no evaluation. Current evaluation methods, including RCTs and implementation studies, can require years to validate an intervention. This timeline is fundamentally incompatible with the BIT environment, where technology advancement and changes in consumer expectations occur quickly, necessitating rapidly evolving interventions. However, BITs can routinely and iteratively collect data in a planned and strategic manner and generate evidence through systematic prospective analyses, thereby creating a system that can "learn." A methodologic framework, Continuous Evaluation of Evolving Behavioral Intervention Technologies (CEEBIT), is proposed that can support the evaluation of multiple BITs or evolving versions, eliminating those that demonstrate poorer outcomes, while allowing new BITs to be entered at any time. CEEBIT could be used to ensure the effectiveness of BITs provided through deployment platforms in clinical care organizations or BIT marketplaces. The features of CEEBIT are described, including criteria for the determination of inferiority, determination of BIT inclusion, methods of assigning consumers to BITs, definition of outcomes, and evaluation of the usefulness of the system. CEEBIT offers the potential to collapse initial evaluation and postmarketing surveillance, providing ongoing assurance of safety and efficacy to patients and consumers, payers, and policymakers.

UR - http://www.scopus.com/inward/record.url?scp=84884312556&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84884312556&partnerID=8YFLogxK

U2 - 10.1016/j.amepre.2013.06.006

DO - 10.1016/j.amepre.2013.06.006

M3 - Article

C2 - 24050429

AN - SCOPUS:84884312556

VL - 45

SP - 517

EP - 523

JO - American Journal of Preventive Medicine

JF - American Journal of Preventive Medicine

SN - 0749-3797

IS - 4

ER -