Placebo response and practice effects in schizophrenia cognition trials

Richard S.E. Keefe, Vicki G. Davis, Philip D Harvey, Alexandra S. Atkins, George M. Haig, Owen Hagino, Stephen Marder, Dana C. Hilt, Daniel Umbricht

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

IMPORTANCE: Patients’ previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. OBJECTIVES: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. DESIGN, SETTING, AND PARTICIPANTS: A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. INTERVENTIONS: Placebo compared with various experimental drug treatments. MAIN OUTCOMES AND MEASURES: Composite score on the MCCB. RESULTS: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). CONCLUSIONS AND RELEVANCE: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.

Original languageEnglish (US)
Pages (from-to)807-814
Number of pages8
JournalJAMA Psychiatry
Volume74
Issue number8
DOIs
StatePublished - Aug 1 2017

Fingerprint

Cognition
Schizophrenia
Placebos
Placebo Effect
Latin America
Therapeutics
North America
Ambulatory Care Facilities
Motivation
Consensus
Anxiety
Randomized Controlled Trials
Demography
Outcome Assessment (Health Care)
Clinical Trials
Depression
Research
Pharmaceutical Preparations

ASJC Scopus subject areas

  • Psychiatry and Mental health

Cite this

Keefe, R. S. E., Davis, V. G., Harvey, P. D., Atkins, A. S., Haig, G. M., Hagino, O., ... Umbricht, D. (2017). Placebo response and practice effects in schizophrenia cognition trials. JAMA Psychiatry, 74(8), 807-814. https://doi.org/10.1001/jamapsychiatry.2017.1574

Placebo response and practice effects in schizophrenia cognition trials. / Keefe, Richard S.E.; Davis, Vicki G.; Harvey, Philip D; Atkins, Alexandra S.; Haig, George M.; Hagino, Owen; Marder, Stephen; Hilt, Dana C.; Umbricht, Daniel.

In: JAMA Psychiatry, Vol. 74, No. 8, 01.08.2017, p. 807-814.

Research output: Contribution to journalArticle

Keefe, RSE, Davis, VG, Harvey, PD, Atkins, AS, Haig, GM, Hagino, O, Marder, S, Hilt, DC & Umbricht, D 2017, 'Placebo response and practice effects in schizophrenia cognition trials', JAMA Psychiatry, vol. 74, no. 8, pp. 807-814. https://doi.org/10.1001/jamapsychiatry.2017.1574
Keefe, Richard S.E. ; Davis, Vicki G. ; Harvey, Philip D ; Atkins, Alexandra S. ; Haig, George M. ; Hagino, Owen ; Marder, Stephen ; Hilt, Dana C. ; Umbricht, Daniel. / Placebo response and practice effects in schizophrenia cognition trials. In: JAMA Psychiatry. 2017 ; Vol. 74, No. 8. pp. 807-814.
@article{95ef5912e3ed4bdfbafb19a5cb71becc,
title = "Placebo response and practice effects in schizophrenia cognition trials",
abstract = "IMPORTANCE: Patients’ previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. OBJECTIVES: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. DESIGN, SETTING, AND PARTICIPANTS: A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. INTERVENTIONS: Placebo compared with various experimental drug treatments. MAIN OUTCOMES AND MEASURES: Composite score on the MCCB. RESULTS: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95{\%} CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). CONCLUSIONS AND RELEVANCE: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.",
author = "Keefe, {Richard S.E.} and Davis, {Vicki G.} and Harvey, {Philip D} and Atkins, {Alexandra S.} and Haig, {George M.} and Owen Hagino and Stephen Marder and Hilt, {Dana C.} and Daniel Umbricht",
year = "2017",
month = "8",
day = "1",
doi = "10.1001/jamapsychiatry.2017.1574",
language = "English (US)",
volume = "74",
pages = "807--814",
journal = "JAMA Psychiatry",
issn = "2168-622X",
publisher = "American Medical Association",
number = "8",

}

TY - JOUR

T1 - Placebo response and practice effects in schizophrenia cognition trials

AU - Keefe, Richard S.E.

AU - Davis, Vicki G.

AU - Harvey, Philip D

AU - Atkins, Alexandra S.

AU - Haig, George M.

AU - Hagino, Owen

AU - Marder, Stephen

AU - Hilt, Dana C.

AU - Umbricht, Daniel

PY - 2017/8/1

Y1 - 2017/8/1

N2 - IMPORTANCE: Patients’ previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. OBJECTIVES: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. DESIGN, SETTING, AND PARTICIPANTS: A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. INTERVENTIONS: Placebo compared with various experimental drug treatments. MAIN OUTCOMES AND MEASURES: Composite score on the MCCB. RESULTS: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). CONCLUSIONS AND RELEVANCE: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.

AB - IMPORTANCE: Patients’ previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. OBJECTIVES: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. DESIGN, SETTING, AND PARTICIPANTS: A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. INTERVENTIONS: Placebo compared with various experimental drug treatments. MAIN OUTCOMES AND MEASURES: Composite score on the MCCB. RESULTS: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). CONCLUSIONS AND RELEVANCE: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.

UR - http://www.scopus.com/inward/record.url?scp=85027481712&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85027481712&partnerID=8YFLogxK

U2 - 10.1001/jamapsychiatry.2017.1574

DO - 10.1001/jamapsychiatry.2017.1574

M3 - Article

VL - 74

SP - 807

EP - 814

JO - JAMA Psychiatry

JF - JAMA Psychiatry

SN - 2168-622X

IS - 8

ER -