Abstract
IMPORTANCE: Patients’ previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. OBJECTIVES: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. DESIGN, SETTING, AND PARTICIPANTS: A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. INTERVENTIONS: Placebo compared with various experimental drug treatments. MAIN OUTCOMES AND MEASURES: Composite score on the MCCB. RESULTS: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). CONCLUSIONS AND RELEVANCE: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 807-814 |
| Number of pages | 8 |
| Journal | JAMA Psychiatry |
| Volume | 74 |
| Issue number | 8 |
| DOIs | |
| State | Published - Aug 1 2017 |
Fingerprint
ASJC Scopus subject areas
- Psychiatry and Mental health
Cite this
Placebo response and practice effects in schizophrenia cognition trials. / Keefe, Richard S.E.; Davis, Vicki G.; Harvey, Philip D; Atkins, Alexandra S.; Haig, George M.; Hagino, Owen; Marder, Stephen; Hilt, Dana C.; Umbricht, Daniel.
In: JAMA Psychiatry, Vol. 74, No. 8, 01.08.2017, p. 807-814.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Placebo response and practice effects in schizophrenia cognition trials
AU - Keefe, Richard S.E.
AU - Davis, Vicki G.
AU - Harvey, Philip D
AU - Atkins, Alexandra S.
AU - Haig, George M.
AU - Hagino, Owen
AU - Marder, Stephen
AU - Hilt, Dana C.
AU - Umbricht, Daniel
PY - 2017/8/1
Y1 - 2017/8/1
N2 - IMPORTANCE: Patients’ previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. OBJECTIVES: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. DESIGN, SETTING, AND PARTICIPANTS: A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. INTERVENTIONS: Placebo compared with various experimental drug treatments. MAIN OUTCOMES AND MEASURES: Composite score on the MCCB. RESULTS: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). CONCLUSIONS AND RELEVANCE: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.
AB - IMPORTANCE: Patients’ previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. OBJECTIVES: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. DESIGN, SETTING, AND PARTICIPANTS: A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. INTERVENTIONS: Placebo compared with various experimental drug treatments. MAIN OUTCOMES AND MEASURES: Composite score on the MCCB. RESULTS: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). CONCLUSIONS AND RELEVANCE: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.
UR - http://www.scopus.com/inward/record.url?scp=85027481712&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85027481712&partnerID=8YFLogxK
U2 - 10.1001/jamapsychiatry.2017.1574
DO - 10.1001/jamapsychiatry.2017.1574
M3 - Article
C2 - 28636694
AN - SCOPUS:85027481712
VL - 74
SP - 807
EP - 814
JO - JAMA Psychiatry
JF - JAMA Psychiatry
SN - 2168-622X
IS - 8
ER -