Validation of the tablet-administered Brief Assessment of Cognition (BAC App)

Alexandra S. Atkins, Vicki Davis, Tina Tseng, Adam Vaughan, Philip D Harvey, Tom Patterson, Meera Narasimhan, Richard S E Keefe

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Computerized tests benefit from automated scoring procedures and standardized administration instructions. These methods can reduce the potential for rater error. However, especially in patients with severe mental illnesses, the equivalency of traditional and tablet-based tests cannot be assumed. The Brief Assessment of Cognition in Schizophrenia (BACS) is a pen-and-paper cognitive assessment tool that has been used in hundreds of research studies and clinical trials, and has normative data available for generating age- and gender-corrected standardized scores. A tablet-based version of the BACS called the BAC App has been developed. This study compared performance on the BACS and the BAC App in patients with schizophrenia and healthy controls. Test equivalency was assessed, and the applicability of paper-based normative data was evaluated. Results demonstrated the distributions of standardized composite scores for the tablet-based BAC App and the pen-and-paper BACS were indistinguishable, and the between-methods mean differences were not statistically significant. The discrimination between patients and controls was similarly robust. The between-methods correlations for individual measures in patients were r.>. 0.70 for most subtests. When data from the Token Motor Test was omitted, the between-methods correlation of composite scores was r. =. 0.88 (df. =. 48; p. <. 0.001) in healthy controls and r. =. 0.89 (df. =. 46; p. <. 0.001) in patients, consistent with the test-retest reliability of each measure. Taken together, results indicate that the tablet-based BAC App generates results consistent with the traditional pen-and-paper BACS, and support the notion that the BAC App is appropriate for use in clinical trials and clinical practice.

Original languageEnglish (US)
JournalSchizophrenia Research
DOIs
StateAccepted/In press - Apr 26 2016

Fingerprint

Cognition
Tablets
Schizophrenia
Clinical Trials
Reproducibility of Results
Research

Keywords

  • App
  • BACS
  • Cognition
  • Cognitive test
  • Schizophrenia
  • Tablet assessment

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Biological Psychiatry

Cite this

Atkins, A. S., Davis, V., Tseng, T., Vaughan, A., Harvey, P. D., Patterson, T., ... Keefe, R. S. E. (Accepted/In press). Validation of the tablet-administered Brief Assessment of Cognition (BAC App). Schizophrenia Research. https://doi.org/10.1016/j.schres.2016.10.010

Validation of the tablet-administered Brief Assessment of Cognition (BAC App). / Atkins, Alexandra S.; Davis, Vicki; Tseng, Tina; Vaughan, Adam; Harvey, Philip D; Patterson, Tom; Narasimhan, Meera; Keefe, Richard S E.

In: Schizophrenia Research, 26.04.2016.

Research output: Contribution to journalArticle

Atkins, Alexandra S. ; Davis, Vicki ; Tseng, Tina ; Vaughan, Adam ; Harvey, Philip D ; Patterson, Tom ; Narasimhan, Meera ; Keefe, Richard S E. / Validation of the tablet-administered Brief Assessment of Cognition (BAC App). In: Schizophrenia Research. 2016.
@article{e2e9b76514c646d787fb5fa7262ded2a,
title = "Validation of the tablet-administered Brief Assessment of Cognition (BAC App)",
abstract = "Computerized tests benefit from automated scoring procedures and standardized administration instructions. These methods can reduce the potential for rater error. However, especially in patients with severe mental illnesses, the equivalency of traditional and tablet-based tests cannot be assumed. The Brief Assessment of Cognition in Schizophrenia (BACS) is a pen-and-paper cognitive assessment tool that has been used in hundreds of research studies and clinical trials, and has normative data available for generating age- and gender-corrected standardized scores. A tablet-based version of the BACS called the BAC App has been developed. This study compared performance on the BACS and the BAC App in patients with schizophrenia and healthy controls. Test equivalency was assessed, and the applicability of paper-based normative data was evaluated. Results demonstrated the distributions of standardized composite scores for the tablet-based BAC App and the pen-and-paper BACS were indistinguishable, and the between-methods mean differences were not statistically significant. The discrimination between patients and controls was similarly robust. The between-methods correlations for individual measures in patients were r.>. 0.70 for most subtests. When data from the Token Motor Test was omitted, the between-methods correlation of composite scores was r. =. 0.88 (df. =. 48; p. <. 0.001) in healthy controls and r. =. 0.89 (df. =. 46; p. <. 0.001) in patients, consistent with the test-retest reliability of each measure. Taken together, results indicate that the tablet-based BAC App generates results consistent with the traditional pen-and-paper BACS, and support the notion that the BAC App is appropriate for use in clinical trials and clinical practice.",
keywords = "App, BACS, Cognition, Cognitive test, Schizophrenia, Tablet assessment",
author = "Atkins, {Alexandra S.} and Vicki Davis and Tina Tseng and Adam Vaughan and Harvey, {Philip D} and Tom Patterson and Meera Narasimhan and Keefe, {Richard S E}",
year = "2016",
month = "4",
day = "26",
doi = "10.1016/j.schres.2016.10.010",
language = "English (US)",
journal = "Schizophrenia Research",
issn = "0920-9964",
publisher = "Elsevier",

}

TY - JOUR

T1 - Validation of the tablet-administered Brief Assessment of Cognition (BAC App)

AU - Atkins, Alexandra S.

AU - Davis, Vicki

AU - Tseng, Tina

AU - Vaughan, Adam

AU - Harvey, Philip D

AU - Patterson, Tom

AU - Narasimhan, Meera

AU - Keefe, Richard S E

PY - 2016/4/26

Y1 - 2016/4/26

N2 - Computerized tests benefit from automated scoring procedures and standardized administration instructions. These methods can reduce the potential for rater error. However, especially in patients with severe mental illnesses, the equivalency of traditional and tablet-based tests cannot be assumed. The Brief Assessment of Cognition in Schizophrenia (BACS) is a pen-and-paper cognitive assessment tool that has been used in hundreds of research studies and clinical trials, and has normative data available for generating age- and gender-corrected standardized scores. A tablet-based version of the BACS called the BAC App has been developed. This study compared performance on the BACS and the BAC App in patients with schizophrenia and healthy controls. Test equivalency was assessed, and the applicability of paper-based normative data was evaluated. Results demonstrated the distributions of standardized composite scores for the tablet-based BAC App and the pen-and-paper BACS were indistinguishable, and the between-methods mean differences were not statistically significant. The discrimination between patients and controls was similarly robust. The between-methods correlations for individual measures in patients were r.>. 0.70 for most subtests. When data from the Token Motor Test was omitted, the between-methods correlation of composite scores was r. =. 0.88 (df. =. 48; p. <. 0.001) in healthy controls and r. =. 0.89 (df. =. 46; p. <. 0.001) in patients, consistent with the test-retest reliability of each measure. Taken together, results indicate that the tablet-based BAC App generates results consistent with the traditional pen-and-paper BACS, and support the notion that the BAC App is appropriate for use in clinical trials and clinical practice.

AB - Computerized tests benefit from automated scoring procedures and standardized administration instructions. These methods can reduce the potential for rater error. However, especially in patients with severe mental illnesses, the equivalency of traditional and tablet-based tests cannot be assumed. The Brief Assessment of Cognition in Schizophrenia (BACS) is a pen-and-paper cognitive assessment tool that has been used in hundreds of research studies and clinical trials, and has normative data available for generating age- and gender-corrected standardized scores. A tablet-based version of the BACS called the BAC App has been developed. This study compared performance on the BACS and the BAC App in patients with schizophrenia and healthy controls. Test equivalency was assessed, and the applicability of paper-based normative data was evaluated. Results demonstrated the distributions of standardized composite scores for the tablet-based BAC App and the pen-and-paper BACS were indistinguishable, and the between-methods mean differences were not statistically significant. The discrimination between patients and controls was similarly robust. The between-methods correlations for individual measures in patients were r.>. 0.70 for most subtests. When data from the Token Motor Test was omitted, the between-methods correlation of composite scores was r. =. 0.88 (df. =. 48; p. <. 0.001) in healthy controls and r. =. 0.89 (df. =. 46; p. <. 0.001) in patients, consistent with the test-retest reliability of each measure. Taken together, results indicate that the tablet-based BAC App generates results consistent with the traditional pen-and-paper BACS, and support the notion that the BAC App is appropriate for use in clinical trials and clinical practice.

KW - App

KW - BACS

KW - Cognition

KW - Cognitive test

KW - Schizophrenia

KW - Tablet assessment

UR - http://www.scopus.com/inward/record.url?scp=85008951187&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85008951187&partnerID=8YFLogxK

U2 - 10.1016/j.schres.2016.10.010

DO - 10.1016/j.schres.2016.10.010

M3 - Article

C2 - 27771201

AN - SCOPUS:85008951187

JO - Schizophrenia Research

JF - Schizophrenia Research

SN - 0920-9964

ER -