Development and validation of a streamlined autism case confirmation approach for use in epidemiologic risk factor research in prospective cohorts

Craig J. Newschaffer, Emily Schriver, Lindsay Berrigan, Rebecca Landa, Wendy L. Stone, Somer Bishop, Diane Burkom, Anne Golden, Lisa Ibanez, Alice Kuo, Kimberly D. Lakes, Daniel S Messinger, Sarah Paterson, Zachary E. Warren

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The cost associated with incorporating standardized observational assessments and diagnostic interviews in large-scale epidemiologic studies of autism spectrum disorders (ASD) risk factors can be substantial. Streamlined approaches for confirming ASD case status would benefit these studies. We conducted a multi-site, cross-sectional criterion validity study in a convenience sample of 382 three-year olds scheduled for neurodevelopmental evaluation. ASD case classification as determined by three novel assessment instruments (the Early Video-guided Autism Screener E-VAS; the Autism Symptom Interview, ASI; the Screening Tool for Autism in Toddlers Expanded, STAT-E) each designed to be administered in less than 30 minutes by lay staff, was compared to ADOS scores and DSM-based diagnostic assessment from a qualified clinician. Sensitivity and specificity of each instrument alone and in combination were estimated. Alternative cutpoints were identified under different criteria and two-stage cross validation was used to avoid overfitting. Findings were interpreted in the context of a large, prospective pregnancy cohort study utilizing a two-stage approach to case identification. Under initial cutpoints, sensitivity ranged from 0.63 to 0.92 and specificity from 0.35 to 0.70. Cutpoints giving equal weight to sensitivity and specificity resulted in sensitivity estimates ranging from 0.45 to 0.83 and specificity ranging from 0.49 to 0.86. Several strategies were well-suited for application as a second-stage case-confirmation. These included the STAT-E alone and the parallel administration of both the E-VAS and the ASI. Use of more streamlined methods of case-confirmation in large-scale prospective cohort epidemiologic investigations of ASD risk factors appears feasible.

Original languageEnglish (US)
JournalAutism Research
DOIs
StateAccepted/In press - 2016

Fingerprint

Epidemiologic Factors
Autistic Disorder
Research
Interviews
Sensitivity and Specificity
Epidemiologic Studies
Cohort Studies
Weights and Measures
Costs and Cost Analysis
Pregnancy
Autism Spectrum Disorder

Keywords

  • ASD
  • Autism
  • Case-confirmation
  • Diagnosis
  • Epidemiology
  • Novel assessments

ASJC Scopus subject areas

  • Neuroscience(all)
  • Clinical Neurology
  • Genetics(clinical)

Cite this

Development and validation of a streamlined autism case confirmation approach for use in epidemiologic risk factor research in prospective cohorts. / Newschaffer, Craig J.; Schriver, Emily; Berrigan, Lindsay; Landa, Rebecca; Stone, Wendy L.; Bishop, Somer; Burkom, Diane; Golden, Anne; Ibanez, Lisa; Kuo, Alice; Lakes, Kimberly D.; Messinger, Daniel S; Paterson, Sarah; Warren, Zachary E.

In: Autism Research, 2016.

Research output: Contribution to journalArticle

Newschaffer, CJ, Schriver, E, Berrigan, L, Landa, R, Stone, WL, Bishop, S, Burkom, D, Golden, A, Ibanez, L, Kuo, A, Lakes, KD, Messinger, DS, Paterson, S & Warren, ZE 2016, 'Development and validation of a streamlined autism case confirmation approach for use in epidemiologic risk factor research in prospective cohorts', Autism Research. https://doi.org/10.1002/aur.1659
Newschaffer, Craig J. ; Schriver, Emily ; Berrigan, Lindsay ; Landa, Rebecca ; Stone, Wendy L. ; Bishop, Somer ; Burkom, Diane ; Golden, Anne ; Ibanez, Lisa ; Kuo, Alice ; Lakes, Kimberly D. ; Messinger, Daniel S ; Paterson, Sarah ; Warren, Zachary E. / Development and validation of a streamlined autism case confirmation approach for use in epidemiologic risk factor research in prospective cohorts. In: Autism Research. 2016.
@article{ac1bfbd37c05407498881e055b58561e,
title = "Development and validation of a streamlined autism case confirmation approach for use in epidemiologic risk factor research in prospective cohorts",
abstract = "The cost associated with incorporating standardized observational assessments and diagnostic interviews in large-scale epidemiologic studies of autism spectrum disorders (ASD) risk factors can be substantial. Streamlined approaches for confirming ASD case status would benefit these studies. We conducted a multi-site, cross-sectional criterion validity study in a convenience sample of 382 three-year olds scheduled for neurodevelopmental evaluation. ASD case classification as determined by three novel assessment instruments (the Early Video-guided Autism Screener E-VAS; the Autism Symptom Interview, ASI; the Screening Tool for Autism in Toddlers Expanded, STAT-E) each designed to be administered in less than 30 minutes by lay staff, was compared to ADOS scores and DSM-based diagnostic assessment from a qualified clinician. Sensitivity and specificity of each instrument alone and in combination were estimated. Alternative cutpoints were identified under different criteria and two-stage cross validation was used to avoid overfitting. Findings were interpreted in the context of a large, prospective pregnancy cohort study utilizing a two-stage approach to case identification. Under initial cutpoints, sensitivity ranged from 0.63 to 0.92 and specificity from 0.35 to 0.70. Cutpoints giving equal weight to sensitivity and specificity resulted in sensitivity estimates ranging from 0.45 to 0.83 and specificity ranging from 0.49 to 0.86. Several strategies were well-suited for application as a second-stage case-confirmation. These included the STAT-E alone and the parallel administration of both the E-VAS and the ASI. Use of more streamlined methods of case-confirmation in large-scale prospective cohort epidemiologic investigations of ASD risk factors appears feasible.",
keywords = "ASD, Autism, Case-confirmation, Diagnosis, Epidemiology, Novel assessments",
author = "Newschaffer, {Craig J.} and Emily Schriver and Lindsay Berrigan and Rebecca Landa and Stone, {Wendy L.} and Somer Bishop and Diane Burkom and Anne Golden and Lisa Ibanez and Alice Kuo and Lakes, {Kimberly D.} and Messinger, {Daniel S} and Sarah Paterson and Warren, {Zachary E.}",
year = "2016",
doi = "10.1002/aur.1659",
language = "English (US)",
journal = "Autism Research",
issn = "1939-3806",
publisher = "John Wiley and Sons Inc.",

}

TY - JOUR

T1 - Development and validation of a streamlined autism case confirmation approach for use in epidemiologic risk factor research in prospective cohorts

AU - Newschaffer, Craig J.

AU - Schriver, Emily

AU - Berrigan, Lindsay

AU - Landa, Rebecca

AU - Stone, Wendy L.

AU - Bishop, Somer

AU - Burkom, Diane

AU - Golden, Anne

AU - Ibanez, Lisa

AU - Kuo, Alice

AU - Lakes, Kimberly D.

AU - Messinger, Daniel S

AU - Paterson, Sarah

AU - Warren, Zachary E.

PY - 2016

Y1 - 2016

N2 - The cost associated with incorporating standardized observational assessments and diagnostic interviews in large-scale epidemiologic studies of autism spectrum disorders (ASD) risk factors can be substantial. Streamlined approaches for confirming ASD case status would benefit these studies. We conducted a multi-site, cross-sectional criterion validity study in a convenience sample of 382 three-year olds scheduled for neurodevelopmental evaluation. ASD case classification as determined by three novel assessment instruments (the Early Video-guided Autism Screener E-VAS; the Autism Symptom Interview, ASI; the Screening Tool for Autism in Toddlers Expanded, STAT-E) each designed to be administered in less than 30 minutes by lay staff, was compared to ADOS scores and DSM-based diagnostic assessment from a qualified clinician. Sensitivity and specificity of each instrument alone and in combination were estimated. Alternative cutpoints were identified under different criteria and two-stage cross validation was used to avoid overfitting. Findings were interpreted in the context of a large, prospective pregnancy cohort study utilizing a two-stage approach to case identification. Under initial cutpoints, sensitivity ranged from 0.63 to 0.92 and specificity from 0.35 to 0.70. Cutpoints giving equal weight to sensitivity and specificity resulted in sensitivity estimates ranging from 0.45 to 0.83 and specificity ranging from 0.49 to 0.86. Several strategies were well-suited for application as a second-stage case-confirmation. These included the STAT-E alone and the parallel administration of both the E-VAS and the ASI. Use of more streamlined methods of case-confirmation in large-scale prospective cohort epidemiologic investigations of ASD risk factors appears feasible.

AB - The cost associated with incorporating standardized observational assessments and diagnostic interviews in large-scale epidemiologic studies of autism spectrum disorders (ASD) risk factors can be substantial. Streamlined approaches for confirming ASD case status would benefit these studies. We conducted a multi-site, cross-sectional criterion validity study in a convenience sample of 382 three-year olds scheduled for neurodevelopmental evaluation. ASD case classification as determined by three novel assessment instruments (the Early Video-guided Autism Screener E-VAS; the Autism Symptom Interview, ASI; the Screening Tool for Autism in Toddlers Expanded, STAT-E) each designed to be administered in less than 30 minutes by lay staff, was compared to ADOS scores and DSM-based diagnostic assessment from a qualified clinician. Sensitivity and specificity of each instrument alone and in combination were estimated. Alternative cutpoints were identified under different criteria and two-stage cross validation was used to avoid overfitting. Findings were interpreted in the context of a large, prospective pregnancy cohort study utilizing a two-stage approach to case identification. Under initial cutpoints, sensitivity ranged from 0.63 to 0.92 and specificity from 0.35 to 0.70. Cutpoints giving equal weight to sensitivity and specificity resulted in sensitivity estimates ranging from 0.45 to 0.83 and specificity ranging from 0.49 to 0.86. Several strategies were well-suited for application as a second-stage case-confirmation. These included the STAT-E alone and the parallel administration of both the E-VAS and the ASI. Use of more streamlined methods of case-confirmation in large-scale prospective cohort epidemiologic investigations of ASD risk factors appears feasible.

KW - ASD

KW - Autism

KW - Case-confirmation

KW - Diagnosis

KW - Epidemiology

KW - Novel assessments

UR - http://www.scopus.com/inward/record.url?scp=84980411212&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84980411212&partnerID=8YFLogxK

U2 - 10.1002/aur.1659

DO - 10.1002/aur.1659

M3 - Article

C2 - 27484054

AN - SCOPUS:84980411212

JO - Autism Research

JF - Autism Research

SN - 1939-3806

ER -