A Bayesian Network Meta-Analysis to Synthesize the Influence of Contexts of Scaffolding Use on Cognitive Outcomes in STEM Education

Brian R. Belland, Andrew E. Walker, Nam Ju Kim

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Computer-based scaffolding provides temporary support that enables students to participate in and become more proficient at complex skills like problem solving, argumentation, and evaluation. While meta-analyses have addressed between-subject differences on cognitive outcomes resulting from scaffolding, none has addressed within-subject gains. This leaves much quantitative scaffolding literature not covered by existing meta-analyses. To address this gap, this study used Bayesian network meta-analysis to synthesize within-subjects (pre–post) differences resulting from scaffolding in 56 studies. We generated the posterior distribution using 20,000 Markov Chain Monte Carlo samples. Scaffolding has a consistently strong effect across student populations, STEM (science, technology, engineering, and mathematics) disciplines, and assessment levels, and a strong effect when used with most problem-centered instructional models (exception: inquiry-based learning and modeling visualization) and educational levels (exception: secondary education). Results also indicate some promising areas for future scaffolding research, including scaffolding among students with learning disabilities, for whom the effect size was particularly large (ḡ = 3.13).

Original languageEnglish (US)
Pages (from-to)1042-1081
Number of pages40
JournalReview of Educational Research
Volume87
Issue number6
DOIs
StatePublished - Dec 1 2017
Externally publishedYes

Fingerprint

mathematics
engineering
science
education
student
argumentation
secondary education
learning disability
visualization
evaluation
learning
literature

Keywords

  • Bayesian network meta-analysis
  • cognitive tutor
  • intelligent tutoring systems
  • problem-centered instruction
  • scaffold
  • STEM

ASJC Scopus subject areas

  • Education

Cite this

A Bayesian Network Meta-Analysis to Synthesize the Influence of Contexts of Scaffolding Use on Cognitive Outcomes in STEM Education. / Belland, Brian R.; Walker, Andrew E.; Kim, Nam Ju.

In: Review of Educational Research, Vol. 87, No. 6, 01.12.2017, p. 1042-1081.

Research output: Contribution to journalArticle

@article{454efd34bddc40da90f261cac6d641fe,
title = "A Bayesian Network Meta-Analysis to Synthesize the Influence of Contexts of Scaffolding Use on Cognitive Outcomes in STEM Education",
abstract = "Computer-based scaffolding provides temporary support that enables students to participate in and become more proficient at complex skills like problem solving, argumentation, and evaluation. While meta-analyses have addressed between-subject differences on cognitive outcomes resulting from scaffolding, none has addressed within-subject gains. This leaves much quantitative scaffolding literature not covered by existing meta-analyses. To address this gap, this study used Bayesian network meta-analysis to synthesize within-subjects (pre–post) differences resulting from scaffolding in 56 studies. We generated the posterior distribution using 20,000 Markov Chain Monte Carlo samples. Scaffolding has a consistently strong effect across student populations, STEM (science, technology, engineering, and mathematics) disciplines, and assessment levels, and a strong effect when used with most problem-centered instructional models (exception: inquiry-based learning and modeling visualization) and educational levels (exception: secondary education). Results also indicate some promising areas for future scaffolding research, including scaffolding among students with learning disabilities, for whom the effect size was particularly large (ḡ = 3.13).",
keywords = "Bayesian network meta-analysis, cognitive tutor, intelligent tutoring systems, problem-centered instruction, scaffold, STEM",
author = "Belland, {Brian R.} and Walker, {Andrew E.} and Kim, {Nam Ju}",
year = "2017",
month = "12",
day = "1",
doi = "10.3102/0034654317723009",
language = "English (US)",
volume = "87",
pages = "1042--1081",
journal = "Review of Educational Research",
issn = "0034-6543",
publisher = "SAGE Publications Inc.",
number = "6",

}

TY - JOUR

T1 - A Bayesian Network Meta-Analysis to Synthesize the Influence of Contexts of Scaffolding Use on Cognitive Outcomes in STEM Education

AU - Belland, Brian R.

AU - Walker, Andrew E.

AU - Kim, Nam Ju

PY - 2017/12/1

Y1 - 2017/12/1

N2 - Computer-based scaffolding provides temporary support that enables students to participate in and become more proficient at complex skills like problem solving, argumentation, and evaluation. While meta-analyses have addressed between-subject differences on cognitive outcomes resulting from scaffolding, none has addressed within-subject gains. This leaves much quantitative scaffolding literature not covered by existing meta-analyses. To address this gap, this study used Bayesian network meta-analysis to synthesize within-subjects (pre–post) differences resulting from scaffolding in 56 studies. We generated the posterior distribution using 20,000 Markov Chain Monte Carlo samples. Scaffolding has a consistently strong effect across student populations, STEM (science, technology, engineering, and mathematics) disciplines, and assessment levels, and a strong effect when used with most problem-centered instructional models (exception: inquiry-based learning and modeling visualization) and educational levels (exception: secondary education). Results also indicate some promising areas for future scaffolding research, including scaffolding among students with learning disabilities, for whom the effect size was particularly large (ḡ = 3.13).

AB - Computer-based scaffolding provides temporary support that enables students to participate in and become more proficient at complex skills like problem solving, argumentation, and evaluation. While meta-analyses have addressed between-subject differences on cognitive outcomes resulting from scaffolding, none has addressed within-subject gains. This leaves much quantitative scaffolding literature not covered by existing meta-analyses. To address this gap, this study used Bayesian network meta-analysis to synthesize within-subjects (pre–post) differences resulting from scaffolding in 56 studies. We generated the posterior distribution using 20,000 Markov Chain Monte Carlo samples. Scaffolding has a consistently strong effect across student populations, STEM (science, technology, engineering, and mathematics) disciplines, and assessment levels, and a strong effect when used with most problem-centered instructional models (exception: inquiry-based learning and modeling visualization) and educational levels (exception: secondary education). Results also indicate some promising areas for future scaffolding research, including scaffolding among students with learning disabilities, for whom the effect size was particularly large (ḡ = 3.13).

KW - Bayesian network meta-analysis

KW - cognitive tutor

KW - intelligent tutoring systems

KW - problem-centered instruction

KW - scaffold

KW - STEM

UR - http://www.scopus.com/inward/record.url?scp=85032927817&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85032927817&partnerID=8YFLogxK

U2 - 10.3102/0034654317723009

DO - 10.3102/0034654317723009

M3 - Article

VL - 87

SP - 1042

EP - 1081

JO - Review of Educational Research

JF - Review of Educational Research

SN - 0034-6543

IS - 6

ER -