Comparing the effects of dynamic computer visualization on undergraduate students’ understanding of osmosis with randomized posttest-only control group design

Shannon Hsianghan Huang Sung, Ji Shen, Shiyan Jiang, Guanhua Chen

Research output: Contribution to journalArticle

Abstract

This study describes the impact of embedding dynamic computer visualization (DCV) in an online instrument that was designed to assess students’ understanding of osmosis. The randomized posttest-only control group research was designed to compare the effect and the perceived helpfulness of the integration of DCV before and after the administration of an osmosis instrument. College students from three large classes (N = 640) were randomly assigned to participate in the research through an online system. Rasch-PCM was applied to determine the psychometric properties of the instrument and differentiate the student’s understanding of osmosis. Welch two-sample t test was applied to examine whether there was significant discrepancy between groups. Multiple regressions analysis was conducted to evaluate the association between predictors and the student’s understanding level, alluding to the performance on the online instrument. We found (a) the psychometric properties of the instrument with DCVs were reliable with good construct validity, (b) students who viewed DCV before they took the assessment performed better than those without, especially on solvation-related items, (c) students’ time spent on the DCVs significantly contributed to their performance, (d) the current data analytics enabled us to study respondents’ DCV navigation behavior, and (e) we summarized how participants perceived DCVs that are in the assessment. Educational implications and significance of this study is also discussed.

Original languageEnglish (US)
Article number26
JournalResearch and Practice in Technology Enhanced Learning
Volume12
Issue number1
DOIs
StatePublished - Dec 1 2017

Fingerprint

Osmosis
visualization
Visualization
Students
Control Groups
Group
student
Psychometrics
psychometrics
Online Systems
Online systems
Pulse code modulation
Solvation
construct validity
Research
Regression analysis
performance
Undergraduate students
regression analysis
Navigation

Keywords

  • Data analytics
  • Dynamic computer visualization
  • Item response theory
  • Navigation behavior
  • Online assessment
  • Osmosis

ASJC Scopus subject areas

  • Education
  • Social Psychology
  • Media Technology
  • Management of Technology and Innovation

Cite this

Comparing the effects of dynamic computer visualization on undergraduate students’ understanding of osmosis with randomized posttest-only control group design. / Sung, Shannon Hsianghan Huang; Shen, Ji; Jiang, Shiyan; Chen, Guanhua.

In: Research and Practice in Technology Enhanced Learning, Vol. 12, No. 1, 26, 01.12.2017.

Research output: Contribution to journalArticle

@article{461e6ff2e16e46eb85c89d353992f218,
title = "Comparing the effects of dynamic computer visualization on undergraduate students’ understanding of osmosis with randomized posttest-only control group design",
abstract = "This study describes the impact of embedding dynamic computer visualization (DCV) in an online instrument that was designed to assess students’ understanding of osmosis. The randomized posttest-only control group research was designed to compare the effect and the perceived helpfulness of the integration of DCV before and after the administration of an osmosis instrument. College students from three large classes (N = 640) were randomly assigned to participate in the research through an online system. Rasch-PCM was applied to determine the psychometric properties of the instrument and differentiate the student’s understanding of osmosis. Welch two-sample t test was applied to examine whether there was significant discrepancy between groups. Multiple regressions analysis was conducted to evaluate the association between predictors and the student’s understanding level, alluding to the performance on the online instrument. We found (a) the psychometric properties of the instrument with DCVs were reliable with good construct validity, (b) students who viewed DCV before they took the assessment performed better than those without, especially on solvation-related items, (c) students’ time spent on the DCVs significantly contributed to their performance, (d) the current data analytics enabled us to study respondents’ DCV navigation behavior, and (e) we summarized how participants perceived DCVs that are in the assessment. Educational implications and significance of this study is also discussed.",
keywords = "Data analytics, Dynamic computer visualization, Item response theory, Navigation behavior, Online assessment, Osmosis",
author = "Sung, {Shannon Hsianghan Huang} and Ji Shen and Shiyan Jiang and Guanhua Chen",
year = "2017",
month = "12",
day = "1",
doi = "10.1186/s41039-017-0067-3",
language = "English (US)",
volume = "12",
journal = "Research and Practice in Technology Enhanced Learning",
issn = "1793-7078",
publisher = "Springer Open",
number = "1",

}

TY - JOUR

T1 - Comparing the effects of dynamic computer visualization on undergraduate students’ understanding of osmosis with randomized posttest-only control group design

AU - Sung, Shannon Hsianghan Huang

AU - Shen, Ji

AU - Jiang, Shiyan

AU - Chen, Guanhua

PY - 2017/12/1

Y1 - 2017/12/1

N2 - This study describes the impact of embedding dynamic computer visualization (DCV) in an online instrument that was designed to assess students’ understanding of osmosis. The randomized posttest-only control group research was designed to compare the effect and the perceived helpfulness of the integration of DCV before and after the administration of an osmosis instrument. College students from three large classes (N = 640) were randomly assigned to participate in the research through an online system. Rasch-PCM was applied to determine the psychometric properties of the instrument and differentiate the student’s understanding of osmosis. Welch two-sample t test was applied to examine whether there was significant discrepancy between groups. Multiple regressions analysis was conducted to evaluate the association between predictors and the student’s understanding level, alluding to the performance on the online instrument. We found (a) the psychometric properties of the instrument with DCVs were reliable with good construct validity, (b) students who viewed DCV before they took the assessment performed better than those without, especially on solvation-related items, (c) students’ time spent on the DCVs significantly contributed to their performance, (d) the current data analytics enabled us to study respondents’ DCV navigation behavior, and (e) we summarized how participants perceived DCVs that are in the assessment. Educational implications and significance of this study is also discussed.

AB - This study describes the impact of embedding dynamic computer visualization (DCV) in an online instrument that was designed to assess students’ understanding of osmosis. The randomized posttest-only control group research was designed to compare the effect and the perceived helpfulness of the integration of DCV before and after the administration of an osmosis instrument. College students from three large classes (N = 640) were randomly assigned to participate in the research through an online system. Rasch-PCM was applied to determine the psychometric properties of the instrument and differentiate the student’s understanding of osmosis. Welch two-sample t test was applied to examine whether there was significant discrepancy between groups. Multiple regressions analysis was conducted to evaluate the association between predictors and the student’s understanding level, alluding to the performance on the online instrument. We found (a) the psychometric properties of the instrument with DCVs were reliable with good construct validity, (b) students who viewed DCV before they took the assessment performed better than those without, especially on solvation-related items, (c) students’ time spent on the DCVs significantly contributed to their performance, (d) the current data analytics enabled us to study respondents’ DCV navigation behavior, and (e) we summarized how participants perceived DCVs that are in the assessment. Educational implications and significance of this study is also discussed.

KW - Data analytics

KW - Dynamic computer visualization

KW - Item response theory

KW - Navigation behavior

KW - Online assessment

KW - Osmosis

UR - http://www.scopus.com/inward/record.url?scp=85065143497&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065143497&partnerID=8YFLogxK

U2 - 10.1186/s41039-017-0067-3

DO - 10.1186/s41039-017-0067-3

M3 - Article

AN - SCOPUS:85065143497

VL - 12

JO - Research and Practice in Technology Enhanced Learning

JF - Research and Practice in Technology Enhanced Learning

SN - 1793-7078

IS - 1

M1 - 26

ER -