Data drive development-multimodal measurement of classroom interaction

Daniel S. Messinger, Lynn Perry, Chaoming Song, Yudong Tao, Samantha Mitsven, Regina Fasano, Chitra Banarjee, Yi Zhang, Mei Ling Shyu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The educational inclusion of children with communication disorders together with typically developing (TD) peers is a national standard. However, we have little mechanistic understanding of how interactions with peers and teachers contribute to the language development of these children. To build that understanding, we combine objective measurement of the quantity and quality of child and teacher speech with radio frequency identification of their physical movement and orientation. Longitudinal observations of two different sets of classrooms are analyzed. One set of classrooms contains children who require hearing aids and cochlear implants. Another set of classrooms contains children with autism spectrum disorder (ASD). Computational modeling of pair-wise movement/orientation is used to derive periods of social contact when speech may occur. Results suggest that children with ASD are isolated from peers but approach teachers relatively quickly. Overall, talk with peers in social contact (and speech heard from teachers) promotes children's own talk which, in turn, is associated with assessed language abilities.

Original languageEnglish (US)
Title of host publicationICMI 2020 Companion - Companion Publication of the 2020 International Conference on Multimodal Interaction
PublisherAssociation for Computing Machinery, Inc
Pages357-359
Number of pages3
ISBN (Electronic)9781450380027
DOIs
StatePublished - Oct 25 2020
Event2020 International Conference on Multimodal Interaction, ICMI 2020 - Virtual, Online, Netherlands
Duration: Oct 25 2020Oct 29 2020

Publication series

NameICMI 2020 Companion - Companion Publication of the 2020 International Conference on Multimodal Interaction

Conference

Conference2020 International Conference on Multimodal Interaction, ICMI 2020
CountryNetherlands
CityVirtual, Online
Period10/25/2010/29/20

Keywords

  • Autism spectrum disorder
  • Hearing loss
  • Language development
  • Objective measurement
  • Social networks

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Data drive development-multimodal measurement of classroom interaction'. Together they form a unique fingerprint.

Cite this