Designing SmartSignPlay: An interactive and intelligent American Sign Language app for children who are deaf or hard of hearing and their families

Ching-Hua Chuan, Caroline Anne Guardino

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

This paper describes an interactive mobile application that aims to assist children who are deaf or hard of hearing (D/HH) and their families to learn and practice American Sign Language (ASL). Approximately 95% of D/HH children are born to hearing parents. Research indicates that the lack of common communication tools between the parent and child often results in delayed development in the child's language and social skills. Benefiting from the interactive advantages and popularity of touchscreen mobile devices, we created SmartSignPlay, an app to teach D/HH children and their families everyday ASL vocabulary and phrases. Vocabulary is arranged into context-based lessons where the vocabulary is frequently used. After watching the sign demonstrated by an animated avatar, the user performed the sign by drawing the trajectory of the hand movement and selecting the correct handshape. While the app is still under iterative development, preliminary results on the usability are provided.

Original languageEnglish (US)
Title of host publicationIUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces
PublisherAssociation for Computing Machinery
Pages45-48
Number of pages4
ISBN (Electronic)9781450341400
DOIs
StatePublished - Mar 7 2016
Externally publishedYes
Event21st International Conference on Intelligent User Interfaces, IUI 2016 - Sonoma, United States
Duration: Mar 7 2016Mar 10 2016

Other

Other21st International Conference on Intelligent User Interfaces, IUI 2016
CountryUnited States
CitySonoma
Period3/7/163/10/16

Fingerprint

Audition
Application programs
Touch screens
Mobile devices
Trajectories
Communication

Keywords

  • American Sign Language
  • Assistive technology
  • Context-aware learning
  • Feedback
  • Touchscreen

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Cite this

Chuan, C-H., & Guardino, C. A. (2016). Designing SmartSignPlay: An interactive and intelligent American Sign Language app for children who are deaf or hard of hearing and their families. In IUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces (pp. 45-48). Association for Computing Machinery. https://doi.org/10.1145/2876456.2879483

Designing SmartSignPlay : An interactive and intelligent American Sign Language app for children who are deaf or hard of hearing and their families. / Chuan, Ching-Hua; Guardino, Caroline Anne.

IUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces. Association for Computing Machinery, 2016. p. 45-48.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chuan, C-H & Guardino, CA 2016, Designing SmartSignPlay: An interactive and intelligent American Sign Language app for children who are deaf or hard of hearing and their families. in IUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces. Association for Computing Machinery, pp. 45-48, 21st International Conference on Intelligent User Interfaces, IUI 2016, Sonoma, United States, 3/7/16. https://doi.org/10.1145/2876456.2879483
Chuan C-H, Guardino CA. Designing SmartSignPlay: An interactive and intelligent American Sign Language app for children who are deaf or hard of hearing and their families. In IUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces. Association for Computing Machinery. 2016. p. 45-48 https://doi.org/10.1145/2876456.2879483
Chuan, Ching-Hua ; Guardino, Caroline Anne. / Designing SmartSignPlay : An interactive and intelligent American Sign Language app for children who are deaf or hard of hearing and their families. IUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces. Association for Computing Machinery, 2016. pp. 45-48
@inproceedings{6f98761c628544a884484231b6ef6ea0,
title = "Designing SmartSignPlay: An interactive and intelligent American Sign Language app for children who are deaf or hard of hearing and their families",
abstract = "This paper describes an interactive mobile application that aims to assist children who are deaf or hard of hearing (D/HH) and their families to learn and practice American Sign Language (ASL). Approximately 95{\%} of D/HH children are born to hearing parents. Research indicates that the lack of common communication tools between the parent and child often results in delayed development in the child's language and social skills. Benefiting from the interactive advantages and popularity of touchscreen mobile devices, we created SmartSignPlay, an app to teach D/HH children and their families everyday ASL vocabulary and phrases. Vocabulary is arranged into context-based lessons where the vocabulary is frequently used. After watching the sign demonstrated by an animated avatar, the user performed the sign by drawing the trajectory of the hand movement and selecting the correct handshape. While the app is still under iterative development, preliminary results on the usability are provided.",
keywords = "American Sign Language, Assistive technology, Context-aware learning, Feedback, Touchscreen",
author = "Ching-Hua Chuan and Guardino, {Caroline Anne}",
year = "2016",
month = "3",
day = "7",
doi = "10.1145/2876456.2879483",
language = "English (US)",
pages = "45--48",
booktitle = "IUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Designing SmartSignPlay

T2 - An interactive and intelligent American Sign Language app for children who are deaf or hard of hearing and their families

AU - Chuan, Ching-Hua

AU - Guardino, Caroline Anne

PY - 2016/3/7

Y1 - 2016/3/7

N2 - This paper describes an interactive mobile application that aims to assist children who are deaf or hard of hearing (D/HH) and their families to learn and practice American Sign Language (ASL). Approximately 95% of D/HH children are born to hearing parents. Research indicates that the lack of common communication tools between the parent and child often results in delayed development in the child's language and social skills. Benefiting from the interactive advantages and popularity of touchscreen mobile devices, we created SmartSignPlay, an app to teach D/HH children and their families everyday ASL vocabulary and phrases. Vocabulary is arranged into context-based lessons where the vocabulary is frequently used. After watching the sign demonstrated by an animated avatar, the user performed the sign by drawing the trajectory of the hand movement and selecting the correct handshape. While the app is still under iterative development, preliminary results on the usability are provided.

AB - This paper describes an interactive mobile application that aims to assist children who are deaf or hard of hearing (D/HH) and their families to learn and practice American Sign Language (ASL). Approximately 95% of D/HH children are born to hearing parents. Research indicates that the lack of common communication tools between the parent and child often results in delayed development in the child's language and social skills. Benefiting from the interactive advantages and popularity of touchscreen mobile devices, we created SmartSignPlay, an app to teach D/HH children and their families everyday ASL vocabulary and phrases. Vocabulary is arranged into context-based lessons where the vocabulary is frequently used. After watching the sign demonstrated by an animated avatar, the user performed the sign by drawing the trajectory of the hand movement and selecting the correct handshape. While the app is still under iterative development, preliminary results on the usability are provided.

KW - American Sign Language

KW - Assistive technology

KW - Context-aware learning

KW - Feedback

KW - Touchscreen

UR - http://www.scopus.com/inward/record.url?scp=85014201158&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85014201158&partnerID=8YFLogxK

U2 - 10.1145/2876456.2879483

DO - 10.1145/2876456.2879483

M3 - Conference contribution

AN - SCOPUS:85014201158

SP - 45

EP - 48

BT - IUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces

PB - Association for Computing Machinery

ER -