A comparison of alternative classifiers for detecting occurrence and intensity in spontaneous facial expression of infants with their mothers

Nazanin Zaker, Mohammad H. Mahoor, Whitney I. Mattson, Daniel S. Messinger, Jeffrey F. Cohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

To model the dynamics of social interaction, it is necessary both to detect specific Action Units (AUs) and variation in their intensity and coordination over time. An automated method that performs well when detecting occurrence may or may not perform well for intensity measurements. We compared two dimensionality reduction approaches - Principal Components Analysis with Large Margin Nearest Neighbor (PCA+LMNN) and Laplacian Eigenmap - and two classifiers, SVM and K-Nearest Neighbor. Twelve infants were video-recorded during face-to-face interactions with their mothers. AUs related to positive and negative affect were manually coded from the video by certified FACS coders. Facial features were tracked using Active Appearance Models (AAM) and registered to a canonical view before extracting Histogram of Oriented Gradients (HOG) features. All possible combinations of dimensionality reduction approaches and classifiers were tested using a leave-one-subject-out cross-validation. For detecting consistency (i.e. reliability as measured by ICC), PCA+LMNN and SVM classifiers gave best results.

Original languageEnglish (US)
Title of host publication2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013
DOIs
StatePublished - Aug 20 2013
Event2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013 - Shanghai, China
Duration: Apr 22 2013Apr 26 2013

Publication series

Name2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013

Other

Other2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013
CountryChina
CityShanghai
Period4/22/134/26/13

Keywords

  • Action Unit
  • Facial Expressions
  • Histogram of Oriented Gradients
  • Laplacian Eigenmap
  • Structural SVM

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'A comparison of alternative classifiers for detecting occurrence and intensity in spontaneous facial expression of infants with their mothers'. Together they form a unique fingerprint.

  • Cite this

    Zaker, N., Mahoor, M. H., Mattson, W. I., Messinger, D. S., & Cohn, J. F. (2013). A comparison of alternative classifiers for detecting occurrence and intensity in spontaneous facial expression of infants with their mothers. In 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013 [6553795] (2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013). https://doi.org/10.1109/FG.2013.6553795