Intensity measurement of spontaneous facial actions: Evaluation of different image representations

Nazanin Zaker, Mohammad H. Mahoor, Whitney I. Mattson, Daniel S. Messinger, Jeffrey F. Cohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

Intensity measurements of infant facial expressions are central to understand emotion-mediated interactions and emotional development. We evaluate alternative image representations for automatic measurement of the intensity of spontaneous facial Action Units (AUs) related to infant emotion expression. Twelve infants were video-recorded during face-to-face interactions with their mothers. Facial features were tracked using active appearance models (AAMs) and registered to a canonical view. Three feature representations were compared: shape and grey scale texture, Histogram of Oriented Gradients (HOG), and Local Binary Pattern Histograms (LBPH). To reduce the high dimensionality of the appearance features (grey scale texture, HOG, and LBPH), a non-linear algorithm was used (Laplacian Eigenmaps). For each representation, support vector machine classifiers were used to learn six gradations of AU intensity (0 to maximal). The target AUs were those central to positive and negative infant emotion. Shape plus grey scale texture performed best for AUs that involve non-rigid deformations of permanent facial features (e.g., AU 12 and AU 20). These findings suggest that AU intensity detection may be maximized by choosing feature representations best suited for specific AU.

Original languageEnglish (US)
Title of host publication2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012
DOIs
StatePublished - Dec 1 2012
Event2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012 - "San Diego,CA", United States
Duration: Nov 7 2012Nov 9 2012

Publication series

Name2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012

Other

Other2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012
CountryUnited States
City"San Diego,CA"
Period11/7/1211/9/12

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Intensity measurement of spontaneous facial actions: Evaluation of different image representations'. Together they form a unique fingerprint.

  • Cite this

    Zaker, N., Mahoor, M. H., Mattson, W. I., Messinger, D. S., & Cohn, J. F. (2012). Intensity measurement of spontaneous facial actions: Evaluation of different image representations. In 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012 [6400846] (2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012). https://doi.org/10.1109/DevLrn.2012.6400846