View-invariant human activity recognition based on shape and motion features

Research output: Chapter in Book/Report/Conference proceedingConference contribution

47 Scopus citations

Abstract

Recognizing human activities from image sequences is an active area of research in computer vision. Most of the previous work on activity recognition focuses on recognition from a single view and ignores the issue of view invariance. In this paper, we present a view invariant human activity recognition approach that uses both motion and shape information for activity representation. For each frame in the video, a 128 dimensional optical flow vector of the region of interest is used to represent the motion of the human body, and a 90 dimensional eigen-shape vector is used to represent the shape. Each activity is represented by a set of Hidden Markov Models (HMMs), where each model represents the activity from a different viewing direction, to realize view-invariance recognition. Experiments on a database of video clips of different activities show that our method is robust.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE Sixth International Symposium on Multimedia Software Engineering, MSE 2004
Pages546-556
Number of pages11
StatePublished - Dec 1 2004
EventProceedings - IEEE Sixth International Symposium on Multimedia Software Engineering, MSE 2004 - Miami, FL, United States
Duration: Dec 13 2004Dec 15 2004

Publication series

NameProceedings - IEEE Sixth International Symposium on Multimedia Software Engineering, MSE 2004

Other

OtherProceedings - IEEE Sixth International Symposium on Multimedia Software Engineering, MSE 2004
CountryUnited States
CityMiami, FL
Period12/13/0412/15/04

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'View-invariant human activity recognition based on shape and motion features'. Together they form a unique fingerprint.

  • Cite this

    Niu, F., & Abdel-Mottaleb, M. (2004). View-invariant human activity recognition based on shape and motion features. In Proceedings - IEEE Sixth International Symposium on Multimedia Software Engineering, MSE 2004 (pp. 546-556). (Proceedings - IEEE Sixth International Symposium on Multimedia Software Engineering, MSE 2004).