Semantic retrieval for videos in non-static background using motion saliency and global features

Dianting Liu, Mei Ling Shyu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

In this paper, a video semantic retrieval framework is proposed based on a novel unsupervised motion region detection algorithm which works reasonably well with dynamic background and camera motion. The proposed framework is inspired by biological mechanisms of human vision which make motion salience (defined as attention due to motion) is more attractive than some other low-level visual features to people while watching videos. Under this biological observation, motion vectors in frame sequences are calculated using the optical flow algorithm to estimate the movement of a block from one frame to another. Next, a center-surround coherency evaluation model is proposed to compute the local motion saliency in a completely unsupervised manner. The integral density algorithm is employed to search the globally optimal solution of the minimum coherency region as the motion region which is then integrated into the video semantic retrieval framework to enhance the performance of video semantic analysis and understanding. Our proposed framework is evaluated using video sequences in non-static background, and the promising experimental results reveal that the semantic retrieval performance can be improved by integrating the global texture and local motion information.

Original languageEnglish (US)
Title of host publicationProceedings - 2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013
Pages294-301
Number of pages8
DOIs
StatePublished - Dec 1 2013
Event2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013 - Irvine, CA, United States
Duration: Sep 16 2013Sep 18 2013

Publication series

NameProceedings - 2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013

Other

Other2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013
CountryUnited States
CityIrvine, CA
Period9/16/139/18/13

Keywords

  • Global feature
  • Motion detection
  • Motion saliency
  • Non-static background
  • Video semantic retrieval

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Semantic retrieval for videos in non-static background using motion saliency and global features'. Together they form a unique fingerprint.

  • Cite this

    Liu, D., & Shyu, M. L. (2013). Semantic retrieval for videos in non-static background using motion saliency and global features. In Proceedings - 2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013 (pp. 294-301). [6693532] (Proceedings - 2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013). https://doi.org/10.1109/ICSC.2013.57