Video Big Data Retrieval Over Media Cloud: A Context-aware Online Learning Approach

Yinan Feng, Pan Zhou, Jie Xu, Shouling Ji, Dapeng Oliver Wu

Research output: Contribution to journalArticle

6 Scopus citations


Online video sharing (e.g., YouTube, YouKu) has emerged as one of the most important services in the current Internet, where billions of videos on the cloud are awaiting people for exploration. Hence, it is necessary for a personalized video retrieval system helping users to find interesting videos from such big data contents. One of the main challenges is how to process the increasing video big data and resolve the accompanying "cold start" issue efficiently. Another challenge is how to satisfy the users' need for the personalized retrieval results, which makes the accuracy of results unknown. In this paper, we formulate the personalized video big data retrieval problem as an interaction between user and system with a stochasticprocess (SP), not just a similarity matching, accuracy (feedback) model of the retrieval, introduce users' real-time context into the retrieval system, and propose a general framework of this problem. By using a novel contextual multi-armed bandit-based algorithm to balance the accuracy and efficiency, we propose a context-based online big-data-oriented personalized video retrieval system. It can support dynamically increasing datasets and has the nature of cross-modal retrieval. Our approach provides accurate retrieval results with sublinear regret and linear storage complexity and significantly improves the learning speed. Furthermore, by learning together for a cluster of similar contexts, we can reach sublinear storage complexity with the same regret but a slightly poorer performance on the "cold start" issue than the previous one. We validate our theoretical results by experiments on a tremendously large dataset, which show that the proposed algorithms outperform existing bandit-based online learning methods in terms of accuracy and efficiency, and the adaptation from bandit framework offers further benefits.

Original languageEnglish (US)
JournalIEEE Transactions on Multimedia
StateAccepted/In press - Jan 1 2018


  • Big Data
  • Big data
  • Cloud computing
  • Clustering algorithms
  • Complexity theory
  • contextual bandit
  • Media
  • media cloud
  • online learning
  • online learning
  • Real-time systems
  • Streaming media
  • video retrieval

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Video Big Data Retrieval Over Media Cloud: A Context-aware Online Learning Approach'. Together they form a unique fingerprint.

  • Cite this