Video Big Data Retrieval over Media Cloud: A Context-Aware Online Learning Approach

Yinan Feng, Pan Zhou, Jie Xu, Shouling Ji, Dapeng Wu

Research output: Contribution to journalArticlepeer-review

14 Scopus citations


Online video sharing (e.g., via YouTube or YouKu) has emerged as one of the most important services in the current Internet, where billions of videos on the cloud are awaiting exploration. Hence, a personalized video retrieval system is needed to help users find interesting videos from big data content. Two of the main challenges are to process the increasing amount of video big data and resolve the accompanying 'cold start' issue efficiently. Another challenge is to satisfy the users' need for personalized retrieval results, of which the accuracy is unknown. In this paper, we formulate the personalized video big data retrieval problem as an interaction between the user and the system via a stochastic process, not just a similarity matching, accuracy (feedback) model of the retrieval; introduce users' real-time context into the retrieval system; and propose a general framework for this problem. By using a novel contextual multiarmed bandit-based algorithm to balance the accuracy and efficiency, we propose a context-based online big-data-oriented personalized video retrieval system. This system can support datasets that are dynamically increasing in size and has the property of cross-modal retrieval. Our approach provides accurate retrieval results with sublinear regret and linear storage complexity and significantly improves the learning speed. Furthermore, by learning for a cluster of similar contexts simultaneously, we can realize sublinear storage complexity with the same regret but slightly poorer performance on the 'cold start' issue compared to the previous approach. We validate our theoretical results experimentally on a tremendously large dataset; the results demonstrate that the proposed algorithms outperform existing bandit-based online learning methods in terms of accuracy and efficiency and the adaptation from the bandit framework offers additional benefits.

Original languageEnglish (US)
Article number8573816
Pages (from-to)1762-1777
Number of pages16
JournalIEEE Transactions on Multimedia
Issue number7
StatePublished - Jul 2019


  • Big data
  • contextual bandit
  • media cloud
  • online learning
  • online learning
  • video retrieval

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Video Big Data Retrieval over Media Cloud: A Context-Aware Online Learning Approach'. Together they form a unique fingerprint.

Cite this