Florida International University - University of Miami Trecvid 2018

Samira Pouyanfar, Yudong Tao, Haiman Tian, Maria Presa Reyes, Yuexuan Tu, Yilin Yan, Tianyi Wang, Hector Cen, Yingxin Li, Saad Sadiq, Mei Ling Shyu, Shu Ching Chen, Winnie Chen, Tiffany Chen, Jonathan Chen

Research output: Contribution to conferencePaper

Abstract

This paper presents the framework and results from the team “Florida International University-University of Miami (FIU-UM)” in the TRECVID 2018 Ad-hoc Video Search (AVS) [1] task. We submitted four manually-assisted runs as follows. • M_D_FIU_UM.18_1 & M_D_FIU_UM.18_3: Convolutional Neural Network (CNN) features + linear Support Vector Machine (SVM), scores from other sources, two different sets of concepts and weighted combinations (“and”, “or”, & “mix” operations) • M_D_FIU_UM.18_2: CNN features + linear SVM, scores from other sources, weighted combination (“and”, “or”, & “mix” operations) + rectified linear score normalization • M_D_FIU_UM.18_4: CNN features + linear SVM, scores from other sources, weighted combination (“and”, “or”, & “mix” operations) + fuse different score sets (“merge” operation) Our framework includes the following processing steps: (1) manual extraction of the most important keywords based on a given query, (2) generation of CNN features from keyframes, (3) generation of scores for each concept using the linear SVM classifier, (4) generation of additional scores from multiple pre-trained models for image classification, object, scene, and action detection, (5) just-in-time concept learning for keywords not found in the concept bank, and (6) integration of the scores using the “and”, “or”, “mix”, and “merge” operators. The performance results show that our first run (M_D_FIU_UM.18_1), which includes our best-weighted combination scores, outperforms the other three runs. This year, the FIU-UM team achieved the second highest score in the manually-assisted run and ranked third among all the submitted runs (combining manually-assisted and automatic runs). The submission details are listed as follows. • Class: M (Manually-assisted runs) • Training type: D (IACC & non-IACC non-TRECVID data) • Team ID: FIU-UM (Florida International University - University of Miami) • Year: 2018.

Original languageEnglish (US)
StatePublished - Jan 1 2020
Event2018 TREC Video Retrieval Evaluation, TRECVID 2018 - Gaithersburg, United States
Duration: Nov 13 2018Nov 15 2018

Conference

Conference2018 TREC Video Retrieval Evaluation, TRECVID 2018
CountryUnited States
CityGaithersburg
Period11/13/1811/15/18

ASJC Scopus subject areas

  • Information Systems
  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Florida International University - University of Miami Trecvid 2018'. Together they form a unique fingerprint.

  • Cite this

    Pouyanfar, S., Tao, Y., Tian, H., Reyes, M. P., Tu, Y., Yan, Y., Wang, T., Cen, H., Li, Y., Sadiq, S., Shyu, M. L., Chen, S. C., Chen, W., Chen, T., & Chen, J. (2020). Florida International University - University of Miami Trecvid 2018. Paper presented at 2018 TREC Video Retrieval Evaluation, TRECVID 2018, Gaithersburg, United States.