Utilization of co-occurrence relationships between semantic concepts in re-ranking for information retrieval

Chao Chen, Lin Lin, Mei-Ling Shyu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Semantic information retrieval is a popular research topic in the multimedia area. The goal of the retrieval is to provide the end users with as relevant results as possible. Many research efforts have been done to build ranking models for different semantic concepts (or classes). While some of them have been proven to be effective, others are still far from satisfactory. Our observation that certain target semantic concepts have high co-occurrence relationships with those easy-to-retrieve semantic concepts (or called reference semantics) has motivated us to utilize such co-occurrence relationships between semantic concepts in information retrieval and re-ranking. In this paper, we propose a novel semantic retrieval and re-ranking framework that takes advantage of the co-occurrence relationships between a target semantic concept and a reference semantic concept to re-rank the retrieved results. The proposed framework discretizes the training data into a set of feature-value pairs and employs Multiple Correspondence Analysis (MCA) to capture the correlation in terms of the impact weight between feature-value pairs and the positive-positive class in which the data instances belong to both the target semantic concept and the reference semantic concept. A combination of all these impact weights is utilized to re-rank the retrieved results for the target semantic concept. Comparative experiments are designed and evaluated on TRECVID 2005 and TRECVID 2010 video collections with public-available ranking scores. Experimental results on different retrieval scales demonstrate that our proposed framework can enhance the retrieval results for the target semantic concepts in terms of average precision, and the improvements for some semantic concepts are promising.

Original languageEnglish
Title of host publicationProceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011
Pages53-60
Number of pages8
DOIs
StatePublished - Dec 1 2011
Event13th IEEE International Symposium on Multimedia, ISM 2011 - Dana Point, CA, United States
Duration: Dec 5 2011Dec 7 2011

Other

Other13th IEEE International Symposium on Multimedia, ISM 2011
CountryUnited States
CityDana Point, CA
Period12/5/1112/7/11

Fingerprint

Information retrieval
Semantics

Keywords

  • Co-occurrence Relationship
  • Multiple Correspondence Analysis (MCA)
  • Re-ranking
  • Semantic Information Retrieval

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Cite this

Chen, C., Lin, L., & Shyu, M-L. (2011). Utilization of co-occurrence relationships between semantic concepts in re-ranking for information retrieval. In Proceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011 (pp. 53-60). [6123325] https://doi.org/10.1109/ISM.2011.18

Utilization of co-occurrence relationships between semantic concepts in re-ranking for information retrieval. / Chen, Chao; Lin, Lin; Shyu, Mei-Ling.

Proceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011. 2011. p. 53-60 6123325.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chen, C, Lin, L & Shyu, M-L 2011, Utilization of co-occurrence relationships between semantic concepts in re-ranking for information retrieval. in Proceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011., 6123325, pp. 53-60, 13th IEEE International Symposium on Multimedia, ISM 2011, Dana Point, CA, United States, 12/5/11. https://doi.org/10.1109/ISM.2011.18
Chen C, Lin L, Shyu M-L. Utilization of co-occurrence relationships between semantic concepts in re-ranking for information retrieval. In Proceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011. 2011. p. 53-60. 6123325 https://doi.org/10.1109/ISM.2011.18
Chen, Chao ; Lin, Lin ; Shyu, Mei-Ling. / Utilization of co-occurrence relationships between semantic concepts in re-ranking for information retrieval. Proceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011. 2011. pp. 53-60
@inproceedings{ff060072bba841d4890b64bb2b12f85b,
title = "Utilization of co-occurrence relationships between semantic concepts in re-ranking for information retrieval",
abstract = "Semantic information retrieval is a popular research topic in the multimedia area. The goal of the retrieval is to provide the end users with as relevant results as possible. Many research efforts have been done to build ranking models for different semantic concepts (or classes). While some of them have been proven to be effective, others are still far from satisfactory. Our observation that certain target semantic concepts have high co-occurrence relationships with those easy-to-retrieve semantic concepts (or called reference semantics) has motivated us to utilize such co-occurrence relationships between semantic concepts in information retrieval and re-ranking. In this paper, we propose a novel semantic retrieval and re-ranking framework that takes advantage of the co-occurrence relationships between a target semantic concept and a reference semantic concept to re-rank the retrieved results. The proposed framework discretizes the training data into a set of feature-value pairs and employs Multiple Correspondence Analysis (MCA) to capture the correlation in terms of the impact weight between feature-value pairs and the positive-positive class in which the data instances belong to both the target semantic concept and the reference semantic concept. A combination of all these impact weights is utilized to re-rank the retrieved results for the target semantic concept. Comparative experiments are designed and evaluated on TRECVID 2005 and TRECVID 2010 video collections with public-available ranking scores. Experimental results on different retrieval scales demonstrate that our proposed framework can enhance the retrieval results for the target semantic concepts in terms of average precision, and the improvements for some semantic concepts are promising.",
keywords = "Co-occurrence Relationship, Multiple Correspondence Analysis (MCA), Re-ranking, Semantic Information Retrieval",
author = "Chao Chen and Lin Lin and Mei-Ling Shyu",
year = "2011",
month = "12",
day = "1",
doi = "10.1109/ISM.2011.18",
language = "English",
isbn = "9780769545899",
pages = "53--60",
booktitle = "Proceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011",

}

TY - GEN

T1 - Utilization of co-occurrence relationships between semantic concepts in re-ranking for information retrieval

AU - Chen, Chao

AU - Lin, Lin

AU - Shyu, Mei-Ling

PY - 2011/12/1

Y1 - 2011/12/1

N2 - Semantic information retrieval is a popular research topic in the multimedia area. The goal of the retrieval is to provide the end users with as relevant results as possible. Many research efforts have been done to build ranking models for different semantic concepts (or classes). While some of them have been proven to be effective, others are still far from satisfactory. Our observation that certain target semantic concepts have high co-occurrence relationships with those easy-to-retrieve semantic concepts (or called reference semantics) has motivated us to utilize such co-occurrence relationships between semantic concepts in information retrieval and re-ranking. In this paper, we propose a novel semantic retrieval and re-ranking framework that takes advantage of the co-occurrence relationships between a target semantic concept and a reference semantic concept to re-rank the retrieved results. The proposed framework discretizes the training data into a set of feature-value pairs and employs Multiple Correspondence Analysis (MCA) to capture the correlation in terms of the impact weight between feature-value pairs and the positive-positive class in which the data instances belong to both the target semantic concept and the reference semantic concept. A combination of all these impact weights is utilized to re-rank the retrieved results for the target semantic concept. Comparative experiments are designed and evaluated on TRECVID 2005 and TRECVID 2010 video collections with public-available ranking scores. Experimental results on different retrieval scales demonstrate that our proposed framework can enhance the retrieval results for the target semantic concepts in terms of average precision, and the improvements for some semantic concepts are promising.

AB - Semantic information retrieval is a popular research topic in the multimedia area. The goal of the retrieval is to provide the end users with as relevant results as possible. Many research efforts have been done to build ranking models for different semantic concepts (or classes). While some of them have been proven to be effective, others are still far from satisfactory. Our observation that certain target semantic concepts have high co-occurrence relationships with those easy-to-retrieve semantic concepts (or called reference semantics) has motivated us to utilize such co-occurrence relationships between semantic concepts in information retrieval and re-ranking. In this paper, we propose a novel semantic retrieval and re-ranking framework that takes advantage of the co-occurrence relationships between a target semantic concept and a reference semantic concept to re-rank the retrieved results. The proposed framework discretizes the training data into a set of feature-value pairs and employs Multiple Correspondence Analysis (MCA) to capture the correlation in terms of the impact weight between feature-value pairs and the positive-positive class in which the data instances belong to both the target semantic concept and the reference semantic concept. A combination of all these impact weights is utilized to re-rank the retrieved results for the target semantic concept. Comparative experiments are designed and evaluated on TRECVID 2005 and TRECVID 2010 video collections with public-available ranking scores. Experimental results on different retrieval scales demonstrate that our proposed framework can enhance the retrieval results for the target semantic concepts in terms of average precision, and the improvements for some semantic concepts are promising.

KW - Co-occurrence Relationship

KW - Multiple Correspondence Analysis (MCA)

KW - Re-ranking

KW - Semantic Information Retrieval

UR - http://www.scopus.com/inward/record.url?scp=84863076578&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863076578&partnerID=8YFLogxK

U2 - 10.1109/ISM.2011.18

DO - 10.1109/ISM.2011.18

M3 - Conference contribution

AN - SCOPUS:84863076578

SN - 9780769545899

SP - 53

EP - 60

BT - Proceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011

ER -