Capturing high-level image concepts via affinity relationships in image database retrieval

Mei-Ling Shyu, Shu Ching Chen, Min Chen, Chengcui Zhang, Kanoksri Sarinnapakorn

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

In this paper, we present a mechanism called Markov Model Mediator (MMM) to facilitate the efficient and effective capturing of high-level image concepts in content-based image retrieval (CBIR). MMM serves as the retrieval engine of the CBIR system and uses affinity-based similarity measures. This mechanism is effective in capturing subjective user concepts in that it not only takes into consideration the global image features, but also learns the high-level concepts of the images from the history of user access patterns and access frequencies on the images in the image database, which differentiates it from the common methods in CBIR. The advantage of our proposed mechanism is that it exploits the richness in the structured description of visual contents as well as the relative affinity relationships among the images. Consequently, it provides the capability to bridge the gap between the low-level features and the high-level concepts. This mechanism is also efficient in that it integrates Principal Component Analysis (PCA) to significantly reduce the image search space at a low cost before performing exact similarity matching. An off-line training subsystem for this framework was implemented and integrated into our system. The experimental results demonstrate that MMM can effectively capture user's high-level concept more quickly.

Original languageEnglish
Pages (from-to)73-92
Number of pages20
JournalMultimedia Tools and Applications
Volume32
Issue number1
DOIs
StatePublished - Jan 1 2007

Fingerprint

Image Database
Image retrieval
Affine transformation
Retrieval
Content-based Image Retrieval
Mediator
Markov Model
Principal component analysis
Image Space
Engines
Differentiate
Similarity Measure
Search Space
Principal Component Analysis
Subsystem
Engine
Integrate
Relationships
Concepts
Costs

Keywords

  • Content-Based Image Retrieval (CBIR)
  • Markov Model Mediator (MMM)
  • Principal Component Analysis (PCA)

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Information Systems
  • Computer Graphics and Computer-Aided Design
  • Software
  • Theoretical Computer Science
  • Computational Theory and Mathematics

Cite this

Capturing high-level image concepts via affinity relationships in image database retrieval. / Shyu, Mei-Ling; Chen, Shu Ching; Chen, Min; Zhang, Chengcui; Sarinnapakorn, Kanoksri.

In: Multimedia Tools and Applications, Vol. 32, No. 1, 01.01.2007, p. 73-92.

Research output: Contribution to journalArticle

Shyu, Mei-Ling ; Chen, Shu Ching ; Chen, Min ; Zhang, Chengcui ; Sarinnapakorn, Kanoksri. / Capturing high-level image concepts via affinity relationships in image database retrieval. In: Multimedia Tools and Applications. 2007 ; Vol. 32, No. 1. pp. 73-92.
@article{3e4ff5526d8d45cf90896f01ad762fd3,
title = "Capturing high-level image concepts via affinity relationships in image database retrieval",
abstract = "In this paper, we present a mechanism called Markov Model Mediator (MMM) to facilitate the efficient and effective capturing of high-level image concepts in content-based image retrieval (CBIR). MMM serves as the retrieval engine of the CBIR system and uses affinity-based similarity measures. This mechanism is effective in capturing subjective user concepts in that it not only takes into consideration the global image features, but also learns the high-level concepts of the images from the history of user access patterns and access frequencies on the images in the image database, which differentiates it from the common methods in CBIR. The advantage of our proposed mechanism is that it exploits the richness in the structured description of visual contents as well as the relative affinity relationships among the images. Consequently, it provides the capability to bridge the gap between the low-level features and the high-level concepts. This mechanism is also efficient in that it integrates Principal Component Analysis (PCA) to significantly reduce the image search space at a low cost before performing exact similarity matching. An off-line training subsystem for this framework was implemented and integrated into our system. The experimental results demonstrate that MMM can effectively capture user's high-level concept more quickly.",
keywords = "Content-Based Image Retrieval (CBIR), Markov Model Mediator (MMM), Principal Component Analysis (PCA)",
author = "Mei-Ling Shyu and Chen, {Shu Ching} and Min Chen and Chengcui Zhang and Kanoksri Sarinnapakorn",
year = "2007",
month = "1",
day = "1",
doi = "10.1007/s11042-006-0059-6",
language = "English",
volume = "32",
pages = "73--92",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",
number = "1",

}

TY - JOUR

T1 - Capturing high-level image concepts via affinity relationships in image database retrieval

AU - Shyu, Mei-Ling

AU - Chen, Shu Ching

AU - Chen, Min

AU - Zhang, Chengcui

AU - Sarinnapakorn, Kanoksri

PY - 2007/1/1

Y1 - 2007/1/1

N2 - In this paper, we present a mechanism called Markov Model Mediator (MMM) to facilitate the efficient and effective capturing of high-level image concepts in content-based image retrieval (CBIR). MMM serves as the retrieval engine of the CBIR system and uses affinity-based similarity measures. This mechanism is effective in capturing subjective user concepts in that it not only takes into consideration the global image features, but also learns the high-level concepts of the images from the history of user access patterns and access frequencies on the images in the image database, which differentiates it from the common methods in CBIR. The advantage of our proposed mechanism is that it exploits the richness in the structured description of visual contents as well as the relative affinity relationships among the images. Consequently, it provides the capability to bridge the gap between the low-level features and the high-level concepts. This mechanism is also efficient in that it integrates Principal Component Analysis (PCA) to significantly reduce the image search space at a low cost before performing exact similarity matching. An off-line training subsystem for this framework was implemented and integrated into our system. The experimental results demonstrate that MMM can effectively capture user's high-level concept more quickly.

AB - In this paper, we present a mechanism called Markov Model Mediator (MMM) to facilitate the efficient and effective capturing of high-level image concepts in content-based image retrieval (CBIR). MMM serves as the retrieval engine of the CBIR system and uses affinity-based similarity measures. This mechanism is effective in capturing subjective user concepts in that it not only takes into consideration the global image features, but also learns the high-level concepts of the images from the history of user access patterns and access frequencies on the images in the image database, which differentiates it from the common methods in CBIR. The advantage of our proposed mechanism is that it exploits the richness in the structured description of visual contents as well as the relative affinity relationships among the images. Consequently, it provides the capability to bridge the gap between the low-level features and the high-level concepts. This mechanism is also efficient in that it integrates Principal Component Analysis (PCA) to significantly reduce the image search space at a low cost before performing exact similarity matching. An off-line training subsystem for this framework was implemented and integrated into our system. The experimental results demonstrate that MMM can effectively capture user's high-level concept more quickly.

KW - Content-Based Image Retrieval (CBIR)

KW - Markov Model Mediator (MMM)

KW - Principal Component Analysis (PCA)

UR - http://www.scopus.com/inward/record.url?scp=33845772265&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33845772265&partnerID=8YFLogxK

U2 - 10.1007/s11042-006-0059-6

DO - 10.1007/s11042-006-0059-6

M3 - Article

AN - SCOPUS:33845772265

VL - 32

SP - 73

EP - 92

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

IS - 1

ER -