TY - JOUR
T1 - Stochastic clustering for organizing distributed information sources
AU - Shyu, Mei Ling
AU - Chen, Shu Ching
AU - Rubin, Stuart H.
N1 - Funding Information:
Manuscript received February 8, 2003; revised August 15, 2003 and March 6, 2004. The work of M.-L. Shyu was supported in part by NSF ITR (Medium) IIS-0325260. The work of S.-C. Chen was supported in part by NSF EIA-0220562 and NSF HRD-0317692. The preliminary version of the current draft was published in Proceedings of the ICS Software Engineering Databse Systems Workshop.
PY - 2004/10
Y1 - 2004/10
N2 - The number of information sources and the volumes of data in these information sources have greatly increased, which may be attributed to the ever-increasing complexity of real-world applications. The enormous amount of information available in the information sources in a distributed information-providing environment has created a need to provide users with tools to effectively and efficiently navigate and retrieve information. Queries in such an environment often access information from multiple information sources. This may be attributed to navigational characteristics. Clusters provide a structure for organizing the large number of information sources for efficient browsing, searching, and retrieval. This paper presents a stochastically-based clustering mechanism, called the Markov model mediator (MMM), to group the information sources into a set of useful clusters. Each information source cluster groups those information sources that show similarities in their data access behavior. Information sources within the same cluster are expected to be able to provide most of the required information among themselves for user queries that are closely related with respect to a particular, application. This can significantly improve system response time, query performance, and result in an overall improvement in decision support. Empirical studies on real databases are performed and the results demonstrate that our proposed mechanism leads to a better set of clusters in comparison with other clustering methods. This serves to illustrate the effectiveness of our proposed MMM mechanism.
AB - The number of information sources and the volumes of data in these information sources have greatly increased, which may be attributed to the ever-increasing complexity of real-world applications. The enormous amount of information available in the information sources in a distributed information-providing environment has created a need to provide users with tools to effectively and efficiently navigate and retrieve information. Queries in such an environment often access information from multiple information sources. This may be attributed to navigational characteristics. Clusters provide a structure for organizing the large number of information sources for efficient browsing, searching, and retrieval. This paper presents a stochastically-based clustering mechanism, called the Markov model mediator (MMM), to group the information sources into a set of useful clusters. Each information source cluster groups those information sources that show similarities in their data access behavior. Information sources within the same cluster are expected to be able to provide most of the required information among themselves for user queries that are closely related with respect to a particular, application. This can significantly improve system response time, query performance, and result in an overall improvement in decision support. Empirical studies on real databases are performed and the results demonstrate that our proposed mechanism leads to a better set of clusters in comparison with other clustering methods. This serves to illustrate the effectiveness of our proposed MMM mechanism.
UR - http://www.scopus.com/inward/record.url?scp=4844220829&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=4844220829&partnerID=8YFLogxK
U2 - 10.1109/TSMCB.2004.833599
DO - 10.1109/TSMCB.2004.833599
M3 - Article
C2 - 15503499
AN - SCOPUS:4844220829
VL - 34
SP - 2035
EP - 2047
JO - IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
JF - IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
SN - 1083-4419
IS - 5
ER -