Ulster University Logo

Clustering semantically heterogeneous distributed aggregate databases

Zhang, Shuai, McClean, Sally and Scotney, Bryan (2014) Clustering semantically heterogeneous distributed aggregate databases. Knowledge and Information Systems, 38 (2). pp. 331-364. [Journal article]

[img] PDF - Published Version
Indefinitely restricted to Repository staff only.

965kB

URL: http://link.springer.com/article/10.1007%2Fs10115-012-0588-4

DOI: 10.1007/s10115-012-0588-4

Abstract

Databases developed independently in a common open distributed environment may be heterogeneous with respect to both data schema and the embedded semantics. Managing schema and semantic heterogeneities brings considerable challenges to learning from distributed data and to support applications involving cooperation between different organisations. In this paper, we are concerned mainly with heterogeneous databases that hold aggregates on a set of attributes, which are often the result of materialised views of native large-scale distributed databases. A model-based clustering algorithm is proposed to construct a mixture model where each component corresponds to a cluster which is used to capture the contextual heterogeneity among databases from different populations. Schema heterogeneity, which can be recast as incomplete information, is handled within the clustering process using Expectation-Maximisation estimation and integration is carried out within a clustering iteration. Our proposed algorithm resolves the schema heterogeneity as part of the clustering process, thus avoiding transformation of the data into a unified schema. Results of algorithm evaluation on classification, scalability and reliability, using both real and synthetic data, demonstrate that our algorithm can achieve good performance by incorporating all of the information from available heterogeneous data. Our clustering approach has great potential for scalable knowledge discovery from semantically heterogeneous databases and for applications in an open distributed environment, such as the Semantic Web.

Item Type:Journal article
Faculties and Schools:Faculty of Computing & Engineering
Faculty of Computing & Engineering > School of Computing and Information Engineering
Faculty of Computing & Engineering > School of Computing and Mathematics
Research Institutes and Groups:Computer Science Research Institute > Smart Environments
Computer Science Research Institute
Computer Science Research Institute > Information and Communication Engineering
ID Code:27002
Deposited By: Dr Shuai Zhang
Deposited On:16 Sep 2013 09:15
Last Modified:09 Dec 2015 11:15

Repository Staff Only: item control page