Zhang, Shuai, McClean, Sally and Scotney, Bryan (2007) Knowledge Discovery from Semantically Heterogeneous Aggregate Databases Using Model-Based Clustering. In: Data Management. Data, Data Everywhere. Springer LNCS, pp. 190-202. ISBN 978-3-540-73389-8 [Book section]
Full text not available from this repository.
When distributed databases are developed independently, they may be semantically heterogeneous with respect to data granularity, scheme information and the embedded semantics. However, most traditional distributed knowledge discovery (DKD) methods assume that the distributed databases derive from a single virtual global table, where they share the same semantics and data structures. This data heterogeneity and the underlying semantics bring a considerable challenge for DKD. In this paper, we propose a model-based clustering method for aggregate databases, where the heterogeneous schema structure is due to the heterogeneous classification schema. The underlying semantics can be captured by different clusters. The clustering is carried out via a mixture model, where each component of the mixture corresponds to a different virtual global table. An advantage of our approach is that the algorithm resolves the heterogeneity as part of the clustering process without previously having to homogenise the heterogeneous local schema to a shared schema. Evaluation of the algorithm is carried out using both real and synthetic data. Scalability of the algorithm is tested against the number of databases to be clustered; the number of clusters; and the size of the databases. The relationship between performance and complexity is also evaluated. Our experiments show that this approach has good potential for scalable integration of semantically heterogeneous databases.
|Item Type:||Book section|
|Faculties and Schools:||Faculty of Computing & Engineering|
Faculty of Computing & Engineering > School of Computing and Information Engineering
|Research Institutes and Groups:||Computer Science Research Institute|
Computer Science Research Institute > Information and Communication Engineering
|Deposited By:||Professor Sally McClean|
|Deposited On:||05 Aug 2010 11:10|
|Last Modified:||15 Jun 2011 10:08|
Repository Staff Only: item control page