Ulster University Logo

Ulster Institutional Repository

Knowledge Discovery from Semantically Heterogeneous Aggregate Databases Using Model-Based Clustering

Biomedical Sciences Research Institute Computer Science Research Institute Environmental Sciences Research Institute Nanotechnology & Advanced Materials Research Institute

Zhang, Shuai, McClean, Sally and Scotney, Bryan (2007) Knowledge Discovery from Semantically Heterogeneous Aggregate Databases Using Model-Based Clustering. In: Data Management. Data, Data Everywhere. Springer LNCS, pp. 190-202. ISBN 978-3-540-73389-8 [Book section]

Full text not available from this repository.

URL: http://dx.doi.org/10.1007/978-3-540-73390-4_22

DOI: doi:10.1007/978-3-540-73390-4_22

Abstract

When distributed databases are developed independently, they may be semantically heterogeneous with respect to data granularity, scheme information and the embedded semantics. However, most traditional distributed knowledge discovery (DKD) methods assume that the distributed databases derive from a single virtual global table, where they share the same semantics and data structures. This data heterogeneity and the underlying semantics bring a considerable challenge for DKD. In this paper, we propose a model-based clustering method for aggregate databases, where the heterogeneous schema structure is due to the heterogeneous classification schema. The underlying semantics can be captured by different clusters. The clustering is carried out via a mixture model, where each component of the mixture corresponds to a different virtual global table. An advantage of our approach is that the algorithm resolves the heterogeneity as part of the clustering process without previously having to homogenise the heterogeneous local schema to a shared schema. Evaluation of the algorithm is carried out using both real and synthetic data. Scalability of the algorithm is tested against the number of databases to be clustered; the number of clusters; and the size of the databases. The relationship between performance and complexity is also evaluated. Our experiments show that this approach has good potential for scalable integration of semantically heterogeneous databases.

Item Type:Book section
Faculties and Schools:Faculty of Computing & Engineering
Faculty of Computing & Engineering > School of Computing and Information Engineering
Research Institutes and Groups:Computer Science Research Institute
Computer Science Research Institute > Information and Communication Engineering
ID Code:14621
Deposited By:Professor Sally McClean
Deposited On:05 Aug 2010 12:10
Last Modified:15 Jun 2011 11:08

Repository Staff Only: item control page