Toward a Grid-Based Zero-Latency Data Warehousing Implementation for Continuous Data Streams Processing

View Sample PDF

Author(s): Tho Manh Nguyen (Vienna University of Technology, Austria), Peter Brezany (University of Vienna, Austria), A. Min Tjoa (Vienna University of Technology, Austria)and Edgar Weippl (Vienna University of Technology, Austria)
Copyright: 2008
Pages: 32
Source title: Data Warehousing and Mining: Concepts, Methodologies, Tools, and Applications
Source Author(s)/Editor(s): John Wang (Montclair State University, USA)
DOI: 10.4018/978-1-59904-951-9.ch048

Keywords: Data Mining and Databases / Data Warehousing / Information Science Reference / Library & Information Science

Purchase

View Toward a Grid-Based Zero-Latency Data Warehousing Implementation for Continuous Data Streams Processing on the publisher's website for pricing and purchasing information.

Abstract

Continuous data streams are information sources in which data arrives in high volume in unpredictable rapid bursts. Processing data streams is a challenging task due to (1) the problem of random access to fast and large data streams using present storage technologies and (2) the exact answers from data streams often being too expensive. A framework of building a Grid-based Zero-Latency Data Stream Warehouse (GZLDSWH) to overcome the resource limitation issues in data stream processing without using approximation approaches is specified. The GZLDSWH is built upon a set of Open Grid Service Infrastructure (OGSI)-based services and Globus Toolkit 3 (GT3) with the capability of capturing and storing continuous data streams, performing analytical processing, and reacting autonomously in near real time to some kinds of events based on a well-established knowledge base. The requirements of a GZLDSWH, its Grid-based conceptual architecture, and the operations of its service are described in this paper. Furthermore, several challenges and issues in building a GZLDSWH, such as the Dynamic Collaboration Model between the Grid services, the Analytical Model, and the Design and Evaluation aspects of the Knowledge Base Rules are discussed and investigated.

The IRMA Community

Research IRM

Toward a Grid-Based Zero-Latency Data Warehousing Implementation for Continuous Data Streams Processing

Purchase

Abstract

Related Content

IRMA Sponsors