IRMA-International.org: Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Node Partitioned Data Warehouses: Experimental Evidence and Improvements

Node Partitioned Data Warehouses: Experimental Evidence and Improvements
View Sample PDF
Author(s): Pedro Furtado (University of Coimbra, Portugal)
Copyright: 2008
Pages: 20
Source title: Data Warehousing and Mining: Concepts, Methodologies, Tools, and Applications
Source Author(s)/Editor(s): John Wang (Montclair State University, USA)
DOI: 10.4018/978-1-59904-951-9.ch046

Purchase

View Node Partitioned Data Warehouses: Experimental Evidence and Improvements on the publisher's website for pricing and purchasing information.

Abstract

Data Warehouses (DWs) with large quantities of data present major performance and scalability challenges, and parallelism can be used for major performance improvement in such context. However, instead of costly specialized parallel hardware and interconnections, we focus on low-cost standard computing nodes, possibly in a non-dedicated local network. In this environment, special care must be taken with partitioning and processing. We use experimental evidence to analyze the shortcomings of a basic horizontal partitioning strategy designed for that environment, then propose and test improvements to allow efficient placement for the low-cost Node Partitioned Data Warehouse. We show experimentally that extra overheads related to processing large replicated relations and repartitioning requirements between nodes can significantly degrade speedup performance for many query patterns. We analyze a simple, easy-to-apply partitioning and placement decision that achieves good performance improvement results. Our experiments and discussion provide important insight into partitioning and processing issues for data warehouses in shared-nothing environments.

Related Content

Nuno Silva, Pedro Sousa, Miguel Mira da Silva. © 2019. 19 pages.
Ioannis Routis, Mara Nikolaidou, Nancy Alexopoulou. © 2019. 21 pages.
Jeffrey S. Zanzig, Guillermo A. Francia III, Xavier P. Francia. © 2019. 26 pages.
S. B. Goyal. © 2019. 30 pages.
Maria João Ferreira, Fernando Moreira, Isabel Seruca. © 2019. 24 pages.
Agostino Poggi, Paolo Fornacciari, Gianfranco Lombardo, Monica Mordonini, Michele Tomaiuolo. © 2019. 21 pages.
Rüdiger Pryss, Manfred Reichert. © 2019. 26 pages.
Body Bottom