The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Node Partitioned Data Warehouses: Experimental Evidence and Improvements
Abstract
Data Warehouses (DWs) with large quantities of data present major performance and scalability challenges, and parallelism can be used for major performance improvement in such context. However, instead of costly specialized parallel hardware and interconnections, we focus on low-cost standard computing nodes, possibly in a non-dedicated local network. In this environment, special care must be taken with partitioning and processing. We use experimental evidence to analyze the shortcomings of a basic horizontal partitioning strategy designed for that environment, then propose and test improvements to allow efficient placement for the low-cost Node Partitioned Data Warehouse. We show experimentally that extra overheads related to processing large replicated relations and repartitioning requirements between nodes can significantly degrade speedup performance for many query patterns. We analyze a simple, easy-to-apply partitioning and placement decision that achieves good performance improvement results. Our experiments and discussion provide important insight into partitioning and processing issues for data warehouses in shared-nothing environments.
Related Content
Nuno Silva, Pedro Sousa, Miguel Mira da Silva.
© 2019.
19 pages.
|
Ioannis Routis, Mara Nikolaidou, Nancy Alexopoulou.
© 2019.
21 pages.
|
Jeffrey S. Zanzig, Guillermo A. Francia III, Xavier P. Francia.
© 2019.
26 pages.
|
S. B. Goyal.
© 2019.
30 pages.
|
Maria João Ferreira, Fernando Moreira, Isabel Seruca.
© 2019.
24 pages.
|
Agostino Poggi, Paolo Fornacciari, Gianfranco Lombardo, Monica Mordonini, Michele Tomaiuolo.
© 2019.
21 pages.
|
Rüdiger Pryss, Manfred Reichert.
© 2019.
26 pages.
|
|
|