IRMA-International.org: Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Discovering Surprising Instances of Simpson's Paradox in Hierarchical Multidimensional Data

Discovering Surprising Instances of Simpson's Paradox in Hierarchical Multidimensional Data
View Sample PDF
Author(s): Carem C. Fabris (CPGEI, CEFET-PR, Brazil)and Alex A. Freitas (University of Kent, UK)
Copyright: 2008
Pages: 17
Source title: Data Warehousing and Mining: Concepts, Methodologies, Tools, and Applications
Source Author(s)/Editor(s): John Wang (Montclair State University, USA)
DOI: 10.4018/978-1-59904-951-9.ch205

Purchase

View Discovering Surprising Instances of Simpson's Paradox in Hierarchical Multidimensional Data on the publisher's website for pricing and purchasing information.

Abstract

This paper focuses on the discovery of surprising unexpected patterns based on a data mining method that consists of detecting instances of Simpson’s paradox. By its very nature, instances of this paradox tend to be surprising to the user. Previous work in the literature has proposed an algorithm for discovering instances of that paradox, but it addressed only flat data stored in a single relation. This work proposes a novel algorithm that considerably extends that previous work by discovering instances of Simpson’s paradox in hierarchical multidimensional data — the kind of data typically found in data warehouse and OLAP environments. Hence, the proposed algorithm can be regarded as integrating the areas of data mining and data warehousing by using an adapted data mining technique to discover surprising patterns from data warehouse and OLAP environments.

Related Content

Nuno Silva, Pedro Sousa, Miguel Mira da Silva. © 2019. 19 pages.
Ioannis Routis, Mara Nikolaidou, Nancy Alexopoulou. © 2019. 21 pages.
Jeffrey S. Zanzig, Guillermo A. Francia III, Xavier P. Francia. © 2019. 26 pages.
S. B. Goyal. © 2019. 30 pages.
Maria João Ferreira, Fernando Moreira, Isabel Seruca. © 2019. 24 pages.
Agostino Poggi, Paolo Fornacciari, Gianfranco Lombardo, Monica Mordonini, Michele Tomaiuolo. © 2019. 21 pages.
Rüdiger Pryss, Manfred Reichert. © 2019. 26 pages.
Body Bottom