Designing Neural Network Ensembles by Minimizing Mutual Information

View Sample PDF

Author(s): Yong Liu (The University of Aizu, Japan), Xin Yao (The University of Birmingham, UK)and Tetsuya Higuchi (National Institute of Advanced Industrial Science and Technology, Japan)
Copyright: 2003
Pages: 21
Source title: Computational Intelligence in Control
Source Author(s)/Editor(s): Masoud Mohammadian (University of Canberra, Australia), Rahul A. Sarker (University of New South Wales, Australia)and Xin Yao (The University of Birmingham, UK)
DOI: 10.4018/978-1-59140-037-0.ch001

Keywords: Artificial Intelligence / Computational Intelligence / Computer Science & IT / Information Science Reference

Purchase

View Designing Neural Network Ensembles by Minimizing Mutual Information on the publisher's website for pricing and purchasing information.

Abstract

This chapter describes negative correlation learning for designing neural network ensembles. Negative correlation learning has been firstly analysed in terms of minimising mutual information on a regression task. By minimising the mutual information between variables extracted by two neural networks, they are forced to convey different information about some features of their input. Based on the decision boundaries and correct response sets, negative correlation learning has been further studied on two pattern classification problems. The purpose of examining the decision boundaries and the correct response sets is not only to illustrate the learning behavior of negative correlation learning, but also to cast light on how to design more effective neural network ensembles. The experimental results showed the decision boundary of the trained neural network ensemble by negative correlation learning is almost as good as the optimum decision boundary.

The IRMA Community

Research IRM

Designing Neural Network Ensembles by Minimizing Mutual Information

Purchase

Abstract

Related Content

IRMA Sponsors