Preliminary experiments with ensembles of neurally diverse artificial neural networks for pattern recognition

Abdullahi Adamu, Tomas Maul, Andrzej Bargiela, Christopher Roadknight

Research output: Journal PublicationArticlepeer-review


Although there have been a few approaches to achieve the goal of fault tolerance by diversifying redundancy of the individual networks that make up a neural network ensemble, some of which include ensembles of neural networks of different sizes, and ensembles of different models of neural networks such as Radial Basis Function Networks and Multilayer Perceptron, there is yet to be an empirical study on hybrid neural networks that makes use of a diverse set of transfer functions, which we would expect to be able to exhibit diverse network architectures, and thus possibly more diverse error patterns. In this paper, we present an approach that uses transfer function diversity to achieve significant results on ensembles. The results show that even with relatively small networks having 5 hidden nodes, and a relatively small ensemble size of just 10 members, the ensemble is able to get competitive results on the Iris data set. It also capable of obtaining competitive results with 20 ensemble members of relatively small networks on other popular data sets such as the Diabetes, Sonar, Hepatitis, and Australian Credit Card problems. In addition to that, it is shown that these results can be achieved with a simple sorting and selection of the Top N solutions of the population, in contrast to other methods of selecting ensemble members that can be computationally expensive, such as selection of the Pareto-front, or hill climbing methods of selection.

Original languageEnglish
Pages (from-to)85-96
Number of pages12
JournalAdvances in Intelligent Systems and Computing
Publication statusPublished - 2015
Externally publishedYes


  • Artificial neural networks
  • Hybrid neural networks
  • Pattern recognition
  • Transfer function optimization

ASJC Scopus subject areas

  • Control and Systems Engineering
  • General Computer Science


Dive into the research topics of 'Preliminary experiments with ensembles of neurally diverse artificial neural networks for pattern recognition'. Together they form a unique fingerprint.

Cite this