Features of Higher Order Neural Network With Adaptive Neurons
One of the most popular machine learningalgorithms, ANN (Artiricial Neural Network) has beenextensively used for Data Mining, which extracts hidden patterns and valuable information from large databases. Data mining has extensive and significant applications in a large variety of areas. This paper introduces a new adaptive Higher Order Neural Network (HONN) model and applies itin data mining tasks such as determining liver disorders and predicting breast cancer recurrences. A new activation function which is a combination of sine and sigmoid functions is used as the neuron activation function for the new HONN model. There are free parameters in the new activation function. The paper compares the new HONN model against a Multi-Layer Perceptron (MLP) with the sigmoid activation function, an RBF Neural Network with the gaussian activation function, and a Recurrent Neural Network (RNN) with the sigmoid activation function.Experimental results show that the new HONN model offers several advantages over conventional ANN models such as improved generalisation capabilities as well as abilities in handling missing values in a dataset.
Keywords-higher order neural network data mining adaptive neural network neuron activation function.
Shuxiang Xu
School of Computing and IS, University of Tasmania Locked Bag 1359, Launceston, Tasmania 7250, Australia
国际会议
成都
英文
429-433
2010-06-23（万方平台首次上网日期，不代表论文的发表时间）