Research and Application of a New Selective Neural Network Ensemble Method based on Error Vectorization
Selective neural network ensemble is an effective way to enhance the generalization accuracy of networks, which is much better than the ensemble of all available networks. However, there are still some problems in the selective ensemble, which are lack of unified definition of diversity among component neural networks (NNs) and hard to improve the accuracy by selecting if the diversities of available NNs are small. Aiming at the above problems, the output errors of NNs are firstly vectorized, the diversity of NNs is defined based on the error vectors and the size of ensemble is analyzed. And then an error vectorization based selective neural network ensemble (EVSNE) is proposed in the paper, in which the error vector of each network can offset that of the other networks by training the component NNs orderly. Thus, the component networks have large diversity. Experiments and comparisons over standard datasets and actual industrial dataset of high-density polyethylene (HDPE) demonstrate that EVSNE performs better in generalization ability with higher accuracy.
selective neural network ensemble diversity definition error vectorization
Zhu Qun-xiong Zhao Nai-wei Xu Yuan
College of Information Science & Technology, Beijing University of Chemical Technology, Beijing 1000
国内会议
厦门
英文
1-6
2012-08-01(万方平台首次上网日期,不代表论文的发表时间)