WEIGHT INITIALIZATION OF FEEDFORWARD NEURAL NETWORKS BY MEANS OF PARTIAL LEAST SQUARES
A method to set the weight initialization and the optimal number of hidden nodes of feedforward neural networks (FNN) based on the partial least squares (PLS) algorithm isdeveloped. The combination of PLS and FNN method ensures that the outputs of neurons are in the active region and increases the rate of convergence. The performance of the FNN, PLS, and PLS-FNN are compared according to an example of customer satisfaction measurement with unknown relationship between the input and output data. The results show that the hybrid PLS-FNN has the smallest root mean square error and the highest imitating precision. It substantially provides the good initial weights, improves the training performance and efficiently achieves an optimal solution.
Feedforward neural networks partial least squares PLS-FNN weight initialization
YAN LIU CHANG-FENG ZHOU YING-WU CHEN
College of Information System and Management, National University of Defense Technology, Changsha, 410073, China
国际会议
2006 International Conference on Machine Learning and Cybernetics(IEEE第五届机器学习与控制论坛)
大连
英文
3119-3122
2006-08-13（万方平台首次上网日期，不代表论文的发表时间）