The Conjugate Gradient Method with Neural Network Control

摘要：

To address the unconstrained optimization problem, the Conjugate Gradient Method (CG) uses the sequence of iterations to approach the minimum point of aim function. Because of the effect of rounding errors, many merits of CG are no longer in existence in practical use. Hence the rate of convergence is not ideal and a practical problem confronting us is how to improve conjugate gradient iteration so as to accelerate the convergence. Common improvements include better descent directions and restart strategies on the precondition of conjugate gradients. From the angle of the search step length, another major factor that influences the rate of convergence, the author proposes the use of the neural network model to introduce ‘priori knowledge’ in CG so that it may predict the next search step length. Large quantities of experimental data prove that this method can effectively improve the rate of convergence.

作者: Ningsheng Gong Wei Shao Hongwei Xu

作者单位: School of Electronics and Information Engineering Nanjing University of Technology

会议类型: 国际会议

会议名称: The 2010 International Conference on Intelligent Systems and Knowledge Engineering(第五届智能系统与知识工程国际会议)

会议地点: 杭州

会议语种:英文

页码: 82-84

在线出版日期: 2010-11-15（万方平台首次上网日期，不代表论文的发表时间）