A Novel Approach to Optimize the Objective Function Based on VC Dimension and Structural Risk Minimization
So far,lots of algorithms and learning methods are taking the empirical risk for the optimization goal. In this paper,we propose a new way to optimize the objective function based on VC dimension and structural risk minimization. The optimized function F is firstly defined by us,and some effective design forms of it will also be given. Then we fulfill a useful criterion—the balance minimum optimization principle. This principle considers not only the empirical risk,but also considers the VC dimension of learning machine. Balancing the two factors can avoid the underfitting problem and overfitting problem. Experimental results show that the method we proposed is effective to improve the property of algorithm efficiency,convergence and generalization of the learning machine. Also,the proposed principle for optimization is a new criterion,which is not a practical method for a particular problem of improvement. Therefore,this method is suitable to be applied in many practical situations,which may bring a good generalization performance and efficiency in some learning problems.
QIU Xintao FU Dongmei YANG Tao
School of Automation,University of Science and Technology Beijing,Beijing 100083,P.R.China
国际会议
The 30th Chinese Control Conference(第三十届中国控制会议)
烟台
英文
1-5
2011-07-01（万方平台首次上网日期，不代表论文的发表时间）