ON COMBINING DISTRIBUTED SVMS BY SIMPLE BAYESIAN FORMALISM RULES

摘要：

Support vector machines (SVMs) has been accepted as a fashionable method in machine learning community.However, it cannot be easily scaled to handle large scale problems for its time and space complexity that is around quadratic with respect to the number of training samples.This paper proposes to combine distributed SVMs by simple Bayesian formalism rules (B-SVMs).B-SVMs randomly decomposes a large-scale task into many smaller and simpler sub-tasks in training phase and uses simple Bayesian formalism rules to make decision for final classification in test phase.B-SVMs was compared with single SVMs that is trained on entire training data set, parallel SVMs combined by majority voting (MV-SVMs), and one kind of fast modular SVMs (FM-SVMs).Experimental results on four problems show that B-SVMs can get higher accuracy than MV-SVMs and FM-SVMs does, the proposed algorithm can significantly reduce training and test time.More importantly, it produces test accuracy that is almost the same as single SVMs does.

作者: XIAO-MING JIN YI-MIN WEN

作者单位: Business school of Central South University, 25 Lu Shan Rd., Changsha 410083, China;Hunan Industry P Hunan Industry Polytechnic, Changsha 410208, China

会议类型: 国际会议

会议名称: 2007 International Conference on Machine Learning and Cybernetics(IEEE第六届机器学习与控制论国际会议)

会议地点: 香港

会议语种:英文

页码: 3630-3635

在线出版日期: 2007-08-19（万方平台首次上网日期，不代表论文的发表时间）