A Self-learning Sensorimotor Model based on Operant Conditioning Theory

摘要：

　　This paper presents a self-learning model to help agents learn the sensorimotor skills.The model includes the sensory part,the motorial part,the sensorimotor map and the learning mechanism.At every learning step,the agent senses its states in its internal environment,executes motions based on the sensorimotor map,and at the same time gets a reward from the external environment as the result of its behavior.Then the sensorimotor map is tuned according to the learning mechanism which is designed based on the theory of Skinner operant conditioning.The convergence of learning mechanism is proved.To show the models ability of self-learning,the paper first simulated the famous Skinner pigeon experiment,and then used the model to a robot with the task of right handshake.Both of the results show that the model designed is intelligent and can help agents learn the sensorimotor skills.

关键词： self-learning sensorimotor model operant conditioning

作者: Xiaoping Zhang Xiaogang Ruan Yao Xiao Jing Huang Xiaoping Zhang

作者单位: College of Electronic Information and Control Engineering Beijing University of Technology Beijing, Department of Psychology Michigan State University East Lansing,MI 48824, USA

会议类型: 国际会议

会议名称: 2015 IEEE Advanced Information Technology, Electronic and Automation Control Conference(IAEAC 2015)(2015 IEEE先进信息技术,电子与自动化控制国际会议)

会议地点: 重庆

会议语种:英文

页码: 572-576

在线出版日期: 2015-12-19（万方平台首次上网日期，不代表论文的发表时间）