Sequential Leaning and Model Selection with Sleep
This paper proposes a quick sequential learning system with model selection, which memorizes each instance completely when the system encounters it. Although the Nearest Neighbor methods achieves the quick sequential learning, the system needs a large amount of resource to memorize all instances. On the other hand, the model based learning methods with model selection need a long time-interval for the optimization of parameters. The aim of this study is to solve this dilemma.The system has two phases, daytime learning phase and nighttime learning phase. During the daytime learning phase, the system recognizes known input patterns and memorizes unknown patterns quickly. During the nighttime learning phase, the system constructs a compact model of the set of memorized patterns using a model selection algorithm. Probably, the nighttime learning phase corresponds to the sleep in biological systems.However, there are cases that the system cannot get enough time interval for the nighttime learning phase. In such the cases, the system cannot complete the learning. This paper also shows the technique to solve the problem caused by the restricted nighttime learning time.
Koichiro Yamauchi
Hokkaido University, Graduate School of Engineering, Group of Systems and Information Engineering,Complex System Engineering Kita-ku, Kite 13 Jyou Nishi 8 Chyou Sapporo, 060-8628, Japan
国际会议
8th International Conference on Neural Information Processing(ICONIP 2001)(第八届国际神经信息处理大会)
上海
英文
243-248
2001-11-14（万方平台首次上网日期，不代表论文的发表时间）