The Infomin Principle: A Unifying Information-based Criterion for Forming Topographic Mappings
In this paper, we propose a new principle InfoMin and a new criterion based on it for forming topographic mappings. The InfoMin principle asserts that a topographic mapping is formed by minimizing the average of information transferred through small areas of the mapping. This criterion can explain clearer why more highly correlated neurons are placed nearer. In addition, we characterize the criterion as a special case of the unifying objective function (the C measure) proposed by Goodhill and Sejnowski 3, and compare it with some topographic mapping methods based on the dimension reduction. We show that our criterion is defined just by the values of neurons and usable without any knowledge on the structure in the input space. Numerical experiments on natural scenes show that the optimization of the criterion could simulate the dimension reduction methods.
Yoshitatsu Matsuda Kazunori Yamaguchi
Laboratory Department of Graphic and Computer Science College of Arts and Sciences The University of Tokyo 3-8-1, Komaba, Meguro-ku, Tokyo, 153-8902, Japan
国际会议
8th International Conference on Neural Information Processing(ICONIP 2001)(第八届国际神经信息处理大会)
上海
英文
52-57
2001-11-14（万方平台首次上网日期，不代表论文的发表时间）