Multi-attention Guided Activation Propagation in CNNs
CNNs compute the activations of feature maps and propagate them through the networks. Activations carry various information with different impacts on the prediction, thus should be handled with different degrees. However, existing CNNs usually process them identically. Visual attention mechanism focuses on the selection of regions of interest and the control of information flow through the network. Therefore, we propose a multi-attention guided activation propagation approach (MAAP), which can be applied into existing CNNs to promote their performance. Attention maps are first computed based on the activations of feature maps, vary as the propagation goes deeper and focus on different regions of interest in the feature maps. Then multi-level attention is utilized to guide the activation propagation, giving CNNs the ability to adaptively highlight pivotal information and weaken uncorrelated information. Experimental results on fine-grained image classification benchmark demonstrate that the applications of MAAP achieve better performance than state-of-the-art CNNs.
Multiple attention Activation propagation Convolutional Neural Networks
Xiangteng He Yuxin Peng
Institute of Computer Science and Technology,Peking University,Beijing,China
国际会议
广州
英文
16-27
2018-11-23（万方平台首次上网日期，不代表论文的发表时间）