Parameter Transfer Unit for Deep Neural Networks
Parameters in deep neural networks which are trained on large-scale databases can generalize across multiple domains,which is referred as “transferability.Unfortunately,the transferability is usually defined as discrete states and it differs with domains and network architectures.Existing works usually heuristically apply parameter-sharing or fine-tuning,and there is no principled approach to learn a parameter transfer strategy.To address the gap,a Parameter Transfer Unit(PTU)is proposed in this paper.PTU learns a fine-grained nonlinear combination of activations from both the source domain network and the target domain network,and subsumes hand-crafted discrete transfer states.In the PTU,the transferability is controlled by two gates which are artificial neurons and can be learned from data.The PTU is a general and flexible module which can be used in both CNNs and RNNs.It can be also integrated with other transfer learning methods in a plug-and-play manner.Experiments are conducted with various network architectures and multiple transfer domain pairs.Results demonstrate the effectiveness of the PTU as it outperforms heuristic parameter-sharing and fine-tuning in most settings.
Transfer learning Deep neural networks
Yinghua Zhang Yu Zhang Qiang Yang
Department of Computer Science and Engineering,Hong Kong University of Science and Technology,Kowloon,Hong Kong
国际会议
澳门
英文
82-95
2019-04-14（万方平台首次上网日期，不代表论文的发表时间）