Image Fusion and Super-Resolution with Convolutional Neural Network

摘要：

　　Image fusion aims to integrate multiple images of the same scene into an artificial image which contains more useful information than any individual one.Due to the constraints of imaging sensors and signal transmission broadband,the resolution of most source images is limited.In traditional processing framework,super-resolution is conducted to improve the resolution of the source images before the fusion operations.However,those super-resolution methods do not make full use of the multi-resolution characteristics of images.In this paper,a novel jointed image fusion and super-resolution algorithm is proposed.Source images are decomposed into undecimated wavelet(UWT)coefficients,the resolution of which is enhanced with convolutional neural network.Then,the coefficients are further integrated with certain fusion rule.Finally,the fused image is constructed from the combined coefficients.The proposed method is tested on multi-focus images,medical images and visible light and near infrared ray images respectively.The experimental results demonstrate the superior performances of the proposed method.

关键词： Image fusion Super-resolution Convolutional neural network

作者: Jinying Zhong Bin Yang Yuehua Li Fei Zhong Zhongze Chen

作者单位: School of Electrical Engineering,University of South China,Hengyang,421001,China

会议类型: 国际会议

会议名称: 第七届全国模式识别学术会议(The 7th Chinese Conference on Pattern Recognition,CCPR2016)

会议地点: 成都

会议语种:英文

页码: 78-88

在线出版日期: 2016-11-03（万方平台首次上网日期，不代表论文的发表时间）