Robust Face Frontalization in Unconstrained Images

摘要：

　　The goal of face frontalization is to recover frontal facing views of faces appearing in single unconstrained images.The previous works mainly focus on how to achieve the frontal facing views effectively.However,they ignore the influences of the face images with occlusion.To overcome the problem,this paper presents a novel but simple scheme for robust face frontalization with only a single 3D model.We employ the same scheme with T.Hassners work to render the non-frontal facing view to the frontal facing view and estimate the invisible(self-occlusion)region.Subsequently,we compute the differences of the local patches around each fixed facial feature points between the average face(male average face or female average face)and test images for occlusion detection.Finally,we combine the proposed local face symmetry strategy and the Poisson image editing to fill the invisible region and occlusion region.Experimental results demonstrate advantages of the proposed method over the previous work.

关键词： Face frontalization 3D model Poisson image editing Occlusion

作者: Yuhan Zhang Jianjun Qian Jian Yang

作者单位: School of Computer Science and Engineering,Nanjing University of Science and Technology,Nanjing,China

会议类型: 国际会议

会议名称: 第七届全国模式识别学术会议(The 7th Chinese Conference on Pattern Recognition,CCPR2016)

会议地点: 成都

会议语种:英文

页码: 225-233

在线出版日期: 2016-11-03（万方平台首次上网日期，不代表论文的发表时间）