Topic-specific Image Caption Generation

摘要：

　　Recently,image caption which aims to generate a textual description for an image automatically has attracted researchers from various fields.Encouraging performance has been achieved by applying deep neural networks.Most of these works aim at generating a single caption which may be incomprehensive,especially for complex images.This paper proposes a topic-specific multi-caption generator,which in-fer topics from image first and then generate a variety of topic-specific captions,each of which depicts the image from a particular topic.We per-form experiments on flickr8k,flickr30k and MSCOCO.The results show that the proposed model performs better than single-caption generator when generating topic-specific captions.The proposed model effectively generates diversity of captions under reasonable topics and they differ from each other in topic level.

关键词： Image caption Topic model Encoder-decoder

作者: Chang Zhou Yuzhao Mao Xiao jie Wang

作者单位: School of Computer,Beijing University of Posts and Telecommunications,Beijing,China

会议类型: 国内会议

会议名称: 第十六届全国计算语言学学术会议暨第五届基于自然标注大数据的自然语言处理国际学术研讨会

会议地点: 南京

会议语种:英文

页码: 1-12

在线出版日期: 2017-10-13（万方平台首次上网日期，不代表论文的发表时间）