Enhancing the Numeracy of Word Embeddings:A Linear Algebraic Perspective

摘要：

　　To reason over the embeddings of numbers,they should cap-ture numeracy information.In this work,we consider the magnitude aspect of numeracy information.We could find a vector in a high dimen-sional space and a subspace of original space.After projecting the orig-inal embeddings of numbers onto that vector or subspace,the magni-tude information could be significantly enhanced.Therefore,this paper proposes a new angle to study numeracy of word embeddings,which is interpretable and has nice mathematical formulations.

关键词： Word embedding numeracy Subspace projection Interpretable models

作者: Yuanhang Ren Ye Du

作者单位: University of Electronic Science and Technology of China,Chengdu,China Southwestern University of Finance and Economics,Chengdu,China

会议类型: 国际会议

会议名称: 9th CCF International Conference on Natural Language Processing and Chinese Computing (NLPCC 2020)

会议地点: 郑州

会议语种:英文

页码: 170-178

在线出版日期: 2020-10-14（万方平台首次上网日期，不代表论文的发表时间）