基于关键词语义特征增强的文本摘要模型

TEXT SUMMARIZATION MODEL BASED ON KEYWORD SEMANTIC FEATURE ENHANCEMENT

  • 摘要: 为了更好地解决现有文本摘要模型常常存在语义信息不准确、未登录生成词等问题,提出一种基于关键词语义特征增强的文本摘要模型。采用keybert关键词提取器,并引入多头自注意力机制增强对关键词语义特征的提取,使模型具有更好的上下文信息融合能力和关键信息的表达能力。为了解决文本摘要中常见的未登录生成词问题和暴露偏差问题,基于指针生成网络,并引入基于强化学习的混合训练策略,从创建的词表和原文中,高效地抽取词汇组成所生成的摘要。实验结果和摘要生成示例表明,与现有算法相比,在NLPCC2017数据集上,所提模型能有效提升摘要生成的准确率和可读性。

     

    Abstract: In order to better solve the problems of inaccurate semantic information and out of vocabulary problems in existing text summarization models, a text summarization model based on keyword semantic feature enhancement is proposed. Keybert keyword extractor was used, and multi-head self-attention mechanism was added to enhance the extraction of keyword semantic information, so that the model had better context information fusion ability and key information expression ability. In order to solve the common problems of out of vocabulary words and exposure bias in text summarization, based on pointer generation network, we used a hybrid training strategy based on reinforcement learning, efficiently extracting the generated abstracts from the created vocabulary and the original text. Compared with existing comparison algorithms, experimental results and examples show that the proposed model can effectively improve the accuracy and readability of summary generation on NLPCC2017 dataset.

     

/

返回文章
返回