基于片段排列和多头选择的实体识别与关系抽取联合模型

JOINT ENTITY RELATION EXTRACTION BASED ON FRAGMENT ARRANGEMENT AND MULTI-HEAD SELECTION

  • 摘要: 针对传统的信息抽取方法存在实体重叠、误差积累和依赖关系缺失等问题,该文提出一种基于片段排列和多头选择的实体识别与关系抽取联合模型。通过共享编码层来建立实体识别与关系抽取之间的依赖;通过片段排列的方式在 span 的层面解决实体重叠问题;使用多头选择机制来预测实体之间的关系,并加入对抗训练,通过辅助损失函数进行约束。通过消除实验和基于不同权重损失函数的实验,找到了效果最好的参数。该模型在中文数据集 DulE 2.0 上取得了 F1 值 0.829 的效果,相对于效果最好的基线模型提升 2.24%。

     

    Abstract: Aimed at the problems of entity overlap, error accumulation and lack of dependency in traditional information extraction methods, a joint model of entity recognition and relationship extraction based on fragment arrangement and multi-head selection is proposed. We established the dependence between entity recognition and relationship extraction by sharing the coding layer, and solved the problem of entity overlap at the level of span through fragment arrangement. The multi-head selection mechanism was used to predict the relationship between entities, and the confrontation training was added, which was constrained by the auxiliary loss function. Through ablation experiments and experiments based on different weight loss functions, the best parameters were found. The model was implemented in the Chinese dataset DulE 2.0, and the F1 value of 0.829 was achieved, which was increased by 2.24% compared with the baseline model with the best effect.

     

/

返回文章
返回