基于BERT-RCNN模型的开源情报文本分类研究

RESEARCH ON TEXT CLASSIFICATION OF OPEN SOURCE INTELLIGENCE BASED ON BERT-RCNN MODEL

  • 摘要: 针对互联网开源情报文本内容较长、语法结构复杂以及传统语言模型静态词向量无法表示多义词问题,提出一种基于BERT和RCNN相融合的开源情报文本分类算法。将BERT作为嵌入层与RCNN模型相连接,通过循环卷积层捕获上下文向量信息来学习输入文本全局语义关系,经过池化层进行最大特征提取,最后利用Softmax分类器对提取特征进行分类。实验结果表明,BERT-RCNN融合模型在测试集上的分类准确率均高于其他主流模型,验证了该算法对提升开源情报文本分类效果的有效性。

     

    Abstract: Aiming at the problems of long content, complex syntax structure, and the inability of traditional language models to express polysemous words using static word vectors, this paper proposes an open source intelligence text classification algorithm based on the fusion of BERT and RCNN. BERT was connected to the RCNN model as an embedded layer. The context vector information was captured through a recurrent convolution layer to learn the global semantic relationship of the input text. The maximum feature extraction was performed through the pooling layer. The Softmax classifier was used to classify the extracted features. The experimental results show that the classification accuracy of BERT-RCNN fusion model on the test set is higher than that of other mainstream models, which verifies the effectiveness of this algorithm in improving the classification effect of open source intelligence texts.

     

/

返回文章
返回