基于RetinaNet的几何题目可读解答方法

READABLE SOLVING METHOD FOR GEOMETRY PROBLEMS BASED ON RETINANET

  • 摘要: 针对几何图形识别不精确和图文数据融合困难的问题,构建基于RetinaNet的几何题目可读解答方法。使用DenseNet-121改进RetinaNet的框架结构并引入辅助任务提升几何图形特征的提取精度。使用Inter-GPS提取几何图形的关系集并使用形式语言进行描述,实现几何图形的识别和可读表达。使用图卷积神经网络、ResNet101和门循环单元对关系集中的节点、几何图形、题目文本分别进行编码,并通过等式生成器生成可读的求解等式,实现几何题目的可读解答。该方法在数据集Geometry3K和GeoQA上进行测试,几何图形识别的平均精度达到了83.83%,几何题目可读解答的平均准确率达到了59.6%,验证了该方法的可行性和有效性。

     

    Abstract: This paper proposes a readable solving method for geometry problems, in order to solve the problem of inaccurate recognition of geometry diagrams and the difficulty of text and diagram fusion. The framework of RetinaNet was improved by using DenseNet-121, and auxiliary tasks were introduced to improve the accuracy of geometry feature extraction. The geometry relations in diagram were extracted by using Inter-GPS and described by formal language, so that the recognition and readable expression of geometry diagrams could be achieved. Thenodes, diagram and text in the geometry relation set were encoded by using graph convolutional neural network(GCN), ResNet101 and gate recurrent unit(GRU) respectively. The readable solving equations were generated through an equation generator. The experiment was conducted on dataset Geometry3K and GeoQA, and the average accuracy of diagram recognition reached 83.83% and the average accuracy of readable solutions reached 59.6%, which verified the feasibility and effectiveness of the proposed method.

     

/

返回文章
返回