融合数据增广结构和端到端网络的3D人脸识别

3D FACE RECOGNITION WITH FUSION OF DATA AUGMENTATION STRUCTURE AND END-TO-END NETWORK

  • 摘要: 针对在3D人脸资源匮乏情况下,3D人脸识别性能低下的问题,提出一种融合数据增广结构和端到端网络的3D人脸识别方法。该方法由端到端学习网络(IMPNet)和3D人脸数据增广结构组成,采用Pointnet++作为骨干网络,并提出多尺度特征平均分插融合策略且重构网络的SA模块,从而使得推理速度提升了37.7%。并对统计形状模型(SSM)进行改进,首次提出基于优化统计形变模型(GSSM)的数据增广结构,使得网络无需大量的真实数据作为训练集,也可获得性能较好的网络。在公共数据集FRGCv2和Bosphorus上,该方法取得了98.9%和99.1%的准确率,优于目前主流方法。

     

    Abstract: Aimed at the problem of low 3D face recognition performance under the condition of lack of 3D face resources, a 3D face recognition method fused with data augmentation structure and end-to-end network is proposed. The method consists of two parts, the end-to-end learning network IMPNet and the 3D face data augmenting structure. It used Pointnet++ as the backbone network, and a multi-scale feature average add-drop fusion strategy and SA network module reconstruction was proposed, which increased the inference speed by 37.7%. By improving the SSM, the data augmentation structure based on the optimized deformation statistical model GSSM was proposed for the first time, so that the network with better performance could be obtained without a large number of real data as the training set. The accuracy of this method on public datasets FRGCv2 and Bosphorus is 98.9% and 99.1%, which is a great improvement compared with the current mainstream methods.

     

/

返回文章
返回