基于改进轻量级沙漏模型的2D单人姿态估计研究与应用

RESEARCH AND APPLICATION OF 2D SINGLE-PERSON POSE ESTIMATION BASED ON IMPROVED LIGHTWEIGHT HOURGLASS MODEL

  • 摘要: 提出一种基于改进轻量级沙漏模型的2D单人人体姿态估计方法。使用逆残差卷积来构建改进的轻量级沙漏模型,从而降低参数数量与计算量,使用多尺度特征融合以提高轻量级模型在遮挡情况下的关键点检测能力。引入知识蒸馏方法,使得改进的模型在略微降低检测准确度时,能大幅降低训练和部署所需要的计算资源。MPII数据集和实际应用中的检测结果表明,改进的轻量级沙漏模型能有效检测人体骨骼关键点,实时性好、鲁棒性强,能在一定程度上克服遮挡问题。

     

    Abstract: A 2D single-person pose estimation method based on improved lightweight hourglass model is proposed. The inverse residual convolution was used to construct an improved lightweight hourglass model, which effectively reduced the number of parameters and the amount of calculation. Multi-scale feature fusion was used to improve the key point detection ability of the lightweight model under occlusion. The introduction of the knowledge distillation method enabled the improved model to significantly reduce the computing resources required for training and deployment when the detection accuracy was slightly reduced. The detection results of the MPII data set and practical application show that the improved lightweight hourglass model can effectively detect the key points of human bones, with good real-time performance and strong robustness, and can overcome the occlusion problem to a certain extent.

     

/

返回文章
返回