基于时空注意图卷积的人体动作识别

ACTION RECOGNITION BASED ON SPATIAL-TEMPORAL ATTENTION GRAPH CONVOLUTION NEURAL NETWORK

  • 摘要: 针对基于骨骼数据的人体动作识别中关键节点及特征应用度不高的问题,构建一种基于时空图卷积和通道-空间联合注意力模块融合改进的人体动作识别系统。算法首先通过空间图卷积获得结构化特征,由通道-空间联合注意力模块强化关键节点和关键结构信息,再由时间图卷积获取高级时空特征,最后用全局池化层和softmax分类器得出识别结果。实验结果表明,在关键节点和结构特征得以强化的同时,也保留了原始特征信息。该算法在基于骨骼数据的人体动作识别上具有更高的精度。

     

    Abstract: In view of the low application of key joints and features in human action recognition based on skeleton data, an improved action recognition system based on the fusion of spatial-temporal graph convolution neural network and channel-spatial union attention block is proposed. The structural features were obtained by spatial graph convolution, and the key joints and key structure information were enhanced by channel-spatial union attention module. The advanced spatial-temporal features were obtained by time graph convolution. The recognition results were obtained by global pooling layer and Softmax classifier. The experimental results show that while the key joints and structural features are enhanced, the original feature information is retained. This algorithm has higher accuracy in skeleton-based action recognition.

     

/

返回文章
返回