深浅双路径卷积神经网络

CONVOLUTIONAL NEURAL NETWORK WITH DEEP AND SHALLOW PATHS

  • 摘要: 受限于嵌入式设备和移动设备的内存和计算能力,深度卷积神经网络(CNN)的部署因较大的参数量和较慢的推理速度受到阻碍,因此轻量化网络研究越来越受到关注。基于ResNet-50构建一个带浅层和深层的双路径架构(SDDP),可以通过调整两个路径的通道维度比例实现模型的压缩。此外,还提出一个特征分离模块,基于通道注意力将特征图分为两组,一组进入深路径,另一组进入浅路径,精确的分组可以让特征提取更加高效。该网络架构在lmageNet数据集上超越了当前最好的剪枝方法和轻量化设计模型。

     

    Abstract: Limited by the memory and computing power of the embedded devices and mobile devices,the deployment of deep convolutional neural networks(CNN)is hindered by the large amount of parameters and slow inference speed.Therefore,lightweight network research has attracted more and more attention.This paper constructs a dual-path architecture with shallow and deep layers based on ResNet-50.The compression of the model could be achieved by adjusting the channel dimension ratio of the two paths.In addition,a feature separation module was proposed,which divided the feature maps into two groups based on channel attention.One group entered the deep path,and the other group entered the shallow path.Precise grouping could make feature extraction more efficient.This architecture surpassed the current best pruning methods and lightweight design models on the ImageNet dataset.

     

/

返回文章
返回