基于可变形多尺度卷积的三维点云目标检测方法

3D POINT CLOUD OBJECT DETECTION METHOD BASED ON DEFORMABLE MULTI-SCALE CONVOLUTION

  • 摘要: 针对行人等小目标识别困难问题,提出一种可变形多尺度卷积三维点云目标检测方法。通过多层卷积堆叠和卷积核设置来聚合对应尺度点云邻域信息,增强网络特征表达能力,解决了PointPillars未考虑点云邻域上下文信息的问题。对现有方法在特征提取时忽视行人易形变的特性,采用双分支策略,在浅层特征图中引入二维偏移量,使网络自适应学习权重,提高对形变目标的鲁棒性。使用特征金字塔结构提取多尺度特征,并拼接双分支特征得到表达更丰富的融合信息。在KITTI数据集上实验表明,与PointPillars算法相比,该方法在鸟瞰图模式下,中等和困难级别的行人检测精度分别提高了7.83百分点和7.38百分点;3D模式下,相应提升为9.91百分点和5.42百分点。

     

    Abstract: A deformable multi-scale convolutional 3D point cloud target detection method is proposed for the problem of difficult recognition of small targets such as pedestrians. The problem that PointPillars did not consider the contextual information of point cloud neighborhood was solved by aggregating corresponding scale point cloud neighborhood information through multilayer convolutional stacking and convolution kernel setting to enhance feature expression ability. For the problem that existing methods neglected pedestrians’ easy deformation characteristics during feature extraction, a two-branching strategy was used to introduce two-dimensional offset in shallow feature map, which enabled the network to adaptively learn weights and improve robustness to deformation targets. Multi-scale features were extracted using feature pyramid structure, and dual-branch features were spliced to obtain fusion information with richer expression. Experiments on the KITTI dataset show that compared with PointPillars algorithm, this method improves pedestrian detection accuracy by 7.83 and 7.38 percentage points for medium and difficult levels in bird’s eye view mode, and the corresponding improvement is 9.91 and 5.42 percentage points in 3D mode.

     

/

返回文章
返回