结合图网络的多模态特征融合三维检测

    Multi-modal Feature Fusion Combined with Graph Network for 3D Detection

    • 摘要: 针对三维检测因受到光照等外界环境因素和激光点云稀疏遮挡而导致的识别不准确问题,提出了基于改进EPNet的三维车辆目标检测方法。文中提出一种基于点方法和图方法相结合的检测方式,图方法通过学习点之间的边信息更新点,结合两种点云特征提取方式更好学习到点与点之间的空间信息,减少物体原始结构信息的损失。并且使用上层融合模块特征改进了图像与点云融合的方式,提出了多层特征融合,减少了光照的影响,提高了车辆检测精度。在公开的KITTI数据集上进行实验,结果表明:文中提出的方法相较于原网络具有更高的检测精度,每种等级的车辆检测精度均有提高,尤其在中等等级上检测精度提高了1.83%,证明了该方法的优越性。

       

      Abstract: Aiming at the inaccurate recognition of 3D detection due to external environmental factors such as illumination and sparse occlusion of laser point clouds, a 3D vehicle target detection method based on improved EPNet is proposed. A detection method based on the combination of point and graph methods is proposed in this paper. The graph method updates points by learning the edge information between points, and combines the two point cloud feature extraction methods to better learn the spatial information between points and reduce the loss of the original structural information of the object. And the way of image and point cloud fusion is improved by using the features of the upper-level fusion module, and a multi-layer feature fusion is proposed, which reduces the influence of illumination and improves the accuracy of vehicle detection. Experiments are carried out on the public KITTI dataset. The results show that the method proposed in this paper has higher detection accuracy than the original network, and the detection accuracy of each level of vehicle has been improved, especially in the Moderate level. The detection accuracy has increased by 1.83%, proving the superiority of the method.

       

    /

    返回文章
    返回