面向黑夜场景的激光雷达多模态端到端自动驾驶模型研究

    Research on LiDAR Multimodal End-to-end Autonomous Driving Model for Night Scenes

    • 摘要: 近年来,自动驾驶发展迅速,涌现了许多自动驾驶模型。然而,这些自动驾驶模型对于黑夜这种光线暗的场景下的应用并未做出针对性研究。黑夜场景中,摄像头的效果较差,而激光雷达主动发射激光,不受环境光照影响,在黑夜场景下也能有效识别道路信息。于是本文提出一种改进的端到端自动驾驶模型,基于FusionAD原碰撞预测-决策一体化架构,新增“特征自适应采样层+梯度动态调整层”,在原模型的碰撞优化部分将牛顿法替换为小批量梯度下降法,形成“感知特征提纯-碰撞风险建模-小批量梯度下降优化”的三阶结构。本文引入多模态融合输入方案,通过融合激光雷达点云数据与视觉图像数据构建联合输入体系。基于华为ONCE数据集,本模型对多模态和纯图像输入两种条件下的端到端自动驾驶模型进行了性能对比实验,结果表明引入改进的碰撞优化结构后,模型在黑夜环境下的碰撞率降低了50.8%,同时位移误差减小了17.3%,轨迹规划性能显著提升,训练效率有所提高。这项改进为端到端自动驾驶系统的鲁棒性和适应性提供了更强的支持,验证了激光雷达在自动驾驶领域应用的潜力,并为未来传感器融合研究奠定了基础。

       

      Abstract: In recent years, the development of autonomous driving has been rapid, with many autonomous driving models emerging. However, these models have not conducted targeted research for applications in dark scenes such as nighttime. In nighttime scene, camera performance is poor, while LiDAR actively emits laser light, is not affected by environmental lighting, and can effectively identify road information. Therefore, this paper proposes an improved end-to-end autonomous driving model, based on the integrated architecture of FusionAD original collision prediction-decision, adding "feature adaptive sampling layer and gradient dynamic adjustment layer", replacing the Newtonian method with a small-batch gradient descent method in the collision optimization part of the original model, forming a three-order structure of "perceptual feature purification, collision risk modeling, and small-batch gradient descent optimization". This paper introduces a multimodal fusion input scheme by integrating LiDAR point cloud data with visual image data to construct a joint input system. Based on the Huawei ONCE dataset, this model conducted performance comparison experiments on end-to-end autonomous driving models under both multimodal and pure image input conditions. The results show that after introducing an improved collision optimization structure, the model reduced the collision rate by 50.8% in nighttime environments, simultaneously decreased the displacement error by 17.3%, significantly improved trajectory planning performance, and enhanced training efficiency.This improvement provides stronger support for the robustness and adaptability of end-to-end autonomous driving systems, validates the potential of LiDAR applications in the autonomous driving field, and lays a foundation for future sensor fusion research

       

    /

    返回文章
    返回