联合Q学习与混合蚁群的无人机三维路径规划
3D Path Planning for UAVs Combining Q-Learning and Hybrid Ant Colony Optimization
-
摘要: 针对无人机三维路径规划过程中经典进化算法收敛速度与全局搜索能力难以兼顾的问题, 提出了一种Q学习引导的混合连续蚁群优化(ACOAGR-GA)路径规划方法.首先, 通过Q-Learning和随机初始解相结合的混合种群初始化方法来优化蚁群初始信息素分布, 为无人机提供高质量初始路径;然后, 在蚁群算法中利用高斯-莱维混合游走策略实现路径规划过程中的动态步长, 帮助算法跳出局部最优;最后, 对蚁群算法自适应节点选择进行优化, 并采用遗传精英择优机制设计适应度值, 以充分利用所有蚂蚁个体, 加速算法的收敛速度并提高全局搜索能力.实验结果表明: 所提方法在路径规划总成本上表现最优, 收敛精度有显著提升, 收敛速度虽略有下降, 但具备逃离局部最优能力.Abstract: To address the challenge that classical evolutionary algorithms struggle to balance convergence speed and global search capability in 3D path planning for unmanned aerial vehicles (UAVs), this paper proposes a Q-learning guided hybrid continuous ant colony optimization (ACOAGR-GA) path planning method.First, a hybrid population initialization strategy combining Q-Learning and random initial solutions is designed to optimize the initial pheromone distribution of the ant colony, providing high-quality initial paths for UAVs. Then, a Gaussian-Lévy hybrid walk strategy is introduced into the ant colony algorithm to achieve dynamic step size during path planning, which helps the algorithm escape from local optima. Finally, the adaptive node selection of the ant colony algorithm is optimized, and a fitness function is constructed via a genetic elite selection mechanism to fully utilize all ant individuals, thus accelerating convergence and enhancing global search performance.Comparative experiments are conducted on 4 task scenarios built based on the open-source digital elevation model from Phung et al., with 5 typical algorithms as benchmarks. The results demonstrate that the proposed method achieves the optimal total path cost. Compared with contrast algorithms, its convergence accuracy is significantly improved, and it possesses excellent local optimum escape ability, with only a slight reduction in convergence speed.
下载: