《计算机应用》唯一官方网站

• •    下一篇

基于深度强化学习的多机器人路径跟随与编队

何浩东1,符浩1,王强1,周帅2,刘伟2   

  1. 1. 武汉科技大学
    2. 武汉科技大学计算机科学与技术学院
  • 收稿日期:2023-08-21 修回日期:2023-11-16 发布日期:2023-12-18 出版日期:2023-12-18
  • 通讯作者: 符浩
  • 基金资助:
    国家自然科学基金;湖北省教育厅科研项目;武汉市知识创新专项项目

Multi-robot path following and formation based on deep reinforcement learning

  • Received:2023-08-21 Revised:2023-11-16 Online:2023-12-18 Published:2023-12-18
  • Contact: Hao FU

摘要: 针对多机器人在人群环境中路径跟随与编队的避障及运动轨迹平滑性问题,提出了基于深度强化学习的多机 器人路径跟随与编队算法。首先,建立行人危险性优先级机制,结合行人危险性优先级机制与强化学习设计危险意识网 络,提高多机器人编队的安全性。然后,引入虚拟机器人作为多机器人的跟随目标,将路径跟随转化为多机器人对虚拟 机器人的跟随控制,从而提高机器人运动轨迹的平滑性。最后,通过仿真实验将所提算法与现有算法进行对比,同时进 行定量与定性分析。实验结果表明,与现有点对点的路径跟随算法相比,所提算法在人群环境下具有优异的避障性能, 可保证多机器人运动轨迹的平滑性。

关键词: 多机器人, 路径跟随, 编队避障, 强化学习

Abstract: Aiming at the obstacle avoidance and trajectory smoothness problem of multi-robot path following and formation in crowd environment, a multi-robot path following and formation algorithm based on deep reinforcement learning was proposed. Firstly, a pedestrian danger priority mechanism was established, which combined with reinforcement learning to design a danger awareness network to enhance the safety of multi-robot formation. Subsequently, a virtual robot was introduced as the reference target for the multirobot, thus transforming path following into tracking control of the virtual robot by the multi-robot, with the purpose of enhancing the smoothness of the robot trajectories. Finally, quantitative and qualitative analysis was conducted through simulation experiments to compare the proposed algorithm with existing ones. The experimental results show that compared with the existing point-to-point path following algorithms, the proposed algorithm has excellent obstacle avoidance performance in crowded environments, which ensures the smoothness of multi-robot motion trajectories.

Key words: multi-robot, path-following, formation obstacle-avoiding, reinforcement lenrning

中图分类号: