Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (11): 3332-3336.DOI: 10.11772/j.issn.1001-9081.2021010021

• Multimedia computing and computer simulation • Previous Articles     Next Articles

Moving object detection and static map reconstruction with hybrid vision system

Yusheng HU(), Bingwei HE, Qingkang DENG   

  1. College of Mechanical Engineering and Automation,Fuzhou University,Fuzhou Fujian 350108,China
  • Received:2021-01-06 Revised:2021-04-06 Accepted:2021-04-12 Online:2021-04-26 Published:2021-11-10
  • Contact: Yusheng HU
  • About author:HU Yusheng, born in 1996, M. S. candidate. His research interests include robot vision,3D reconstruction
    HE Bingwei, born in 1973, Ph. D., professor. His research interests include robot vision,vision measurement
    DENG Qingkang,born in 1996,M. S. candidate.
  • Supported by:
    the National Natural Science Foundation of China(61473090)

混合视觉系统的运动物体检测和静态地图重建

胡誉生(), 何炳蔚, 邓清康   

  1. 福州大学 机械工程及自动化学院,福州 350108
  • 通讯作者: 胡誉生
  • 作者简介:胡誉生(1996—),男,福建莆田人,硕士研究生,主要研究方向:机器人视觉、三维重建
    何炳蔚(1973—),男,山东郓城人,教授, 博士,主要研究方向:机器人视觉、视觉测量
    邓清康(1996—),男,福建南平人,硕士研究生,主要研究方向:机器人视觉、三维重建。
  • 基金资助:
    国家自然科学基金资助项目(61473090)

Abstract:

Moving object detection and static map reconstruction in the environment with complex dynamic background are prone to incomplete moving object detection. In order to solve the problem, a new moving object detection method with hybrid vision system assisted by point cloud segmentation was proposed. Firstly, the PassThrough+RANdom SAmple Consensus (RANSAC) method was proposed to overcome large-area wall interference, so as to realize the point cloud ground point recognition. Secondly, the non-ground point data were projected to the image as feature points, and their optical flow motion vectors and artificial motion vectors were estimated to detect the dynamic points. Then, the dynamic threshold strategy was used to perform Euclidean clustering to the point cloud. Finally, the results of dynamic point detection and point cloud segmentation were integrated to completely extract the moving objects. In addition, the Octomap tool was used to convert the point cloud map into a 3D grid map in order to complete the map construction. Through the experimental results and data analysis, it can be seen that the proposed method can effectively improve the integrity of moving object detection, and reconstruct a low-loss, highly-practical static grid map.

Key words: dynamic background, moving object detection, static map, Euclidean clustering, RANdom SAmple Consensus (RANSAC)

摘要:

复杂动态背景环境下的运动物体检测和静态地图重建中容易出现运动物体检测不完整的问题。针对上述问题,提出了一种混合视觉系统下点云分割辅助的运动物体检测方法。首先,提出了直通滤波+随机采样一致性(PassThrough+RANSAC)方法来克服大面积墙壁干扰以实现点云地面点的识别;其次,将非地面点数据作为特征点投射到图像上,并估计其光流运动向量和人工运动向量,从而对动态点进行检测;然后,采用动态阈值策略对点云进行欧氏聚类;最后,整合动态点检测结果与点云分割结果来完整地提取出运动物体。此外,通过八叉树地图(Octomap)工具将点云地图转换为三维栅格地图以完成地图的构建。通过实验结果和数据分析可知,所提方法可以有效提高运动物体检测的完整性,同时重建出低损耗、高实用性的静态栅格地图。

关键词: 动态背景, 运动物体检测, 静态地图, 欧氏聚类, 随机采样一致性

CLC Number: