《计算机应用》唯一官方网站

• •    下一篇

基于点云重构的自监督点云异常检测方法

杨建锋1,2,陈斌2,3,4, 李雨轩1,2   

  1. 1.中国科学院 成都计算机应用研究所 2.中国科学院大学 3.哈尔滨工业大学(深圳) 国际人工智能研究院 4.哈尔滨工业大学 重庆研究院
  • 收稿日期:2024-09-23 修回日期:2024-12-23 发布日期:2025-01-14 出版日期:2025-01-14
  • 通讯作者: 陈斌
  • 作者简介:杨建锋(1998—),男,江西南昌人,硕士研究生,主要研究方向:机器视觉、异常检测;陈斌(1970—),男,四川广汉人,研究员,博士,CCF会员,主要研究方向:工业检测、深度学习;李雨轩(1999—),男,河南商丘人,硕士研究生,主要研究方向:异常检测,深度学习。

Self-supervised point cloud anomaly detection method based on point cloud reconstruction

YANG Jianfeng1,2, CHEN Bin2,3,4, LI Yuxuan1,2   

  1. 1. Chengdu Institute of Computer Applications,Chinese Academy of Sciences 2. University of Chinese Academy of Sciences 3. International Institute for Artificial Intelligence,Harbin Institute of Technology(Shenzhen) 4. Chongqing Research Institute,Harbin Institute of Technology
  • Received:2024-09-23 Revised:2024-12-23 Online:2025-01-14 Published:2025-01-14
  • About author:YANG Jianfeng, born in 1998, M.S. candidate. His research interests include machine vision, anomaly detection. CHEN Bin, born in 1970, Ph. D., research fellow. His research interests include industrial detection, deep learning. LI Yuxuan, born in 1999, M.S. candidate. His research interests include anomaly detection, deep learning.

摘要: 面对日趋复杂的工业生产环境,三维点云工业异常检测需求与日俱增。尽管基于预训练网络的二维异常检测方法效果显著,但三维点云预训练网络的泛化能力有限,导致这类点云异常检测方法效果不佳。为提高三维点云异常检测性能,提出一种基于点云重构的异常检测方法Point-ReAD(Point cloud Reconstruction for Anomaly Detection),它由3个核心模块构成:异常模拟模块、点云重构网络和异常判别模块。在训练阶段,正常点云图经异常模拟模块产生异常点云送入点云重构网络,正常点云作为自监督信号指导重构网络学习。点云重构网络使用分组注意力模块(Group Attention Module,GAM),该模块设计用于融合点云的复杂结构信息,从而有效地捕捉点云中的几何和语义特征。在推理阶段,测试点云进入重构网络后生成重构点云,异常判别模块比较重构前后的点云从而精确定位异常。实验结果表明,Point-ReAD在MVTec 3D-AD数据集上的点云级AUROC(Area Under the Receiver Operator characteristic Curve)和点级AUPRO (Area Under the Per-Region Overlap)分别达到了95.49%和94.66%,相较于M3DM(Multi-3D-Memory)、3DRÆM(3D Discriminatively trained Reconstruction Anomaly Embedding Model)等方法整体性能有所提升。

关键词: 异常检测, 自监督学习, 点云, 计算机视觉, 重构网络

Abstract: As industrial production environments become more intricate, the demand for 3D point cloud industrial anomaly detection is increasing. Although the two-dimensional anomaly detection method based on pre-trained feature extractor is effective, the generalization ability of three-dimensional point cloud pre-training network is limited, which leads to the poor effect of this kind of point cloud anomaly detection method. To bolster the performance of three-dimensional point cloud anomaly detection, Point-ReAD, an innovative method based on point cloud reconstruction, was proposed. Point-ReAD comprises an anomaly simulation module, a point cloud reconstruction network, and an anomaly discrimination module. During training, anomalous point clouds were created from normal point cloud data by the anomaly simulation module, which were then fed into the point cloud reconstruction network, with the normal point clouds serving as self-supervised signals to guide the learning process. The point cloud reconstruction network specifically incorporates the Group Attention Module (GAM), which is meticulously designed to seamlessly integrate intricate structural information from point clouds, thereby enhancing the efficacy of capturing geometric and semantic features in point clouds. In the inference phase, the test point clouds were introduced into the reconstruction network to generate reconstructed point clouds, and anomalies were identified by the anomaly discrimination module by comparing the pre- and post-reconstruction point clouds. The experimental results showed that Point-ReAD achieves point cloud-level AUROC and point-level AUPRO of 95.49% and 94.66%, respectively, on the MVTec 3D-AD dataset, indicating an overall performance improvement compared to methods like M3DM (Multi-3D-Memory) and 3DRÆM (3D Discriminatively trained Reconstruction Anomaly Embedding Model).

Key words: anomaly detection, self- supervised learning, point cloud, computer vision, reconstruction network

中图分类号: