《计算机应用》唯一官方网站

• •    下一篇

轻量化沥青路面裂缝图像分割网络 PIPNet

封筠*,毕健康,霍一儒,李家宽
  

  1. 石家庄铁道大学 信息科学与技术学院, 石家庄 050043
  • 发布日期:2023-08-24 出版日期:2023-08-24
  • 作者简介:封筠(1971—),女,河北石家庄人,教授,博士,CCF 会员,主要研究方向:计算机视觉、机器学习;毕健康(1996—),男,河 北沧州人,硕士,主要研究方向:图像分割、深度学习; 霍一儒(2000—),男,河北邢台人,硕士研究生,主要研究方向:图像分割、 深度学习;李家宽(1998—),男,河北石家庄人,硕士研究生,主要研究方向:缺陷检测、深度学习。
  • 基金资助:
    河北省高等学校科学技术研究重点项目(ZD2021333)

PIPNet: a lightweight asphalt pavement crack image segmentation network 

FENG Jun*BI JiankangHUO YiruLI Jiakuan #br#   

  1. School of Information Science and TechnologyShijiazhuang Hebei 050043China
  • Online:2023-08-24 Published:2023-08-24
  • About author:FENG Jun, born in 1971, Ph. D., professor. Her research interests include computer vision, machine learning, complex network analysis. BI Jiankang, born in 1996, M. S. His research interests include image segmentation, deep learning. HUO Yiru, born in 2000, M. S. candidate. His research interests include image segmentation, deep learning. LI Jiakuan, born in 1998, M. S. candidate. His research interests include defect detection, deep learning

摘要: 裂缝分割是对路面病害损坏程度评估的重要前提,为平衡深度神经网络分割的有效性与实时性,提出一种基于U-Net 编码-解码器结构的轻量化沥青路面裂缝图像分割网络(PIPNet)。编码部分为倒金字塔结构,提出了具有不同空洞率的多分支并行空洞卷积模块,结合深度可分离卷积和普通卷积,逐级减少并行卷积的个数,对表层、中层及底层特征提取多尺度信息并降低模型复杂度,借鉴 GhostNet 特点,设计了逆残差轻量化模块,嵌入并行双池化注意力。在 GAPs384 数据集上的测试结果表明,PIPNet 在参数量和计算量仅为 ResNet50 编码近 1/6 的情况下,其平均交并比提高了 1.10 个百分点,且较轻量化GhostNet SegNet 分别高出 4.14 9.95 个百分点。实验结果表明,PIPNet 在降低模型复杂度的同时,有着较高的裂缝分割性能,且对不同路面裂缝图像分割适应性良好。

关键词: 沥青路面图像, 裂缝分割, 轻量化神经网络, 倒金字塔结构, 并行空洞卷积

Abstract: Crack segmentation is an important prerequisite for evaluating the damage degree of pavement diseases. In order to balance the effectiveness and real-time of deep neural network segmentation, a lightweight asphalt pavement crack segmentation neural network(PIPNet) based on U-Net encoder-decoder structure was proposed in this paper. The encoding part was an inverted pyramid structure. Multi-branch parallel dilated convolution module with different dilatation rates was proposed to extract multi-scale information from the top, middle and bottom features and reduce model complexity, which combined deep separable convolutions with ordinary convolutions and gradually reduced the number of parallel convolutions. Drawing on the characteristics of GhostNet network, an inverse residual lightweight module was designed, which embedded with parallel dual pooling attention. Testing results on GAPS384 dataset show that the proposed lightweight segmentation method improves its mIOU value by 1.10 percentage points, respectively when the Params and MFLOPs values are only about one-sixth of the ResNet50 encoding. The mIOU value is 4.14 and 9.95 percentage points higher than the lightweight GhostNet and SegNet networks, respectively. Experimental results show that the proposed method has high crack segmentation performance while reducing the model complexity, and has good adaptability to segmentation of different road crack images.

Key words: asphalt pavement image, crack segmentation, lightweight neural network, inverted pyramid structure, parallel dilated convolution

中图分类号: