Bridge crack classification and measurement method based on deep convolutional neural network

doi:10.11772/j.issn.1001-9081.2019091546

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (4): 1056-1061.DOI: 10.11772/j.issn.1001-9081.2019091546

• Artificial intelligence • Previous Articles Next Articles

Bridge crack classification and measurement method based on deep convolutional neural network

LIANG Xuehui^1,2, CHENG Yunze², ZHANG Ruijie², ZHAO Fei²

1. Tianjin Key Laboratory for Control Theory and Application in Complicated Systems(Tianjin University of Technology), Tianjin 300384, China;
2. School of Electrical and Electronic Engineering, Tianjin University of Technology, Tianjin 300384, China

Received:2019-09-09 Revised:2019-11-01 Online:2020-04-10 Published:2019-11-18
Supported by:
This work is partially supported by the Tianjin Science and Technology Commissioner Project(14JCTPJC00510).

基于卷积神经网络的桥梁裂缝识别和测量方法

梁雪慧^1,2, 程云泽², 张瑞杰², 赵菲²

1. 天津市复杂系统控制理论与应用重点实验室(天津理工大学), 天津 300384;
2. 天津理工大学电气电子工程学院, 天津 300384

通讯作者: 程云泽
作者简介:梁雪慧(1970-),女,河北藁城人,副教授,硕士,主要研究方向:智能控制;程云泽(1996-),男,河北唐山人,硕士研究生,主要研究方向:深度学习、图像处理;张瑞杰(1993-),男,甘肃金昌人,硕士研究生,主要研究方向:智能控制;赵菲(1994-),女,河北石家庄人,硕士研究生,主要研究方向:深度学习、图像处理。
基金资助:
天津市科技特派员项目（14JCTPJC00510）。

Abstract

Abstract: In order to improve the detection level of bridge cracks,and solve the time-consuming and laborious problem in manual detection and the parameters to be set manually in traditional image processing methods,an improved bridge crack detection algorithm was proposed based on GoogLeNet. Firstly,a large-scale bridge crack Retinex-Laplace-Histogram equalization(RLH)dataset was constructed for model training and testing. Secondly,based on the original GoogLeNet model,the inception module was improved by using the normalized convolution kernel,three improved schemes were used to modify the beginning of the network,the seventh and later inception layers were removed,and a bridge crack feature image classification system was established. Finally,the sliding window was used to accurately locate the cracks and the lengths and widths of the cracks were calculated by the skeleton extraction algorithm. The experimental results show that compared with the original GoogLeNet network,the improve-GoogLeNet network increased the recognition accuracy by 3. 13%, and decreased the training time to the 64. 6% of the original one. In addition,the skeleton extraction algorithm can consider the trend of the crack,calculate the width more accurately,and the maximum width and the average width can be calculated. In summary,the classification and measurement method proposed in this paper have the characteristics of high accuracy,fast speed,accurate positioning and accurate measurement.

Key words: image processing, deep learning, GoogLeNet deep convolution model, skeleton extraction algorithm, bridge creak

摘要： 为了提高桥梁裂缝检测水平，解决目前手工检测费时费力和传统图像处理方法需要人工设定参数的问题，提出一种基于改进GoogLeNet的桥梁裂缝检测算法。首先，构建了一个较大规模的桥梁裂缝数据集RLH（Retinex-Laplace-Histogram equalization）用于模型的训练和测试。其次，基于原始的GoogLeNet模型，采用归一化的卷积核改进了inception模块，采用三种改进方案修改网络开头，去掉第七个及以后的inception层，建立桥梁裂缝特征图像分类系统。最后，利用滑动窗口精准定位裂缝并结合骨架提取算法计算裂缝的长度和宽度。实验结果表明，改进的GoogLeNet网络与原始GoogLeNet网络相比，识别准确率提升了3.13%，训练时间减少为原来的64.6%。另外，骨架提取算法能够考虑裂缝的走势，计算宽度更加准确，且最大宽度和平均宽度都能计算。综上所述，所提分类和测量方法具有准确度高、速度快、定位准确、测量准确等特点。

关键词: 图像处理, 深度学习, GoogLeNet深度卷积模型, 骨架提取算法, 桥梁裂缝

CLC Number:

TP391.41

LIANG Xuehui, CHENG Yunze, ZHANG Ruijie, ZHAO Fei. Bridge crack classification and measurement method based on deep convolutional neural network[J]. Journal of Computer Applications, 2020, 40(4): 1056-1061.

梁雪慧, 程云泽, 张瑞杰, 赵菲. 基于卷积神经网络的桥梁裂缝识别和测量方法[J]. 计算机应用, 2020, 40(4): 1056-1061.

References

[1] 《中国公路学报》编辑部. 中国桥梁工程学术研究综述·2014[J]. 中国公路学报,2014, 27(5):1-96. (Editorial office of China journal of highway and transport. Review on China's bridge engineering research:2014[J]. China Journal of Highway and Transport,2014, 27(5):1-96.)
[2] SANCHEZ-CUEVAS P J,HEREDIA G,OLLERO A. Multirotor UAS for bridge inspection by contact using the ceiling effect[C]//Proceedings of the 2017 International Conference on Unmanned Aircraft Systems. Piscataway,NJ:IEEE,2017:767-774.
[3] JIMENEZ-CANO A E, HEREDIA G, OLLERO A. Aerial manipulator with a compliant arm for bridge inspection[C]//Proceedings of the 2017 International Conference on Unmanned Aircraft Systems. Piscataway,NJ:IEEE,2017:1217-1222.
[4] AMHAZ R,CHAMBON S,IDIER J,BALTAZART V. Automatic crack detection on two-dimensional pavement images:an algorithm based on minimal path selection[J]. IEEE Transactions on Intelligent Transportation Systems,2016,17(10):2718-2729.
[5] 王耀东, 朱力强, 史红梅, 等. 基于局部图像纹理计算的隧道裂缝视觉检测技术[J]. 铁道学报,2018,40(2):82-90. (WANG Y D,ZHU L Q,SHI H M,et al. Vision detection of tunnel crack based on local image texture calculation[J]. Journal of the China Railway Society,2018,40(2):82-90.)
[6] HASSAN N,MATHAVAN S,KAMAL K. Road crack detection using the particle filter[C]//Proceedings of the 2017 International Conference on Automation and Computing. Piscataway,NJ:IEEE, 2017:1-6.
[7] 钱彬, 唐振民, 沈肖波, 等. 基于多特征流形学习和矩阵分解的路面裂缝检测[J]. 仪器仪表学报,2016,37(7):1639-1646. (QIAN B,TANG Z M,SHEN X B,et al. Pavement crack detection based on multi-feature manifold learning and matrix factorization[J]. Chinese Journal of Scientific Instrument,2016,37(7):1639-1646.)
[8] MUSTAFA R,MOHAMED E A. Concrete crack detection based multi-block CLBP features and SVM classifier[J]. Journal of Theoretical and Applied Information Technology,2015,81(1):151-160.
[9] QUINTANA M, TORRES J, MENENDEZ J M. A simplified computer vision system for road surface inspection and maintenance view document[J]. IEEE Transactions on Intelligent Transportation Systems,2016,17(3):608-619.
[10] SHI Y,CUI L,QI Z,et al. Automatic road crack detection using random structured forests[C]//IEEE Transactions on Intelligent Transportation Systems,2016,17(12):3434-3445.
[11] OLIVEIRA H,CORREIA P L. Road surface crack detection:improved segmentation with pixel-based refinement[C]//Proceedings of the 2017 European Signal Processing Conference. Piscataway,NJ:IEEE,2017:2026-2030.
[12] ZHANG D,LI Q,CHEN Y,et al. An efficient and reliable coarse-to-fine approach for asphalt pavement crack detection[J]. Image and Vision Computing,2017,57(C):130-146.
[13] EILER M D, FERGUS R. Visualizing and understanding convolutional networks[C]//Proceedings of the 2014 European Conference on Computer Vision. Berlin:Springer,2014:818-833.
[14] TOMASI C,MANDUCHI R. Bilateral filtering for gray and color images[C]//Proceedings of the 6th International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 1998:839-846.
[15] LEI L,ZHOU Y,LI J. An investigation of Retinex algorithms for image enhancement[J]. Journal of Electronics(China),2007, 24(15):696-700.
[16] 章毓晋. 图像处理与分析[M]. 北京:清华大学出社,1999:77-79. (ZHANG Y J. Image Processing and Analysis[M]. Beijing:Tsinghua University Press,1999:77-79.)
[17] SIMONYAN K, ZISSERMAN A. Two-stream convolutional networks for action recognition in videos[J]. Advances in Neural Information Processing Systems,2014,1(4):568-576.
[18] HASSAN N,MATHAVAN S,KAMAL K. Road crack detection using the particle filter[C]//Proceedings of the 2017 International Conference on Automation and Computing. Piscataway, NJ:IEEE,2017:1-6.
[19] LEON B. Large-scale machine learning with stochastic Gradient descent[C]//Proceedings of the 19th International Conference on Computational Statistics. Piscataway,NJ:IEEE,2018:177-186.
[20] 王睿, 漆泰岳, 雷波, 等. 隧道衬砌裂缝特征提取方法研究[J]. 岩石力学与工程学报,2015, 34(6):1211-1217.(WANG R,QI T Y,LEI B,et al. Characteristic extraction of cracks of tunnel lining[J]. Chinese Journal of Rock Mechanics and Engineering, 2015, 34(6):1211-1217.)
[21] 元大鹏. 地铁隧道图像数据分析系统[D]. 北京:北京交通大学,2016:43-46. (YUAN D P. Analysis system for subway tunnel image[D]. Beijing:Binjing Jiaotong University,2016:43-46.)

Bridge crack classification and measurement method based on deep convolutional neural network

基于卷积神经网络的桥梁裂缝识别和测量方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	CHEN Chengrui, SUN Ning, HE Shibiao, LIAO Yong. Deep learning-based joint channel estimation and equalization algorithm for C-V2X communications [J]. Journal of Computer Applications, 2021, 41(9): 2687-2693.
[2]	XIE Defeng, JI Jianmin. Syntax-enhanced semantic parsing with syntax-aware representation [J]. Journal of Computer Applications, 2021, 41(9): 2489-2495.
[3]	DAI Yurou, YANG Qing, ZHANG Fengli, ZHOU Fan. Trajectory prediction model of social network users based on self-supervised learning [J]. Journal of Computer Applications, 2021, 41(9): 2545-2551.
[4]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[5]	XU Jianglang, LI Linyan, WAN Xinjun, HU Fuyuan. Indoor scene recognition method combined with object detection [J]. Journal of Computer Applications, 2021, 41(9): 2720-2725.
[6]	ZHENG Zhiqiang, HU Xin, WENG Zhi, WANG Yuhe, CHENG Xi. Cattle eye image feature extraction method based on improved DenseNet [J]. Journal of Computer Applications, 2021, 41(9): 2780-2784.
[7]	HE Zhenghai, XIAN Yantuan, WANG Meng, YU Zhengtao. Case reading comprehension method combining syntactic guidance and character attention mechanism [J]. Journal of Computer Applications, 2021, 41(8): 2427-2431.
[8]	CAO Yuhong, XU Hai, LIU Sun'ao, WANG Zixiao, LI Hongliang. Review of deep learning-based medical image segmentation [J]. Journal of Computer Applications, 2021, 41(8): 2273-2287.
[9]	QIN Binbin, PENG Liangkang, LU Xiangming, QIAN Jiangbo. Research progress on driver distracted driving detection [J]. Journal of Computer Applications, 2021, 41(8): 2330-2337.
[10]	GAO Qinquan, HUANG Bingcheng, LIU Wenzhe, TONG Tong. Bamboo strip surface defect detection method based on improved CenterNet [J]. Journal of Computer Applications, 2021, 41(7): 1933-1938.
[11]	HOU Xiaohan, JIN Guodong, TAN Lining, XUE Yuanliang. Synthetic aperture radar ship detection method based on self-adaptive and optimal features [J]. Journal of Computer Applications, 2021, 41(7): 2150-2155.
[12]	LI Yafang, LIANG Ye, FENG Weiwei, ZU Baokai, KANG Yujian. Deep network embedding method based on community optimization [J]. Journal of Computer Applications, 2021, 41(7): 1956-1963.
[13]	WANG Yue, JIANG Yiming, LAN Julong. Intrusion detection based on improved triplet network and K-nearest neighbor algorithm [J]. Journal of Computer Applications, 2021, 41(7): 1996-2002.
[14]	DU Yan, LYU Liangfu, JIAO Yichen. Fuzzy prototype network based on fuzzy reasoning [J]. Journal of Computer Applications, 2021, 41(7): 1885-1890.
[15]	LIU Shize, ZHU Yida, CHEN Runze, LUO Haiyong, ZHAO Fang, SUN Yi, WANG Baohui. Traffic mode recognition algorithm based on residual temporal attention neural network [J]. Journal of Computer Applications, 2021, 41(6): 1557-1565.