Improved YOLOv3 target detection based on boundary limit point features

doi:10.11772/j.issn.1001-9081.2021111999

Abstract

Abstract: The problems of large number of targets， small scale and high-overlapping lead to low accuracy and difficulty in target detection. In order to improve the precision of target detection and avoid missed detection and false detection as much as possible， an improved YOLOv3 target detection algorithm based on boundary limit point features was proposed. Firstly， a boundary enhancement operator Border was introduced to adaptively extract boundary features from the limit points of the boundary to enhance the features of the existing points and improve the accuracy of target positioning. Then， the precision of target detection was further improved by increasing the target detection scale， refining the feature map， and enhancing the fusion of the feature image deep and shallow semantic information. Finally， based on the target instance characteristics in target detection and the improved network model， the Complete Intersection over Union （CIoU） function was introduced to improve the original YOLOv3 loss function， thereby improving the convergence speed and recall of the detection box. Experimental results show that compared with the original YOLOv3 target detection algorithm， the improved YOLOv3 target detection algorithm has the Average Precision increased by 3.9 percentage points ， and has the detection speed similar to the original algorithm， verifying that it can effectively improve the target detection ability of models.

Key words: target detection, boundary limit point, YOLOv3 algorithm, refinement feature map, multi-scale detection, loss function

摘要： 目标数量多、尺度较小与高度重叠等问题导致目标检测精度低、难度大。为提升目标检测精度，尽可能避免漏检、误检情况，提出一种基于边界极限点特征的改进YOLOv3目标检测算法。首先，引入边界增强算子Border，从边界的极限点中自适应地提取边界特征来增强已有点特征，提高目标定位准确度；然后，增加目标检测尺度，细化特征图，增强特征图深、浅层语义信息的融合，提高目标检测精度；最后，基于目标检测中目标实例特性及改进网络模型，引入完全交并比（CIoU）函数对原YOLOv3损失函数进行改进，提高检测框收敛速度以及检测框召回率。实验结果表明，相较于原YOLOv3目标检测算法，改进后的YOLOv3目标检测算法的平均精度提高了3.9个百分点，且检测速度与原算法相近，能有效提高模型对目标的检测能力。

关键词: 目标检测, 边界极限点, YOLOv3算法, 细化特征图, 多尺度检测, 损失函数

CLC Number:

TP391.41

LI Kewen, YANG Jiantao, HUANG Zongchao. Improved YOLOv3 target detection based on boundary limit point features[J]. Journal of Computer Applications, 2023, 43(1): 81-87.

李克文, 杨建涛, 黄宗超. 基于边界极限点特征的改进YOLOv3目标检测[J]. 《计算机应用》唯一官方网站, 2023, 43(1): 81-87.

References

1 YI J R， WU P X， METAXAS D N. ASSD： attentive single shot multibox detector［J］. Computer Vision and Image Understanding， 2019， 189： No.102827. 10.1016/j.cviu.2019.102827
2 LI X L， SONG D W， DONG Y S. Hierarchical feature fusion network for salient object detection［J］. IEEE Transactions on Image Processing， 2020， 29： 9165-9175. 10.1109/tip.2020.3023774
3 赵宏，孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述［J］. 计算机应用， 2021， 41（9）：2496-2503. 10.11772/j.issn.1001-9081.2020111829 ZHAO H， KONG D Y. Chinese description of image content based on fusion of image feature attention and adaptive attention［J］. Journal of Computer Applications， 2021， 41（9）： 2496-2503. 10.11772/j.issn.1001-9081.2020111829
4 HE K M， ZHANG X Y， REN S Q， et al. Deep residual learning for image recognition［C］// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2016： 770-778. 10.1109/cvpr.2016.90
5 RADOSAVOVIC I， KOSARAJU R P， GIRSHICK R， et al. Designing network design spaces［C］// Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2020： 10425-10433. 10.1109/cvpr42600.2020.01044
6 BROCK A， DE S， SMITH S L， et al. High-performance large-scale image recognition without normalization［C］// Proceedings of the 38th International Conference on Machine Learning. New York： JMLR.org， 2021： 1059-1071. 10.48550/arXiv.2102.06171
7 REDMON J， DIVVALA S， GIRSHICK R， et al. You only look once： unified， real-time object detection［C］// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2016： 779-788. 10.1109/cvpr.2016.91
8 REDMON J， FARHADI A. YOLO9000： better， faster， stronger［C］// Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2017： 6517-6525. 10.1109/cvpr.2017.690
9 REDMON J， FARHADI A. YOLOv3： an incremental improvement［EB/OL］. （2018-04-08）［2021-12-10］.https：//arxiv.org/pdf/1804.02767.pdf. 10.1109/cvpr.2017.690
10 LIU W， ANGUELOV D， ERHAN D， et al. SSD： single shot multiBox detector［C］// Proceedings of the 2016 European Conference on Computer Vision， LNCS 9905. Cham： Springer， 2016： 21-37.
11 LIN T Y， GOYAL P， GIRSHICK R， et al. Focal loss for dense object detection［C］// Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway： IEEE， 2017： 2999-3007. 10.1109/iccv.2017.324
12 GIRSHICK R， DONAHUE J， DARRELL T， et al. Rich feature hierarchies for accurate object detection and semantic segmentation［C］// Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2014： 580-587. 10.1109/cvpr.2014.81
13 GIRSHICK R. Fast R-CNN［C］// Proceedings of the 2015 IEEE International Conference on Computer Vision. Piscataway： IEEE， 2015： 1440-1448. 10.1109/iccv.2015.169
14 REN S Q， HE K M， GIRSHICK R， et al. Faster R-CNN： towards real-time object detection with region proposal networks［C］// Proceedings of the 28th International Conference on Neural Information Processing Systems. Cambridge： MIT Press， 2015： 91-99.
15 ZHENG Z H， WANG P， LIU W， et al. Distance-IoU loss： faster and better learning for bounding box regression［C］// Proceedings of the 34th AAAI Conference on Artificial Intelligence. Palo Alto， CA： AAAI Press， 2020： 12993-13000. 10.1609/aaai.v34i07.6999
16 LIN T Y， MAIRE M， BELONGIE S， et al. Microsoft COCO： common objects in context［C］// Proceedings of the 2014 European Conference on Computer Vision， LNCS 8693. Cham： Springer， 2014： 740-755.
17 HUANG Z C， WANG J L， FU X S， et al. DC-SPP-YOLO： dense connection and spatial pyramid pooling based YOLO for object detection［J］. Information Sciences， 2020， 522： 241-258. 10.1016/j.ins.2020.02.067
18 WU W H， LI Q. Machine vision inspection of electrical connectors based on improved Yolo v3［J］. IEEE Access， 2020， 8： 166184-166196. 10.1109/access.2020.3022405
19 LIU G X， NOUAZE J C， TOUKO MBOUEMBE P L， et al. YOLO-Tomato： a robust algorithm for tomato detection based on YOLOv3［J］. Sensors， 2020， 20（7）： No.2145. 10.3390/s20072145
20 HSU W Y， LIN W Y. Ratio-and-scale-aware YOLO for pedestrian detection［J］. IEEE Transactions on Image Processing， 2021， 30： 934-947. 10.1109/tip.2020.3039574
21 LIN T Y， DOLLáR P， GIRSHICK R， et al. Feature pyramid networks for object detection［C］// Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2017： 936-944. 10.1109/cvpr.2017.106
22 VU T， JANG H， PHAM T X， et al. Cascade RPN： Delving into high-quality region proposal network with adaptive convolution［C/OL］// Proceedings of the 33rd Conference on Neural Information Processing Systems. ［2021-08-23］. https：//proceedings.neurips.cc/paper/2019/file/d554f7bb7be44a7267068a7df88ddd20-Paper.pdf.
23 HUANG J， RATHOD V， SUN C， et al. Speed/accuracy trade-offs for modern convolutional object detectors ［C］// Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： 2017： 7310-7311. 10.1109/cvpr.2017.351
24 SHRIVASTAVA A， SUKTHANKAR R， MALIK J， et al. Beyond skip connections： top-down modulation for object detection［EB/OL］. （2017-09-19）［2021-05-03］.https：//arxiv.org/pdf/1612.06851.pdf.
25 FU C Y， LIU W， RANGA A， et al. DSSD： deconvolutional single shot detector［EB/OL］. （2017-01-23）［2021-07-24］.https：//arxiv.org/pdf/1701.06659.pdf.
26 TAN M X， PANG R M， LE Q V. EfficientDet： scalable and efficient object detection［C］// Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2020： 10778-10787. 10.1109/cvpr42600.2020.01079
27 LIU S T， HUANG D， WANG Y H. Learning spatial fusion for single-shot object detection［EB/OL］. （2019-11-25）［2021-02-12］.https：//arxiv.org/pdf/1911.09516.pdf.
28 QIU H， MA Y C， LI Z M， et al. BorderDet： border feature for dense object detection［C］// Proceedings of the 2020 European Conference on Computer Vision， LNCS 12346. Cham： Springer， 2020： 549-564.
29 LI Z H， XI T， ZHANG G， et al. AutoDet： pyramid network architecture search for object detection［J］. International Journal of Computer Vision， 2021， 129（4）： 1087-1105. 10.1007/s11263-020-01415-x
30 SZEGEDY C， IOFFE S， VANHOUCKE V， et al. Inception-v4， inception-ResNet and the impact of residual connections on learning［C］// Proceedings of the 31st AAAI Conference on Artificial Intelligence. Palo Alto， CA： AAAI Press， 2017： 4278-4284. 10.1609/aaai.v31i1.11231

[1]	Zhonghua LI, Yunqi BAI, Xuejin WANG, Leilei HUANG, Chujun LIN, Shiyu LIAO. Low illumination face detection based on image enhancement [J]. Journal of Computer Applications, 2024, 44(8): 2588-2594.
[2]	Kaili DENG, Weibo WEI, Zhenkuan PAN. Industrial defect detection method with improved masked autoencoder [J]. Journal of Computer Applications, 2024, 44(8): 2595-2603.
[3]	Zhe KONG, Han LI, Shaowei GAN, Mingru KONG, Bingtao HE, Ziyu GUO, Ducheng JIN, Zhaowen QIU. Structure segmentation model for 3D kidney images based on asymmetric multi-decoder and attention module [J]. Journal of Computer Applications, 2024, 44(7): 2216-2224.
[4]	Zhangjian JI, Na DU. Tiny target detection based on improved VariFocalNet [J]. Journal of Computer Applications, 2024, 44(7): 2200-2207.
[5]	Xiaohui CHENG, Yuntian HUANG, Ruifang ZHANG. Lightweight infrared road scene detection model based on multiscale and weighted coordinate attention [J]. Journal of Computer Applications, 2024, 44(6): 1927-1934.
[6]	Tianhua CHEN, Jiaxuan ZHU, Jie YIN. Bird recognition algorithm based on attention mechanism [J]. Journal of Computer Applications, 2024, 44(4): 1114-1120.
[7]	Wei LI, Ling CHEN, Xiuyuan XU, Min ZHU, Jixiang GUO, Kai ZHOU, Hao NIU, Yuchen ZHANG, Shanye YI, Yi ZHANG, Fengming LUO. Interstitial lung disease segmentation algorithm based on multi-task learning [J]. Journal of Computer Applications, 2024, 44(4): 1285-1293.
[8]	Zhanjun JIANG, Baijing WU, Long MA, Jing LIAN. Faster-RCNN water-floating garbage recognition based on multi-scale feature and polarized self-attention [J]. Journal of Computer Applications, 2024, 44(3): 938-944.
[9]	Yuliang ZHENG, Yunhua CHEN, Weijie BAI, Pinghua CHEN. Vehicle target detection by fusing event data and image frames [J]. Journal of Computer Applications, 2024, 44(3): 931-937.
[10]	Cunyi LIAO, Yi ZHENG, Weijin LIU, Huan YU, Shouyin LIU. Decoupling-fusing algorithm for multiple tasks with autonomous driving environment perception [J]. Journal of Computer Applications, 2024, 44(2): 424-431.
[11]	Yudong PANG, Zhixing LI, Weijie LIU, Tianhao LI, Ningning WANG. Small target detection model in overlooking scenes on tower cranes based on improved real-time detection Transformer [J]. Journal of Computer Applications, 2024, 44(12): 3922-3929.
[12]	Lin WANG, Jingliang LIU, Wuwei WANG. Small target detection method in UAV images based on fusion of dilated convolution and Transformer [J]. Journal of Computer Applications, 2024, 44(11): 3595-3602.
[13]	Tao LIU, Shihong JU, Yimeng GAO. Small object detection algorithm from drone perspective based on improved YOLOv8n [J]. Journal of Computer Applications, 2024, 44(11): 3603-3609.
[14]	Dahai LI, Bingtao LI, Zhendong WANG. Underwater target detection algorithm based on improved YOLOv8 [J]. Journal of Computer Applications, 2024, 44(11): 3610-3616.
[15]	Xiang GUO, Wengang JIANG, Yuhang WANG. Encrypted traffic classification method based on improved Inception-ResNet [J]. Journal of Computer Applications, 2023, 43(8): 2471-2476.