Journal of Computer Applications ›› 2023, Vol. 43 ›› Issue (8): 2611-2618.DOI: 10.11772/j.issn.1001-9081.2022091343
• Multimedia computing and computer simulation • Previous Articles
Meijia LIANG1(), Xinwu LIU2, Xiaopeng HU1,3
Received:
2022-09-15
Revised:
2022-12-20
Accepted:
2023-01-05
Online:
2023-03-02
Published:
2023-08-10
Contact:
Meijia LIANG
About author:
LIU Xinwu, born in 1989, M. S., assistant engineer. His research interests include big data analysis.Supported by:
通讯作者:
梁美佳
作者简介:
刘昕武(1989—),男,湖南株洲人,助理工程师,硕士,主要研究方向:大数据分析基金资助:
CLC Number:
Meijia LIANG, Xinwu LIU, Xiaopeng HU. Small target detection algorithm for train operating environment image based on improved YOLOv3[J]. Journal of Computer Applications, 2023, 43(8): 2611-2618.
梁美佳, 刘昕武, 胡晓鹏. 基于改进YOLOv3的列车运行环境图像小目标检测算法[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2611-2618.
Add to citation manager EndNote|Ris|BibTeX
URL: http://www.joca.cn/EN/10.11772/j.issn.1001-9081.2022091343
输入特征层 | 操作 | 上/下采样倍数 | 输出特征图 |
---|---|---|---|
256×64×64 | 下采样 | 4 | 256×16×16 |
512×32×32 | 下采样 | 2 | 512×16×16 |
1 024×16×16 | — | — | 1 024×16×16 |
Tab. 1 Specific up-sampling or down-sampling operations for different input feature layers
输入特征层 | 操作 | 上/下采样倍数 | 输出特征图 |
---|---|---|---|
256×64×64 | 下采样 | 4 | 256×16×16 |
512×32×32 | 下采样 | 2 | 512×16×16 |
1 024×16×16 | — | — | 1 024×16×16 |
类别 | 训练集样本数 | 测试集样本数 |
---|---|---|
共计 | 26 164 | 6 491 |
person | 5 861 | 1 413 |
locomotive | 8 141 | 2 141 |
car | 284 | 89 |
signal_light | 5 758 | 1 481 |
truck | 195 | 39 |
sign | 1 138 | 275 |
obstacle | 4 787 | 1 053 |
Tab. 2 Information of training set and test set
类别 | 训练集样本数 | 测试集样本数 |
---|---|---|
共计 | 26 164 | 6 491 |
person | 5 861 | 1 413 |
locomotive | 8 141 | 2 141 |
car | 284 | 89 |
signal_light | 5 758 | 1 481 |
truck | 195 | 39 |
sign | 1 138 | 275 |
obstacle | 4 787 | 1 053 |
空洞卷积 | 稠密模块 | 特征融合 | k-means | mAP@0.5 | F1 | FPS |
---|---|---|---|---|---|---|
— | — | — | — | 0.753 | 0.777 | 145 |
— | — | — | √ | 0.802 | 0.823 | 145 |
√ | — | — | — | 0.763 | 0.786 | 136 |
√ | √ | — | — | 0.780 | 0.796 | 131 |
— | — | √ | — | 0.779 | 0.798 | 85 |
√ | √ | √ | — | 0.792 | 0.808 | 83 |
√ | √ | √ | √ | 0.845 | 0.861 | 83 |
Tab. 3 Comparison of experimental results of module ablation
空洞卷积 | 稠密模块 | 特征融合 | k-means | mAP@0.5 | F1 | FPS |
---|---|---|---|---|---|---|
— | — | — | — | 0.753 | 0.777 | 145 |
— | — | — | √ | 0.802 | 0.823 | 145 |
√ | — | — | — | 0.763 | 0.786 | 136 |
√ | √ | — | — | 0.780 | 0.796 | 131 |
— | — | √ | — | 0.779 | 0.798 | 85 |
√ | √ | √ | — | 0.792 | 0.808 | 83 |
√ | √ | √ | √ | 0.845 | 0.861 | 83 |
类别 | YOLOv3 | YOLOv3-TOEI | 类别 | YOLOv3 | YOLOv3-TOEI |
---|---|---|---|---|---|
person | 0.838 | 0.880 | truck | 0.928 | 0.951 |
locomotive | 0.957 | 0.963 | sign | 0.570 | 0.779 |
car | 0.880 | 0.913 | obstacle | 0.528 | 0.680 |
signal_light | 0.571 | 0.745 |
Tab. 4 Comparison of each category AP between YOLOv3 and YOLOv3-TOEI
类别 | YOLOv3 | YOLOv3-TOEI | 类别 | YOLOv3 | YOLOv3-TOEI |
---|---|---|---|---|---|
person | 0.838 | 0.880 | truck | 0.928 | 0.951 |
locomotive | 0.957 | 0.963 | sign | 0.570 | 0.779 |
car | 0.880 | 0.913 | obstacle | 0.528 | 0.680 |
signal_light | 0.571 | 0.745 |
算法 | mAP@0.5 | F1 | FPS |
---|---|---|---|
YOLOv3 | 0.753 | 0.777 | 145 |
YOLOv3-spp | 0.748 | 0.772 | 145 |
YOLOv3-tiny | 0.602 | 0.632 | 431 |
YOLOv4 | 0.775 | 0.710 | 64 |
Faster RCNN | 0.856 | 0.876 | 21 |
SSD | 0.719 | 0.752 | 109 |
YOLOv3-TOEI | 0.845 | 0.861 | 83 |
Tab. 5 Comprehensive comparison of YOLOv3-TOEI and other algorithms
算法 | mAP@0.5 | F1 | FPS |
---|---|---|---|
YOLOv3 | 0.753 | 0.777 | 145 |
YOLOv3-spp | 0.748 | 0.772 | 145 |
YOLOv3-tiny | 0.602 | 0.632 | 431 |
YOLOv4 | 0.775 | 0.710 | 64 |
Faster RCNN | 0.856 | 0.876 | 21 |
SSD | 0.719 | 0.752 | 109 |
YOLOv3-TOEI | 0.845 | 0.861 | 83 |
1 | 李柯泉,陈燕,刘佳晨,等. 基于深度学习的目标检测算法综述[J]. 计算机程, 2022, 48(7):1-12. 10.19678/j.issn.1000-3428.0062725 |
LI K Q, CHEN Y, LIU J C, et al. Survey of deep learning-based object detection algorithms[J]. Computer Engineering, 2022, 48(7):1-12. 10.19678/j.issn.1000-3428.0062725 | |
2 | GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]// Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2014:580-587. 10.1109/cvpr.2014.81 |
3 | GIRSHICK R. Fast R-CNN[C]// Proceedings of the 2015 IEEE International Conference on Computer Vision. Piscataway: IEEE, 2015:1440-1448. 10.1109/iccv.2015.169 |
4 | REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[C]// Proceedings of the 28th International Conference on Neural Information Processing Systems. Cambridge: MIT Press, 2015, 1:91-99. |
5 | REDMON J, FARHADI A. YOLOv3: an incremental improvement[EB/OL]. (2018-04-08) [2022-08-06].. 10.1109/cvpr.2017.690 |
6 | BOCHKOVSKIY A, WANG C Y, LIAO H Y M. YOLOv4: optimal speed and accuracy of object detection[EB/OL]. (2020-04-23) [2022-08-06].. |
7 | LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot multiBox detector[C]// Proceedings of the 2016 European Conference on Computer Vision, LNCS 9905. Cham: Springer, 2016:21-37. |
8 | 熊群芳,林军,刘悦,等. 深度学习研究现状及其在轨道交通领域的应用[J]. 控制与信息技术, 2018(2):1-6. |
XIONG Q F, LIN J, LIU Y, et al. Deep learning and its application in the field of rail transit[J]. Control and Information Technology, 2018(2):1-6. | |
9 | WANG H M, PEI H Y, ZHANG J B. Detection of locomotive signal lights and pedestrians on railway tracks using improved YOLOv4[J]. IEEE Access, 2022, 10:15495-15505. 10.1109/access.2022.3148182 |
10 | 王焕民,张建柏,裴华艳,等. 基于MobileNet-SSD的铁路信号灯检测识别[J]. 兰州交通大学学报, 2020, 39(4):66-70. 10.3969/j.issn.1001-4373.2020.04.010 |
WANG H M, ZHANG J B, PEI H Y, et al. Research on railway signal lamp detection based on MobileNet-SSD[J]. Journal of Lanzhou Jiaotong University, 2020, 39(4):66-70. 10.3969/j.issn.1001-4373.2020.04.010 | |
11 | LU Y D, LI J Y, WANG X T. Abnormal detection of track fastener based on improved YOLOV3 algorithm[C]// Proceedings of the 5th International Conference on Mechanical, Control and Computer Engineering. Piscataway: IEEE, 2020: 1826-1831. 10.1109/icmcce51767.2020.00401 |
12 | YE T, WANG B C, SONG P, et al. Automatic railway traffic object detection system using feature fusion refine neural network under shunting mode[J]. Sensors, 2018, 18(6): No.1916. 10.3390/s18061916 |
13 | KARAGIANNIS G, OLSEN S, PEDERSEN K. Deep learning for detection of railway signs and signals[C]// Proceedings of the 2019 Science and Information Conference, AISC 943. Cham: Springer, 2020: 1-15. 10.1007/978-3-030-17795-9_1 |
14 | YE T, ZHANG X, ZHANG Y, et al. Railway traffic object detection using differential feature fusion convolution neural network[J]. IEEE Transactions on Intelligent Transportation Systems, 2021, 22(3): 1375-1387. 10.1109/tits.2020.2969993 |
15 | 冯号,黄朝兵,文元桥. 基于改进YOLOv3的遥感图像小目标检测[J]. 计算机应用, 2022, 42(12):3723-3732. |
FENG H, HUANG C B, WEN Y Q. Remote sensing image small target detection based on improved YOLOv3[J]. Journal of Computer Applications, 2022, 42(12):3723-3732. | |
16 | HUANG G, LIU Z, L van der MAATEN, et al. Densely connected convolutional networks[C]// Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2017: 2261-2269. 10.1109/cvpr.2017.243 |
17 | LIN T Y, DOLLÁR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]// Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2017: 936-944. 10.1109/cvpr.2017.106 |
18 | TAN M X, PANG R M, LE Q V. EfficientDet: scalable and efficient object detection[C]// Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2020: 10778-10787. 10.1109/cvpr42600.2020.01079 |
19 | HU J, SHEN L, SUN G. Squeeze-and-excitation networks[C]// Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2018:7132-7141. 10.1109/cvpr.2018.00745 |
20 | HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2016: 770-778. 10.1109/cvpr.2016.90 |
21 | YU F, KOLTUN V. Multi-scale context aggregation by dilated convolutions[EB/OL]. (2016-04-30) [2022-07-21].. 10.1109/cvpr.2017.75 |
22 | 曹帅帅. 基于改进YOLOv3的口罩佩戴检测模型研究[D]. 青岛:青岛大学, 2021:45-52. 10.1109/cisai54367.2021.00044 |
CAO S S. Research on mask wearing detection model based on improved YOLOv3[D]. Qingdao: Qingdao University, 2021:45-52. 10.1109/cisai54367.2021.00044 | |
23 | LIU S, QI L, QIN H F, et al. Path aggregation network for instance segmentation[C]// Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2018: 8759-8768. 10.1109/cvpr.2018.00913 |
24 | GHIASI G, LIN T Y, LE Q V. NAS-FPN: learning scalable feature pyramid architecture for object detection[C]// Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2019: 7029-7038. 10.1109/cvpr.2019.00720 |
[1] | Huan LIU, Lianghong WU, Lyu ZHANG, Liang CHEN, Bowen ZHOU, Hongqiang ZHANG. Leukocyte detection method based on twice-fusion-feature CenterNet [J]. Journal of Computer Applications, 2023, 43(8): 2602-2610. |
[2] | Zelin XU, Min YANG, Meng CHEN. Point-of-interest category representation model with spatial and textual information [J]. Journal of Computer Applications, 2023, 43(8): 2456-2461. |
[3] | Doudou LI, Wanggen LI, Yichun XIA, Yang SHU, Kun GAO. Skeleton-based action recognition based on feature interaction and adaptive fusion [J]. Journal of Computer Applications, 2023, 43(8): 2581-2587. |
[4] | Shuai ZHENG, Xiaolong ZHANG, He DENG, Hongwei REN. 3D liver image segmentation method based on multi-scale feature fusion and grid attention mechanism [J]. Journal of Computer Applications, 2023, 43(7): 2303-2310. |
[5] | Ruilin JIANG, Renchao QIN. Multi-neural network malicious code detection model based on depthwise separable convolution [J]. Journal of Computer Applications, 2023, 43(5): 1527-1533. |
[6] | Hui LIU, Linyu ZHANG, Fugang WANG, Rujin HE. Object detection algorithm based on attention mechanism and context information [J]. Journal of Computer Applications, 2023, 43(5): 1557-1564. |
[7] | Kai ZHANG, Zhengchu QIN, Yue LIU, Xinyi QIN. Multi-learning behavior collaborated knowledge tracing model [J]. Journal of Computer Applications, 2023, 43(5): 1422-1429. |
[8] | Jiadong LI, Danpu ZHANG, Yaqiong FAN, Jianfeng YANG. Lightweight ship target detection algorithm based on improved YOLOv5 [J]. Journal of Computer Applications, 2023, 43(3): 923-929. |
[9] | Xueqiang LYU, Yunan ZHANG, Jing HAN, Yunpeng CUI, Huan LI. Table structure recognition model integrating edge features and attention [J]. Journal of Computer Applications, 2023, 43(3): 752-758. |
[10] | Xuedong HE, Shibin XUAN, Kuan WANG, Mengnan CHEN. DeepLabV3+ image segmentation algorithm fusing cumulative distribution function and channel attention mechanism [J]. Journal of Computer Applications, 2023, 43(3): 936-942. |
[11] | Ping WANG, Nan CHEN, Lei LU. Fall detection algorithm based on scene prior and attention guidance [J]. Journal of Computer Applications, 2023, 43(2): 529-535. |
[12] | Gang CHEN, Yongwei LIAO, Zhenguo YANG, Wenying LIU. Image inpainting algorithm of multi-scale generative adversarial network based on multi-feature fusion [J]. Journal of Computer Applications, 2023, 43(2): 536-544. |
[13] | Wenju LI, Gan ZHANG, Liu CUI, Wanghui CHU. Lightweight traffic sign recognition model based on coordinate attention [J]. Journal of Computer Applications, 2023, 43(2): 608-614. |
[14] | Honggang YANG, Jiejie CHEN, Mengfei XU. Bilinear involution neural network for image classification of fundus diseases [J]. Journal of Computer Applications, 2023, 43(1): 259-264. |
[15] | Yuchao LYU, Xi JIANG, Yinghao XU, Xijun ZHU. Improved brachial plexus nerve segmentation method based on multi-scale feature fusion [J]. Journal of Computer Applications, 2023, 43(1): 273-279. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||