同一场景下超大尺度差异物体的识别和定位方法

doi:10.11772/j.issn.1001-9081.2020040466

计算机应用 ›› 2020, Vol. 40 ›› Issue (12): 3520-3525.DOI: 10.11772/j.issn.1001-9081.2020040466

同一场景下超大尺度差异物体的识别和定位方法

王一婷¹, 张柯², 李捷², 郝宗波¹, 段昶^3,4, 朱策⁴

1. 电子科技大学信息与软件工程学院, 成都 610054;
2. 四川九洲电器集团有限责任公司, 四川绵阳, 621000;
3. 西南石油大学电气信息工程学院, 成都 610500;
4. 电子科技大学信息与通信工程学院, 成都 611731

收稿日期:2020-04-14 修回日期:2020-06-08 出版日期:2020-12-10 发布日期:2020-08-11
通讯作者: 郝宗波(1977-),男,河南新乡人,副教授,博士,主要研究方向:视频图像处理。zbhao@uestc.edu.cn
作者简介:王一婷(1996-),女,四川眉山人,硕士研究生,主要研究方向:图像处理;张柯(1983-),男,四川绵阳人,高级工程师,硕士,研究方向:信号与信息处理、人工智能;李捷(1969-),女,山东青州人,正高级工程师,博士,主要研究方向:通信工程、人工智能;段昶(1979-),男,四川遂宁人,讲师,博士,主要研究方向:图像处理、人工智能;朱策(1969-),男,四川自贡人,教授,博士,CCF会员,主要研究方向:图像处理、人工智能
基金资助:
中央军委装备发展部武器装备预研基金资助项目（41412010201）；中央高校基本科研业务费资助项目（A03013023001049）。

Recognition and localization method of super-large-scale variance objects in the same scene

WANG Yiting¹, ZHANG Ke², LI Jie², HAO Zongbo¹, DUAN Chang^3,4, ZHU Ce⁴

1. School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu Sichuan 610054, China;
2. Sichuan Jiuzhou Electric Group Company Limited, Mianyang Sichuan 621000, China;
3. School of Electrical Engineering and Information, Southwest Petroleum University, Chengdu Sichuan 610500, China;
4. School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu Sichuan 611731, China

Received:2020-04-14 Revised:2020-06-08 Online:2020-12-10 Published:2020-08-11
Supported by:
This work is partially supported by the Weapons and Equipment Pre-research Fund of Equipment Development Department of Central Military Commission （41412010201）， the Fundamental Research Funds for the Central Universities （A03013023001049）.

摘要/Abstract

摘要： 近年来，深度学习在物体检测方面取得了非常好的效果和突飞猛进的发展，但在某些特殊场景下，如要求同时检测尺度相差极大的目标物体（相差大于100倍）时，现有的物体识别方法的性能急剧下降。针对同一场景下超大尺度差异物体识别与定位问题，对YOLOv3框架进行了改进，结合图像金字塔技术来提取图像的多尺度特征；并在训练过程中，针对不同尺度的目标提出采用动态交并比（IoU）的策略，此策略可以更好地解决样本不均衡的问题。实验结果表明，该模型对同一场景下超大超小物体的识别能力有了明显的提升。将之应用于机场环境，取得了较好的应用效果。

关键词: 超大尺度差异, 物体识别, YOLOv3, 动态交并比, 深度学习

Abstract: In recent years, deep learning achieves very good results and has great improvement in object detection. However, in some special scenes, for example, when it is required to simultaneously detect objects with greatly different scales (difference greater than 100 times), common object recognition methods' performance will drop dramatically. Aiming at the problem of recognizing and locating objects with super-large-scale variance in the same scene, the You Only Look Once version3 (YOLOv3) framework was improved, the image pyramid technology was combined to extract the multi-scale features of the image. And in the training process, the strategy of using dynamic Intersection over Union (IoU) was proposed for different scale objects, which was able to better solve the problem of sample imbalance. Experimental results show that the proposed model significantly improves the recognition ability of super-large and super-small objects in the same scene. The proposed model has been applied to the airport environment and achieved good application results.

Key words: super-large-scale variance, object recognition, You Only Look Once version3 (YOLOv3), dynamic Intersection over Union (IoU), deep learning

中图分类号:

TP391

王一婷, 张柯, 李捷, 郝宗波, 段昶, 朱策. 同一场景下超大尺度差异物体的识别和定位方法[J]. 计算机应用, 2020, 40(12): 3520-3525.

WANG Yiting, ZHANG Ke, LI Jie, HAO Zongbo, DUAN Chang, ZHU Ce. Recognition and localization method of super-large-scale variance objects in the same scene[J]. Journal of Computer Applications, 2020, 40(12): 3520-3525.

参考文献

[1] REDMON J,DIVVALA S,GIRSHICK R,et al. You Only Look Once:unified,real-time object detection[C]//Proceeding of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2016:779-788
[2] 任培明. 基于YOLO的实时目标检测方法研究[D]. 无锡:江南大学,2019:19-25. (REN P M. Research on real-time target detection method based on YOLO[D]. Wuxi:Jiangnan University,2019:19-25.)
[3] REDMON J,FARHADI A. YOLO9000:better,faster,stronger[C]//Proceeding of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:6517-6525.
[4] REDMON J,FARHADI A. YOLOv3:an incremental improvement[EB/OL].[2019-04-08]. https://arxiv.org/pdf/1804.02767.pdf.
[5] HE K,ZHANG X,REN S,et al. Deep residual learning for image recognition[C]//Proceeding of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2016:770-778
[6] TAN M, LE Q V. EfficientNet:rethinking model scaling for convolutional neuralnetworks[EB/OL].[2019-11-22]. https://arxiv.org/pdf/1905.11946.pdf
[7] 闫世武, 罗金良, 严庆. 基于改进的YOLOv3的目标检测的研究[J]. 智能计算机与应用, 2019, 9(6):312-315.(YAN S W,LUO J L, YAN Q. Research on target detection based on improved YOLOv3[J]. Smart Computer and Applications,2019,9(6):312-315.)
[8] GIRSHICK R,DONAHUE J,DARRELL T,et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceeding of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2014:580-587
[9] GIRSHICK R. Fast R-CNN[C]//Proceeding of the 2015 IEEE Conference on Computer Vision. Piscataway:IEEE,2015:1440-1448
[10] REN S,HE K,GIRSHICK R,et al. Faster R-CNN:towards realtime object detection with region proposalnetworks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017, 39(6):1137-1149.
[11] LIU W,ANGUELOV D,ERHAN D,et a1. SSD:single shot multibox detector[C]//Proceeding of the 2016 European Conference on Computer Vision,LNCS 9905. Cham:Springer, 2016:21-37.
[12] DUAN K,BAI S,XIE L,et al. CenterNet:keypoint triplets for object detection[C]//Proceeding of the 2019 IEEE/CVF International Conference on Computer Vision. Piscataway:IEEE, 2019:6568-6577
[13] 郭继民. 基于深度神经网络的物体识别方法研究与实现[D]. 成都:电子科技大学, 2018:27-32.(GUO J M. Research and implementation of object recognition method based on deep neuralnetwork[D]. Chengdu:University of Electronic Science and Technology of China,2018:27-32.)
[14] LIN T Y,DOLLÁR P,GIRSHICKR,et al. Feature pyramidnetworks for object detection[C]//Proceeding of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:936-944.
[15] HE K,ZHANG X,REN S,et al. Spatial pyramid pooling in deep convolutionalnetworks for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2015, 37(9):1904-1916.

同一场景下超大尺度差异物体的识别和定位方法

Recognition and localization method of super-large-scale variance objects in the same scene

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	郑志强, 胡鑫, 翁智, 王雨禾, 程曦. 基于改进DenseNet的牛眼图像特征提取方法[J]. 计算机应用, 2021, 41(9): 2780-2784.
[2]	陈成瑞, 孙宁, 何世彪, 廖勇. 面向C-V2X通信的基于深度学习的联合信道估计与均衡算法[J]. 计算机应用, 2021, 41(9): 2687-2693.
[3]	谢德峰, 吉建民. 融入句法感知表示进行句法增强的语义解析[J]. 计算机应用, 2021, 41(9): 2489-2495.
[4]	代雨柔, 杨庆, 张凤荔, 周帆. 基于自监督学习的社交网络用户轨迹预测模型[J]. 计算机应用, 2021, 41(9): 2545-2551.
[5]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[6]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[7]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[8]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[9]	何正海, 线岩团, 王蒙, 余正涛. 融合句法指导与字符注意力机制的案情阅读理解方法[J]. 计算机应用, 2021, 41(8): 2427-2431.
[10]	刘双元, 郑王里, 林云汉. 面向三维特征描述子的自适应二进制简化方法[J]. 计算机应用, 2021, 41(7): 2062-2069.
[11]	李亚芳, 梁烨, 冯韦玮, 祖宝开, 康玉健. 基于社区优化的深度网络嵌入方法[J]. 计算机应用, 2021, 41(7): 1956-1963.
[12]	王月, 江逸茗, 兰巨龙. 基于改进三元组网络和K近邻算法的入侵检测[J]. 计算机应用, 2021, 41(7): 1996-2002.
[13]	高钦泉, 黄炳城, 刘文哲, 童同. 基于改进CenterNet的竹条表面缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1933-1938.
[14]	杜炎, 吕良福, 焦一辰. 基于模糊推理的模糊原型网络[J]. 计算机应用, 2021, 41(7): 1885-1890.
[15]	侯笑晗, 金国栋, 谭力宁, 薛远亮. 基于自适应和最优特征的合成孔径雷达舰船检测方法[J]. 计算机应用, 2021, 41(7): 2150-2155.