Recognition and localization method of super-large-scale variance objects in the same scene

doi:10.11772/j.issn.1001-9081.2020040466

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (12): 3520-3525.DOI: 10.11772/j.issn.1001-9081.2020040466

• Artificial intelligence • Previous Articles Next Articles

Recognition and localization method of super-large-scale variance objects in the same scene

WANG Yiting¹, ZHANG Ke², LI Jie², HAO Zongbo¹, DUAN Chang^3,4, ZHU Ce⁴

1. School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu Sichuan 610054, China;
2. Sichuan Jiuzhou Electric Group Company Limited, Mianyang Sichuan 621000, China;
3. School of Electrical Engineering and Information, Southwest Petroleum University, Chengdu Sichuan 610500, China;
4. School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu Sichuan 611731, China

Received:2020-04-14 Revised:2020-06-08 Online:2020-12-10 Published:2020-08-11
Supported by:
This work is partially supported by the Weapons and Equipment Pre-research Fund of Equipment Development Department of Central Military Commission （41412010201）， the Fundamental Research Funds for the Central Universities （A03013023001049）.

同一场景下超大尺度差异物体的识别和定位方法

王一婷¹, 张柯², 李捷², 郝宗波¹, 段昶^3,4, 朱策⁴

1. 电子科技大学信息与软件工程学院, 成都 610054;
2. 四川九洲电器集团有限责任公司, 四川绵阳, 621000;
3. 西南石油大学电气信息工程学院, 成都 610500;
4. 电子科技大学信息与通信工程学院, 成都 611731

通讯作者: 郝宗波(1977-),男,河南新乡人,副教授,博士,主要研究方向:视频图像处理。zbhao@uestc.edu.cn
作者简介:王一婷(1996-),女,四川眉山人,硕士研究生,主要研究方向:图像处理;张柯(1983-),男,四川绵阳人,高级工程师,硕士,研究方向:信号与信息处理、人工智能;李捷(1969-),女,山东青州人,正高级工程师,博士,主要研究方向:通信工程、人工智能;段昶(1979-),男,四川遂宁人,讲师,博士,主要研究方向:图像处理、人工智能;朱策(1969-),男,四川自贡人,教授,博士,CCF会员,主要研究方向:图像处理、人工智能
基金资助:
中央军委装备发展部武器装备预研基金资助项目（41412010201）；中央高校基本科研业务费资助项目（A03013023001049）。

Abstract

Abstract: In recent years, deep learning achieves very good results and has great improvement in object detection. However, in some special scenes, for example, when it is required to simultaneously detect objects with greatly different scales (difference greater than 100 times), common object recognition methods' performance will drop dramatically. Aiming at the problem of recognizing and locating objects with super-large-scale variance in the same scene, the You Only Look Once version3 (YOLOv3) framework was improved, the image pyramid technology was combined to extract the multi-scale features of the image. And in the training process, the strategy of using dynamic Intersection over Union (IoU) was proposed for different scale objects, which was able to better solve the problem of sample imbalance. Experimental results show that the proposed model significantly improves the recognition ability of super-large and super-small objects in the same scene. The proposed model has been applied to the airport environment and achieved good application results.

Key words: super-large-scale variance, object recognition, You Only Look Once version3 (YOLOv3), dynamic Intersection over Union (IoU), deep learning

摘要： 近年来，深度学习在物体检测方面取得了非常好的效果和突飞猛进的发展，但在某些特殊场景下，如要求同时检测尺度相差极大的目标物体（相差大于100倍）时，现有的物体识别方法的性能急剧下降。针对同一场景下超大尺度差异物体识别与定位问题，对YOLOv3框架进行了改进，结合图像金字塔技术来提取图像的多尺度特征；并在训练过程中，针对不同尺度的目标提出采用动态交并比（IoU）的策略，此策略可以更好地解决样本不均衡的问题。实验结果表明，该模型对同一场景下超大超小物体的识别能力有了明显的提升。将之应用于机场环境，取得了较好的应用效果。

关键词: 超大尺度差异, 物体识别, YOLOv3, 动态交并比, 深度学习

CLC Number:

TP391

WANG Yiting, ZHANG Ke, LI Jie, HAO Zongbo, DUAN Chang, ZHU Ce. Recognition and localization method of super-large-scale variance objects in the same scene[J]. Journal of Computer Applications, 2020, 40(12): 3520-3525.

王一婷, 张柯, 李捷, 郝宗波, 段昶, 朱策. 同一场景下超大尺度差异物体的识别和定位方法[J]. 计算机应用, 2020, 40(12): 3520-3525.

References

[1] REDMON J,DIVVALA S,GIRSHICK R,et al. You Only Look Once:unified,real-time object detection[C]//Proceeding of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2016:779-788
[2] 任培明. 基于YOLO的实时目标检测方法研究[D]. 无锡:江南大学,2019:19-25. (REN P M. Research on real-time target detection method based on YOLO[D]. Wuxi:Jiangnan University,2019:19-25.)
[3] REDMON J,FARHADI A. YOLO9000:better,faster,stronger[C]//Proceeding of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:6517-6525.
[4] REDMON J,FARHADI A. YOLOv3:an incremental improvement[EB/OL].[2019-04-08]. https://arxiv.org/pdf/1804.02767.pdf.
[5] HE K,ZHANG X,REN S,et al. Deep residual learning for image recognition[C]//Proceeding of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2016:770-778
[6] TAN M, LE Q V. EfficientNet:rethinking model scaling for convolutional neuralnetworks[EB/OL].[2019-11-22]. https://arxiv.org/pdf/1905.11946.pdf
[7] 闫世武, 罗金良, 严庆. 基于改进的YOLOv3的目标检测的研究[J]. 智能计算机与应用, 2019, 9(6):312-315.(YAN S W,LUO J L, YAN Q. Research on target detection based on improved YOLOv3[J]. Smart Computer and Applications,2019,9(6):312-315.)
[8] GIRSHICK R,DONAHUE J,DARRELL T,et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceeding of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2014:580-587
[9] GIRSHICK R. Fast R-CNN[C]//Proceeding of the 2015 IEEE Conference on Computer Vision. Piscataway:IEEE,2015:1440-1448
[10] REN S,HE K,GIRSHICK R,et al. Faster R-CNN:towards realtime object detection with region proposalnetworks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017, 39(6):1137-1149.
[11] LIU W,ANGUELOV D,ERHAN D,et a1. SSD:single shot multibox detector[C]//Proceeding of the 2016 European Conference on Computer Vision,LNCS 9905. Cham:Springer, 2016:21-37.
[12] DUAN K,BAI S,XIE L,et al. CenterNet:keypoint triplets for object detection[C]//Proceeding of the 2019 IEEE/CVF International Conference on Computer Vision. Piscataway:IEEE, 2019:6568-6577
[13] 郭继民. 基于深度神经网络的物体识别方法研究与实现[D]. 成都:电子科技大学, 2018:27-32.(GUO J M. Research and implementation of object recognition method based on deep neuralnetwork[D]. Chengdu:University of Electronic Science and Technology of China,2018:27-32.)
[14] LIN T Y,DOLLÁR P,GIRSHICKR,et al. Feature pyramidnetworks for object detection[C]//Proceeding of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:936-944.
[15] HE K,ZHANG X,REN S,et al. Spatial pyramid pooling in deep convolutionalnetworks for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2015, 37(9):1904-1916.

Recognition and localization method of super-large-scale variance objects in the same scene

同一场景下超大尺度差异物体的识别和定位方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[2]	XU Jianglang, LI Linyan, WAN Xinjun, HU Fuyuan. Indoor scene recognition method combined with object detection [J]. Journal of Computer Applications, 2021, 41(9): 2720-2725.
[3]	CHEN Chengrui, SUN Ning, HE Shibiao, LIAO Yong. Deep learning-based joint channel estimation and equalization algorithm for C-V2X communications [J]. Journal of Computer Applications, 2021, 41(9): 2687-2693.
[4]	XIE Defeng, JI Jianmin. Syntax-enhanced semantic parsing with syntax-aware representation [J]. Journal of Computer Applications, 2021, 41(9): 2489-2495.
[5]	DAI Yurou, YANG Qing, ZHANG Fengli, ZHOU Fan. Trajectory prediction model of social network users based on self-supervised learning [J]. Journal of Computer Applications, 2021, 41(9): 2545-2551.
[6]	ZHENG Zhiqiang, HU Xin, WENG Zhi, WANG Yuhe, CHENG Xi. Cattle eye image feature extraction method based on improved DenseNet [J]. Journal of Computer Applications, 2021, 41(9): 2780-2784.
[7]	CAO Yuhong, XU Hai, LIU Sun'ao, WANG Zixiao, LI Hongliang. Review of deep learning-based medical image segmentation [J]. Journal of Computer Applications, 2021, 41(8): 2273-2287.
[8]	QIN Binbin, PENG Liangkang, LU Xiangming, QIAN Jiangbo. Research progress on driver distracted driving detection [J]. Journal of Computer Applications, 2021, 41(8): 2330-2337.
[9]	HE Zhenghai, XIAN Yantuan, WANG Meng, YU Zhengtao. Case reading comprehension method combining syntactic guidance and character attention mechanism [J]. Journal of Computer Applications, 2021, 41(8): 2427-2431.
[10]	LIU Shuangyuan, ZHENG Wangli, LIN Yunhan. Adaptive binary simplification method for 3D feature descriptor [J]. Journal of Computer Applications, 2021, 41(7): 2062-2069.
[11]	LI Yafang, LIANG Ye, FENG Weiwei, ZU Baokai, KANG Yujian. Deep network embedding method based on community optimization [J]. Journal of Computer Applications, 2021, 41(7): 1956-1963.
[12]	DU Yan, LYU Liangfu, JIAO Yichen. Fuzzy prototype network based on fuzzy reasoning [J]. Journal of Computer Applications, 2021, 41(7): 1885-1890.
[13]	WANG Yue, JIANG Yiming, LAN Julong. Intrusion detection based on improved triplet network and K-nearest neighbor algorithm [J]. Journal of Computer Applications, 2021, 41(7): 1996-2002.
[14]	HOU Xiaohan, JIN Guodong, TAN Lining, XUE Yuanliang. Synthetic aperture radar ship detection method based on self-adaptive and optimal features [J]. Journal of Computer Applications, 2021, 41(7): 2150-2155.
[15]	GAO Qinquan, HUANG Bingcheng, LIU Wenzhe, TONG Tong. Bamboo strip surface defect detection method based on improved CenterNet [J]. Journal of Computer Applications, 2021, 41(7): 1933-1938.