Object tracking algorithm combining re-detection mechanism and convolutional regression network

doi:10.11772/j.issn.1001-9081.2018122593

Journal of Computer Applications ›› 2019, Vol. 39 ›› Issue (8): 2247-2251.DOI: 10.11772/j.issn.1001-9081.2018122593

• Artificial intelligence • Previous Articles Next Articles

Object tracking algorithm combining re-detection mechanism and convolutional regression network

JIA Yongchao, HE Xiaowei, ZHENG Zhonglong

College of Mathematics and Computer Science, Zhejiang Normal University, Jinhua Zhejiang 321004, China

Received:2019-01-02 Revised:2019-03-08 Online:2019-03-28 Published:2019-08-10
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61572023, 61672467).

融合重检测机制的卷积回归网络目标跟踪算法

贾永超, 何小卫, 郑忠龙

浙江师范大学数学与计算机科学学院, 浙江金华 321004

通讯作者: 何小卫
作者简介:贾永超(1989-),男,河北迁安人,硕士研究生,主要研究方向:人工智能、目标跟踪;何小卫(1968-),男,浙江金华人,教授,硕士,主要研究方向:图像视频处理、机器学习、区块链;郑忠龙(1975-),男,河北石家庄人,教授,博士生导师,博士,主要研究方向:机器学习、模式识别、图像处理、区块链。
基金资助:
国家自然科学基金资助项目（61572023，61672467）。

Abstract

Abstract: Concerning the problem that Context-Ware Correlation Filter (CACF) algorithm based on artificial features has poor tracking performance under the situations of deformation, motion blur and low resolution and when the tracker encounters conditions like severe occlusion, it is easy to fall into local optimum and cause tracking failure, a new object tracking algorithm combining re-detection mechanism and Convolutional Regression Network (CRN) was proposed. In the training phase, the correlation filter was integrated into the deep neural network as a CRN layer, so that the network became a whole for end-to-end training. In the tracking phase, different network layers and their response values were merged through residual connections. At the same time, a re-detection mechanism was introduced to make the tracking algorithm recover from the potential tracking failure, and the re-detector would be activated when the response value was lower than the given threshold. Experimental results on the dataset OTB-2013 show that the proposed algorithm achieves 88.1% accuracy on 50 video sequences, which is 9.7 percentage points higher than the accuracy of original CACF algorithm, and has better results compared with original algorithm on video sequences with attributes like deformation and motion blur.

Key words: object tracking, correlation filter, Convolution Regression Network (CRN), end-to-end, re-detection

摘要： 针对基于人工特征的背景感知相关滤波（CACF）算法在形变、运动模糊、低分辨率情形跟踪效果较差以及跟踪器遇到严重遮挡等情形容易陷入局部最优而导致跟踪失败的问题，提出一种融合重检测机制的卷积回归网络（CRN）目标跟踪算法。在训练阶段，将相关滤波作为CRN层融入进深度神经网络，使网络成为一个整体进行端到端训练；在跟踪阶段，通过残差连接融合不同网络层及其响应值，同时引入重检测机制使算法从潜在的跟踪失败中恢复，当响应值低于给定阈值时激活检测器。在数据集OTB-2013上的实验表明，所提算法在50个视频序列上精确度达到88.1%，相比原始CACF算法提高9.7个百分点，在具有形变、运动模糊等属性的视频序列上相比原始算法表现更优秀。

关键词: 目标跟踪, 相关滤波, 卷积回归网络, 端到端, 重检测

CLC Number:

JIA Yongchao, HE Xiaowei, ZHENG Zhonglong. Object tracking algorithm combining re-detection mechanism and convolutional regression network[J]. Journal of Computer Applications, 2019, 39(8): 2247-2251.

贾永超, 何小卫, 郑忠龙. 融合重检测机制的卷积回归网络目标跟踪算法[J]. 计算机应用, 2019, 39(8): 2247-2251.

References

[1] YILMAZ A, JAVED O, SHAH M. Object tracking:a survey[J]. ACM Computing Surveys, 2006, 38(4):13-55.
[2] CHENG Y. Mean shift, mode seeking clustering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, 17(8):790-799.
[3] COMANICIU D, RAMESH V, MEER P. Real-time tracking of non-rigid objects using mean shift[C]//Proceedings of the 2003 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2003:2002-2142.
[4] DOUCET A, de FREITAS N, GORDON N. Sequential Monte Carlo Methods in Practice[M]. Berlin:Springer, 2001:496-497.
[5] RISTIC B, ARULAMPALAM S, GORDON N. Beyond the Kalman filter-particle filters for tracking applications[J]. IEEE Transactions on Aerospace and Electronic Systems, 2003, 18(5):37-38.
[6] DANELLJAN M, KHAN F S, FELSBERG M, et al. Adaptive color attributes for real-time visual tracking[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2014:1090-1097.
[7] BOLME D S, BEVERIDGE J R, DRAPER B A, et al. Visual object tracking using adaptive correlation filters[C]//Proceedings of the 2010 Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2010:2544-2550.
[8] HENRIQUES J F, RUI C, MARTINS P, et al. Exploiting the circulant structure of tracking-by-detection with kernels[C]//Proceedings of the 2012 European Conference on Computer Vision, LNCS 7575. Berlin:Springer, 2012:702-715.
[9] HENRIQUES J F, RUI C, MARTINS P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3):583-596.
[10] MUELLER M, SMITH N, GHANEM B. Context-aware correlation filter tracking[C]//Proceedings of the 2017 Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2017:1387-1395.
[11] 管皓,薛向阳,安志勇.深度学习在视频目标跟踪中的应用进展与展望[J].自动化学报,2016,42(6):834-847. (GUAN H, XUE X Y, AN Z Y. Advances on application of deep learning for video-object tracking[J]. Acta Automatica Sinica, 2016, 42(6):834-847.)
[12] 王鑫,侯志强,余旺盛,等.基于多层卷积特征融合的目标尺度自适应稳健跟踪[J].光学学报,2017,37(11):232-243. (WANG X, HOU Z Q, YU W S, et al. Target scale adaptive robust tracking based on fusion of multilayer convolutional features[J]. Acta Optica Sinica, 2017, 37(11):232-243.)
[13] MA C, HUANG J-B, YANG X K, et al. Hierarchical convolutional features for visual tracking[C]//Proceedings of the 2015 IEEE International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 2015:3074-3082.
[14] 熊昌镇,车满强,王润玲.基于稀疏卷积特征和相关滤波的实时视觉跟踪算法[J].计算机应用,2018,38(8):2175-2179. (XIONG C Z, CHE M Q, WANG R L. Real-time visual tracking algorithm based on correlation filters and sparse convolutional features[J]. Journal of Computer Applications, 2018, 38(8):2175-2179.)
[15] QI Y, ZHANG S, QIN L, et al. Hedged deep tracking[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Washington,DC:IEEE Computer Society, 2016:4303-4311.
[16] WU Y, LIM J, YANG M-H. Online object tracking:a benchmark[C]//Proceedings of the 2013 Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2013:2411-2418.
[17] BERTINETTO L, VALMADRE J, HENRIQUES J F, et al. Fully-convolutional siamese networks for object tracking[C]//Proceedings of the 2016 European Conference on Computer Vision, LNCS 9914. Cham:Springer, 2016:850-865.

Object tracking algorithm combining re-detection mechanism and convolutional regression network

融合重检测机制的卷积回归网络目标跟踪算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	JI Zhangjian, REN Xingwang. Object tracking algorithm of fully-convolutional Siamese networks with rotation and scale estimation [J]. Journal of Computer Applications, 2021, 41(9): 2705-2711.
[2]	GUO Shuai, SU Yang. Encrypted traffic classification method based on data stream [J]. Journal of Computer Applications, 2021, 41(5): 1386-1391.
[3]	WANG Ning, SONG Huihui, ZHANG Kaihua. Accurate object tracking algorithm based on distance weighting overlap prediction and ellipse fitting optimization [J]. Journal of Computer Applications, 2021, 41(4): 1100-1105.
[4]	ZHONG Sha, HUANG Yuqing. Specified object tracking of unmanned aerial vehicle based on Siamese region proposal network [J]. Journal of Computer Applications, 2021, 41(2): 523-529.
[5]	WU Saisai, LIANG Xiaohe, XIE Nengfu, ZHOU Ailian, HAO Xinning. Annotation method for joint extraction of domain-oriented entities and relations [J]. Journal of Computer Applications, 2021, 41(10): 2858-2863.
[6]	HU Xuemin, TONG Xiuchi, GUO Lin, ZHANG Ruohan, KONG Li. End-to-end autonomous driving model based on deep visual attention neural network [J]. Journal of Computer Applications, 2020, 40(7): 1926-1931.
[7]	CHEN Xiukai, LU Zhihua, ZHOU Yu. Speech separation algorithm based on convolutional encoder decoder and gated recurrent unit [J]. Journal of Computer Applications, 2020, 40(7): 2137-2141.
[8]	ZHANG Jie, CHANG Tianqing, DAI Wenjun, GUO Libin, ZHANG Lei. Object tracking algorithm based on correlation filtering and color probability model [J]. Journal of Computer Applications, 2020, 40(6): 1774-1782.
[9]	XU Xiaochao, YAN Hua. Target tracking algorithm based on kernelized correlation filter with block-based model [J]. Journal of Computer Applications, 2020, 40(3): 683-688.
[10]	SHI Guoqiang, ZHAO Xia. Object tracking algorithm based on jointly-optimized strong-coupled Siamese region proposal network [J]. Journal of Computer Applications, 2020, 40(10): 2822-2830.
[11]	LI Minze, LI Xiaoxia, WANG Xueyuan, SUN Wei. Real-time facial expression recognition based on convolutional neural network with multi-scale kernel feature [J]. Journal of Computer Applications, 2019, 39(9): 2568-2574.
[12]	QIU Zeyu, QU Dan, ZHANG Lianhai. End-to-end speech synthesis based on WaveNet [J]. Journal of Computer Applications, 2019, 39(5): 1325-1329.
[13]	YANG Chunde, LIU Jing, QU Zhong. Fast scale adaptive object tracking algorithm with separating window [J]. Journal of Computer Applications, 2019, 39(4): 1145-1149.
[14]	HU Xiuhua, WANG Changyuan, XIAO Feng, WANG Yawen. Object tracking algorithm based on correlation filter with spatial structure information [J]. Journal of Computer Applications, 2019, 39(4): 1150-1156.
[15]	PAN Peike, WANG Yan, LUO Yong, ZHOU Jiliu. Automatic segmentation of nasopharyngeal neoplasm in MR image based on U-net model [J]. Journal of Computer Applications, 2019, 39(4): 1183-1188.