Real-time object tracking method based on multi-channel kernel correlation filter

doi:10.11772/j.issn.1001-9081.2015.12.3544

Journal of Computer Applications ›› 2015, Vol. 35 ›› Issue (12): 3544-3549.DOI: 10.11772/j.issn.1001-9081.2015.12.3544

• Virtual reality and digital media • Previous Articles Next Articles

Real-time object tracking method based on multi-channel kernel correlation filter

HU Zhaohua^1,2, XING Weiguo¹, HE Jun¹, ZHANG Xiuzai^1,2

1. School of Electronic and Information Engineering, Nanjing University of Information Science and Technology, Nanjing Jiangsu 210044, China;
2. Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing Jiangsu 210044, China

Received:2015-05-18 Revised:2015-08-01 Online:2015-12-10 Published:2015-12-10

多通道核相关滤波的实时跟踪方法

胡昭华^1,2, 邢卫国¹, 何军¹, 张秀再^1,2

1. 南京信息工程大学电子与信息工程学院, 南京 210044;
2. 江苏省大气环境与装备技术协同创新中心, 南京 210044

通讯作者: 胡昭华(1981-),女,安徽马鞍山人,副教授,博士,主要研究方向:视觉跟踪、模式识别
作者简介:邢卫国(1990-),男,江苏滨海人,硕士研究生,主要研究方向:目标跟踪;何军(1978-),男,河南郑州人,讲师,硕士,主要研究方向:计算机视觉、高维数据分析、压缩感知;张秀再(1979-),男,江苏沛县人,副教授,博士,主要研究方向:信号与信息处理。
基金资助:
国家自然科学基金资助项目(61203273);江苏省自然科学基金资助项目(BK20141004);江苏省普通高校自然科学研究项目(11KJB510009,14KJB510019);江苏高校优势学科Ⅱ期建设工程项目。

Abstract

Abstract: The most existing algorithms have to build the complex model and draw a large number of training samples to achieve accurate object tracking,which will produce large amount of calculation. The proposed problem is not conducive to real-time tracking. In order to solve the problem, a real-time tracking method based on multi-channel kernel correlation filter was presented. Firstly, the target information of video frames were trained by using the nucleation ridge regression method to get the filter template. Secondly, the filter template was utilized to carry out the correlation measure for the possible area of the frame to be detected. Finally, the most relevant location was considered as the tracking result and the independent inputs of multiple channels were weighted and then added to solve the problem of multi-channel input. A large number of comparison experiments with the existing tracking methods show that, the proposed method guarantees the tracking accuracy and its tracking speed also has obvious advantages under different challenge factors. The proposed method avoids to extract a large number of samples by the correlation filter and use the dot product of frequency domain to replace the correlation operation of time-domain, which greatly reduces the computational complexity and makes the tracking speed completely meet the tracking demand of real-time scenario.

Key words: visual tracking, correlation filter, kernel function, real-time

摘要： 现有跟踪算法大都需要构建复杂的外观模型、抽取大量训练样本来实现精确的目标跟踪,会产生庞大的计算量,不利于实时跟踪。鉴于此,提出了一种多通道核相关滤波的实时跟踪方法。首先,利用核化岭回归方法对视频帧的目标信息进行训练,学习得到滤波模板;接着,用滤波模板对待检测帧的可能区域进行相关性度量;最后,将相关度最高的位置作为跟踪结果,并通过对多通道的独立输入进行加权求和,解决多通道输入问题。与现有跟踪方法的大量对比实验表明,在不同的挑战因素下,该方法在保证跟踪精度的同时,跟踪速度也存在明显优势。该方法通过相关滤波的方式可避免抽取大量样本,并利用频域的点乘代替时域的相关运算,大大降低了计算复杂度,使跟踪速度完全满足实时场景的跟踪需求。

关键词: 视觉跟踪, 相关滤波, 核函数, 实时性

CLC Number:

TP391.41

HU Zhaohua, XING Weiguo, HE Jun, ZHANG Xiuzai. Real-time object tracking method based on multi-channel kernel correlation filter[J]. Journal of Computer Applications, 2015, 35(12): 3544-3549.

胡昭华, 邢卫国, 何军, 张秀再. 多通道核相关滤波的实时跟踪方法[J]. 计算机应用, 2015, 35(12): 3544-3549.

References

[1] DANELLJAN M, KHAN F S, FELSBERG M, et al. Adaptive color attributes for real-time visual tracking[C]//CVPR 2014:Proceedings of the 2014 Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2014:1090-1097.
[2] HENRIQUES J F, CASEIRO R, MARTINS P. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 37(3):583-596.
[3] ZHANG K, ZHANG L, LIU Q, et al. Fast visual tracking via dense spatio-temporal context learning[C]//ECCV 2014:Proceedings of the 13th European Conference on Computer Vision, LNCS 8693. Berlin:Springer, 2014:127-141.
[4] PENG S, PENG X. Object tracking with efficient multiple instance learning[J]. Journal of Computer Applications, 2015, 35(2):466-469. (彭爽,彭晓明.基于高效多示例学习的目标跟踪[J].计算机应用,2015,35(2):466-469.)
[5] ZHONG W. Robust object tracking via sparsity-based collaborative model[C]//CVPR 2012:Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2012:1838-1845.
[6] ROSS D, LIM J, LIN R-S, et al.Incremental learning for robust visual tracking[J]. International Journal of Computer Vision, 2008, 77(1/2/3):125-141.
[7] MENG J, LIU J, HAN M. Marginalized particle filter for combined feature target-tracking[J]. Journal of Application Research of Computers, 2015, 32(7):135-144. (孟军英,刘教民,韩明.基于联合特征的边缘粒子滤波目标跟踪算法研究[J].计算机应用研究,2015,32(7):135-144.)
[8] YANG F, LU H, YANG M. Robust super-pixel tracking[J]. IEEE Transaction on Image Processing, 2014, 23(4):1639-1651.
[9] BABENKO B, YANG M-H, BELONGIE S. Robust object tracking with online multiple instance learning[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(8):1619-1632.
[10] YANG F, LU H, YANG M. Robust visual tracking via multiple kernel boosting with affinity constraints[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(2):242-254.
[11] ZHANG K, ZHANG L, YANG M. Real-time object tracking via online discriminative feature selection[J]. IEEE Transactions on Image Processing, 2013, 22(12):4664-4677.
[12] BOLME D, BEVERIDGE J, B DRAPER, et al.Visual object tracking using adaptive correlation filters[C]//CVPR 2010:Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2010:2544-2550.
[13] HENRIQUES J, CASEIRO R, MARTINS P, et al.Exploiting the circulant structure of tracking-by-detection with kernels[C]//ECCV 2012:Proceedings of the 2012 European Conference on Computer Vision. Berlin:Springer, 2012:702-715.
[14] RIFKIN R, YEO G, POGGIO T. Regularized least-squares classification[M]//Advances in Learning Theory:Methods, Models and Applications. Amsterdam:IOS Press, 2003:131-154.
[15] MESSERSCHMITT D G. Stationary points of a real-valued function of a complex variable, UCB/EECS-2006-93[R]. Berkeley:University of California, EECS Department, 2006:1-8
[16] KALAL Z, MIKOLAJCZYK K, MATAS J. Tracking-learning-detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(7):1409-1422.
[17] JIA X, LU H, YANG M. Visual tracking via adaptive structural local sparse appearance model[C]//CVPR 2012:Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2012:1822-1829.
[18] ADAM A, RIVLIN E, SHIMSHONI I. Robust fragments-based tracking using the integral histogram[C]//CVPR 2006:Proceedings of the 2006 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2006:798-805.
[19] HARE S, SAFFARI A, TORR P H S. Struck:structured output tracking with kernels[C]//ICCV 2011:Proceedings of the 2011 International Conference on Computer Vision. Piscataway:IEEE, 2011:263-270.
[20] WU Y, LIM J, YANG M. Online object tracking:a benchmark[C]//CVPR 2013:Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2013:2411-2418.

Real-time object tracking method based on multi-channel kernel correlation filter

多通道核相关滤波的实时跟踪方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	Wentao JIANG, Wanxuan LI, Shengchong ZHANG. Correlation filtering based target tracking with nonlinear temporal consistency [J]. Journal of Computer Applications, 2024, 44(8): 2558-2570.
[2]	Zheng WU, Zhiyou CHENG, Zhentian WANG, Chuanjian WANG, Sheng WANG, Hui XU. Deep learning-based classification of head movement amplitude during patient anaesthesia resuscitation [J]. Journal of Computer Applications, 2024, 44(7): 2258-2263.
[3]	Yaping DENG, Yingjiang LI. Review of YOLO algorithm and its applications to object detection in autonomous driving scenes [J]. Journal of Computer Applications, 2024, 44(6): 1949-1958.
[4]	Xiaogang SONG, Dongdong ZHANG, Pengfei ZHANG, Li LIANG, Xinhong HEI. Real-time object detection algorithm for complex construction environments [J]. Journal of Computer Applications, 2024, 44(5): 1605-1612.
[5]	Yudong PANG, Zhixing LI, Weijie LIU, Tianhao LI, Ningning WANG. Small target detection model in overlooking scenes on tower cranes based on improved real-time detection Transformer [J]. Journal of Computer Applications, 2024, 44(12): 3922-3929.
[6]	Qiumei ZHENG, Weiwei NIU, Fenghua WANG, Dan ZHAO. Dual-branch real-time semantic segmentation network based on detail enhancement [J]. Journal of Computer Applications, 2024, 44(10): 3058-3066.
[7]	Dongying ZHU, Yong ZHONG, Guanci YANG, Yang LI. Research progress on motion segmentation of visual localization and mapping in dynamic environment [J]. Journal of Computer Applications, 2023, 43(8): 2537-2545.
[8]	Qingyu JIA, Liang CHANG, Xianyi YANG, Baohua QIANG, Shihao ZHANG, Wu XIE, Minghao YANG. Real-time reconstruction method of visual information for manipulator operation [J]. Journal of Computer Applications, 2023, 43(4): 1255-1260.
[9]	Qiangqiang QIN, Junguo LIAO, Yixun ZHOU. Small object detection algorithm based on split mixed attention [J]. Journal of Computer Applications, 2023, 43(11): 3579-3586.
[10]	Zixing YU, Shaojun QU, Xin HE, Zhuo WANG. High-low dimensional feature guided real-time semantic segmentation network [J]. Journal of Computer Applications, 2023, 43(10): 3077-3085.
[11]	Jun MA, Zhen YAO, Cuifeng XU, Shouhong CHEN. Multi-UAV real-time tracking algorithm based on improved PP-YOLO and Deep-SORT [J]. Journal of Computer Applications, 2022, 42(9): 2885-2892.
[12]	Hanlun LI, Jianguo REN. Malware propagation model based on characteristic behavior detection in P2P networks [J]. Journal of Computer Applications, 2022, 42(7): 2125-2131.
[13]	Juan WANG, Xuliang YUAN, Minghu WU, Liquan GUO, Zishan LIU. Real-time semantic segmentation method based on squeezing and refining network [J]. Journal of Computer Applications, 2022, 42(7): 1993-2000.
[14]	Jing QIN, Fali SUN, Fang HUI, Zumin WANG, Bing GAO, Changqing JI. Review of key technology and application of wearable electroencephalogram device [J]. Journal of Computer Applications, 2022, 42(4): 1029-1035.
[15]	Yunzhi QIU, Tinghua WANG, Xiaolu DAI. Doubly feature-weighted fuzzy support vector machine [J]. Journal of Computer Applications, 2022, 42(3): 683-687.