动态的加权孪生网络跟踪算法

doi:10.11772/j.issn.1001-9081.2019122195

计算机应用 ›› 2020, Vol. 40 ›› Issue (8): 2214-2218.DOI: 10.11772/j.issn.1001-9081.2019122195

动态的加权孪生网络跟踪算法

熊昌镇, 李言

城市道路交通智能控制技术北京市重点实验室(北方工业大学), 北京 100144

收稿日期:2019-12-31 修回日期:2020-03-10 出版日期:2020-08-10 发布日期:2020-05-13
通讯作者: 熊昌镇(1979-),男,福建建宁人,副教授,博士,主要研究方向:深度学习、视频分析,xczkiong@163.com
作者简介:李言(1994-),男,北京人,硕士研究生,主要研究方向:目标跟踪。
基金资助:
国家重点研发计划项目（2017YFC0821102）。

Dynamic weighted siamese network tracking algorithm

XIONG Changzhen, LI Yan

Beijing Key Laboratory of Urban Road Transportation Intelligent Control Technology(North China University of Technology), Beijing 100144, China

Received:2019-12-31 Revised:2020-03-10 Online:2020-08-10 Published:2020-05-13
Supported by:
This work is partially supported by the National Key Research and Development Program of China (2017YFC0821102).

摘要/Abstract

摘要： 为提升快速在线目标跟踪与分割算法的跟踪精度，提出了一种动态的加权孪生网络跟踪算法。首先，对初始帧提取的模板特征与每帧提取的模板特征进行学习融合，提高跟踪器的泛化能力；其次，在掩膜分支产生目标掩膜的过程中用加权的方式融合特征，减少冗余特征带来的干扰，提高跟踪的精度。在数据集VOT2016和VOT2018上进行测试，所提算法的预期平均重叠率分别为0.450和0.390，精确性分别为0.649和0.618，鲁棒性分别为0.205和0.267，均高于基准算法，跟踪速度为34帧/s，达到了实时跟踪的要求。所提算法有效地提高了跟踪的准确性，能在复杂的跟踪环境下较好地完成跟踪任务。

关键词: 视觉跟踪, 孪生网络, 卷积神经网络, 模板更新, 加权融合

Abstract: In order to improve the tracking accuracy of fast online target tracking and segmentation algorithm, a dynamic weighted siamese network tracking algorithm was proposed. First, the template features extracted from the initial frame and the template features extracted from each frame were learned and fused to improve the generalization ability of the tracker. Second, in the process of obtaining the target mask by the mask branch, the features were fused in a weighting method, so as to reduce the interference caused by redundant features and improve the tracking accuracy. The algorithm was evaluated on the VOT2016 and VOT2018 datasets. The results show that the proposed algorithm has the expected average overlap rate of 0.450 and 0.390 respectively, the accuracy of 0.649 and 0.618 respectively, and the robustness of 0.205 and 0.267 respectively, all of which are higher than those of baseline algorithm. The tracking speed of the proposed algorithm is 34 frame/s, which meets the requirements of real-time tracking. The proposed algorithm effectively improves the tracking accuracy, and completes the tracking task well in a complex tracking environment.

Key words: visual tracking, siamese network, Convolutional Neural Network (CNN), template update, weighted fusion

中图分类号:

TP391.41

熊昌镇, 李言. 动态的加权孪生网络跟踪算法[J]. 计算机应用, 2020, 40(8): 2214-2218.

XIONG Changzhen, LI Yan. Dynamic weighted siamese network tracking algorithm[J]. Journal of Computer Applications, 2020, 40(8): 2214-2218.

参考文献

[1] BERTINETTO L, VALMADRE J, HENRIQUES J F, et al. Fully-convolutional Siamese networks for object tracking[C]//Proceedings of the 14th European Conference on Computer Vision, LNCS 9914. Cham:Springer, 2016:850-865.
[2] 杨康,宋慧慧,张开华. 基于双重注意力孪生网络的实时视觉跟踪[J]. 计算机应用, 2019, 39(6):1652-1656. (YANG K, SONG H H, ZHANG K H. Real-time visual tracking based on dual attention siamese network[J]. Journal of Computer Applications, 2019, 39(6):1652-1656.)
[3] HELD D, THRUN S, SAVARESE S. Learning to track at 100 FPS with deep regression networks[C]//Proceedings of the 14th European Conference on Computer Vision, LNCS 9905. Cham:Springer, 2016:749-765.
[4] 熊昌镇,车满强,王润玲. 基于稀疏卷积特征和相关滤波的实时视觉跟踪算法[J]. 计算机应用, 2018, 38(8):2175-2179, 2223. (XIONG C Z, CHE M Q, WANG R L. Real-time visual tracking algorithm based on correlation filters and sparse convolutional features[J]. Journal of Computer Applications, 2018, 38(8):2175-2179, 2223.)
[5] GUO Q, FENG W, ZHOU C, et al. Learning dynamic Siamese network for visual object tracking[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway:IEEE, 2017:1781-1798.
[6] LI B, YAN J, WU W, et al. High performance visual tracking with Siamese region proposal network[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2018:8971-8980.
[7] ZHU Z, WANG Q, LI B, et al. Distractor-aware Siamese networks for visual object tracking[C]//Proceedings of the 15th European Conference on Computer Vision, LNCS 11213. Cham:Springer, 2018:103-119.
[8] WANG Q, ZHANG L, BERTINETTO L, et al. Fast online object tracking and segmentation:a unifying approach[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2019:1328-1338.
[9] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems. Red Hook, NY:Curran Associates Inc., 2012:1097-1105.
[10] HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2016:770-778.
[11] RUSSAKOVSKY O, DENG J, SU H, et al. ImageNet large scale visual recognition challenge[J]. International Journal of Computer Vision, 2015, 115(3):211-252.
[12] KRISTAN M, LEONARDIS A, MATAS J, et al. The visual object tracking VOT2016 challenge results[C]//Proceedings of the 2016 IEEE International Conference on Computer Vision, LNCS 9914. Cham:Springer, 2016:777-823.
[13] KRISTAN M, LEONARDIS A, MATAS J, et al. The sixth visual object tracking VOT2018 challenge results[C]//Proceedings of the 2018 European Conference on Computer Vision, LNCS 11129. Cham:Springer, 2018:3-53.
[14] DANELLJAN M, ROBINSON A, KHAN FS, et al. Beyond correlation filters:learning continuous convolution operations for visual tracking[C]//Proceedings of the 2016 European Conference on Computer Vision, LNCS 9909. Cham:Springer, 2016:472-488.
[15] DANELLJAN M, BHAT G, KHAN F S, et al. ECO:efficient convolution operators for tracking[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2017:6931-6939.
[16] HE A, LUO C, TIAN X, et al. A twofold Siamese network for real-time object tracking[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2018:4834-4843.
[17] XU T, FENG Z H, WU X, et al. Learning adaptive discriminative correlation filters via temporal consistency preserving spatial feature selection for robust visual object tracking[J]. IEEE Transactions on Image Processing, 2019, 28(11):5596-5609.

动态的加权孪生网络跟踪算法

Dynamic weighted siamese network tracking algorithm

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	王贺兵, 张春梅. 基于非对称卷积-压缩激发-次代残差网络的人脸关键点检测[J]. 计算机应用, 2021, 41(9): 2741-2747.
[2]	宋中山, 梁家锐, 郑禄, 刘振宇, 帖军. 基于双向门控尺度特征融合的遥感场景分类[J]. 计算机应用, 2021, 41(9): 2726-2735.
[3]	李康康, 张静. 基于注意力机制的多层次编码和解码的图像描述模型[J]. 计算机应用, 2021, 41(9): 2504-2509.
[4]	张永斌, 常文欣, 孙连山, 张航. 基于字典的域名生成算法生成域名的检测方法[J]. 计算机应用, 2021, 41(9): 2609-2614.
[5]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[6]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[7]	姬张建, 任兴旺. 带旋转与尺度估计的全卷积孪生网络目标跟踪算法[J]. 计算机应用, 2021, 41(9): 2705-2711.
[8]	牟长宁, 王海鹏, 周丕宇, 侯鑫行. 基于图卷积神经网络的串联质谱从头测序[J]. 计算机应用, 2021, 41(9): 2773-2779.
[9]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[10]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[11]	黄程程, 董霄霄, 李钊. 基于二维Winograd算法的深流水线5×5卷积方法[J]. 计算机应用, 2021, 41(8): 2258-2264.
[12]	曾祥银, 郑伯川, 刘丹. 基于深度卷积神经网络和聚类的左右轨道线检测[J]. 计算机应用, 2021, 41(8): 2324-2329.
[13]	武光利, 李雷霆, 郭振洲, 王成祥. 基于改进的双向长短期记忆网络的视频摘要生成模型[J]. 计算机应用, 2021, 41(7): 1908-1914.
[14]	吴则举, 焦翠娟, 陈亮. 基于改进Faster R-CNN的轮胎缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1939-1946.
[15]	杨粟, 欧阳智, 杜逆索. 基于相关度距离的无监督并行哈希图像检索[J]. 计算机应用, 2021, 41(7): 1902-1907.