基于深度多视图特征距离学习的行人重识别

doi:10.11772/j.issn.1001-9081.2018122505

计算机应用 ›› 2019, Vol. 39 ›› Issue (8): 2223-2229.DOI: 10.11772/j.issn.1001-9081.2018122505

基于深度多视图特征距离学习的行人重识别

邓轩¹, 廖开阳^1,2, 郑元林^1,3, 袁晖¹, 雷浩¹, 陈兵¹

1. 西安理工大学印刷包装与数字媒体学院, 西安 710048;
2. 陕西省印刷包装工程技术研究中心, 西安 710048;
3. 陕西省印刷包装工程重点实验室, 西安 710048

收稿日期:2018-12-19 修回日期:2019-02-28 出版日期:2019-08-10 发布日期:2019-08-14
通讯作者: 廖开阳
作者简介:邓轩(1995-),女,山东菏泽人,硕士研究生,主要研究方向:深度学习、图像处理;廖开阳(1976-),男,湖北荆州人,讲师,博士,主要研究方向:机器视觉、人工智能;郑元林(1975-),男,山东泰安人,副教授,博士,主要研究方向:色彩管理、彩色图像质量评估、颜色科学;袁晖(1993-),男,江西赣州人,硕士研究生,主要研究方向:深度学习、图像处理;雷浩(1995-),男,湖南岳阳人,硕士研究生,主要研究方向:深度学习、图像处理;陈兵(1997-),男,陕西安康人,主要研究方向:图像处理。
基金资助:
国家自然科学基金资助项目（61671376，61771386）；陕西省教育厅科学研究项目（18JK0556）。

Person re-identification based on deep multi-view feature distance learning

DENG Xuan¹, LIAO Kaiyang^1,2, ZHENG Yuanlin^1,3, YUAN Hui¹, LEI Hao¹, CHEN Bing¹

1. College of Printing, Packaging Engineering and Digital Media Technology, Xi'an University of Technology, Xi'an Shaanxi 710048, China;
2. Printing and Packaging Engineering Technology Research Centre of Shaanxi Province, Xi'an Shaanxi 710048, China;
3. Key Laboratory of Printing and Packaging Engineering of Shaanxi Province, Xi'an Shaanxi 710048, China

Received:2018-12-19 Revised:2019-02-28 Online:2019-08-10 Published:2019-08-14
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61671376, 61771386), the Scientific Research Project of Shaanxi Provincial Department of Education (18JK0556).

摘要/Abstract

摘要： 传统手工特征很大程度上依赖于行人的外观特征，而深度卷积特征作为高维特征，直接用来匹配图像会消耗大量的时间和内存，并且来自较高层的特征很容易受到行人姿势背景杂波影响。针对这些问题，提出一种基于深度多视图特征距离学习的方法。首先，提出一种新的整合和改善深度区域的卷积特征，利用滑框技术对卷积特征进行处理，得到低维的深度区域聚合特征并使其维数等于卷积层通道数；其次，通过交叉视图二次判别分析方法，从深度区域聚合特征和手工特征两个角度出发，提出一种多视图特征距离学习算法；最后，利用加权融合策略来完成传统特征和卷积特征之间的协作。在Market-1501和VIPeR数据集上的实验结果显示，所提融合模型的Rank1值在两个数据集上分别达到80.17%和75.32%；在CUHK03数据集新分类规则下，所提方法的Rank1值达到33.5%。实验结果表明，通过距离加权融合之后的行人重识别的精度明显高于单独的特征距离度量取得的精度，验证了所提的深度区域特征和算法模型的有效性。

关键词: 行人重识别, 卷积神经网络, 区域聚合特征, 加权融合策略, 距离度量

Abstract: The traditional handcrafted features rely heavily on the appearance characteristics of pedestrians and the deep convolution feature is a high-dimensional feature, so, it will consume a lot of time and memory when the feature is directly used to match the image. Moreover, features from higher levels are easily affected by human pose or background clutter. Aiming at these problems, a method based on deep multi-view feature distance learning was proposed. Firstly, a new feature to improve and integrate the convolution feature of the deep region was proposed. The convolution feature was processed by the sliding frame technique, and the integration feature of low-dimensional deep region with the dimension equal to the number of convolution layer channels was obtained. Secondly, from the perspectives of the deep regional integration feature and the handcrafted feature, a multi-view feature distance learning algorithm was proposed by utilizing the cross-view quadratic discriminant analysis method. Finally, the weighted fusion strategy was used to accomplish the collaboration between handcrafted features and deep convolution features. Experimental results show that the Rank1 value of the proposed method reaches 80.17% and 75.32% respectively on the Market-1501 and VIPeR datasets; under the new classification rules of CHUK03 dataset, the Rank1 value of the proposed method reaches 33.5%. The results show that the accuracy of pedestrian re-identification after distance-weighted fusion is significantly higher than that of the separate feature distance metric, and the effectiveness of the proposed deep region features and algorithm model are proved.

Key words: person re-identification, Convolutional Neural Network (CNN), regional integration feature, weighted fusion strategy, distance metric

中图分类号:

邓轩, 廖开阳, 郑元林, 袁晖, 雷浩, 陈兵. 基于深度多视图特征距离学习的行人重识别[J]. 计算机应用, 2019, 39(8): 2223-2229.

DENG Xuan, LIAO Kaiyang, ZHENG Yuanlin, YUAN Hui, LEI Hao, CHEN Bing. Person re-identification based on deep multi-view feature distance learning[J]. Journal of Computer Applications, 2019, 39(8): 2223-2229.

参考文献

[1] LIAO S, HU Y, ZHU X, et al. Person re-identification by local maximal occurrence representation and metric learning[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2015:2197-2206.
[2] WU S, CHEN Y-C, LI X, et al. An enhanced deep feature representation for person re-identification[C]//Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision. Washington, DC:IEEE Computer Society, 2016:1-8.
[3] DING S, LIN L, WANG G, et al. Deep feature learning with relative distance comparison for person re-identification[J]. Pattern Recognition, 2015, 48(10):2993-3003.
[4] 丁宗元,王洪元,陈付华,等.基于距离中心化与投影向量学习的行人重识别[J].计算机研究与发展,2017,54(8):1785-1794. (WANG Z Y, WANG H Y, CHEN F H, et al. Person re-identification based on distance centralization and projection vectors learning[J]. Journal of Computer Research and Development, 2017, 54(8):1785-1794.)
[5] KÖSTINGER M, HIRZER M, WOHLHART P, et al. Large scale metric learning from equivalence constraints[C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2012, 1:2288-2295.
[6] FARENZENA M, BAZZANI L, PERINA A, et al. Person re-identification by symmetry-driven accumulation of local features[C]//Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2010:2360-2367.
[7] 张耿宁,王家宝,李阳,等.基于特征融合与核局部Fisher判别分析的行人重识别[J].计算机应用,2016,36(9):2597-2600. (ZHANG G N, WANG J B, LI Y, et al. Person re-identification based on feature fusion and kernel local Fisher discriminant analysis[J]. Journal of Computer Applications, 2016, 36(9):2597-2600.)
[8] 孙金玉,王洪元,张继,等.基于块稀疏表示的行人重识别方法[J].计算机应用,2018,38(2):448-453. (SUN J Y, WANG H Y, ZHANG J, et al. Person re-identification method based on block sparse representation[J]. Journal of Computer Applications, 2018, 38(2):448-453.)
[9] TAO D, GUO Y, YU B, et al. Deep multi-view feature learning for person re-identification[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2018, 28(10):2657-2666.
[10] GONG Y, WANG L, GUO R, et al. Multi-scale orderless pooling of deep convolutional activation features[C]//Proceedings of the 2014 European Conference on Computer Vision, LNCS 8695. Cham:Springer, 2014:392-407.
[11] GRAY D, BRENNAN S, TAO H. Evaluating appearance models for recognition, reacquisition, and tracking[C]//Proceedings of the 2007 IEEE International Workshop on Performance Evaluation for Tracking and Surveillance. Piscataway, NJ:IEEE, 2007:41-49.
[12] ZHENG L, SHEN L, TIAN L, et al. Scalable person re-identification:a benchmark[C]//Proceedings of the 2015 IEEE International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 2015:1116-1124.
[13] LI W, ZHAO R, XIAO T, et al. DeepReID:deep filter pairing neural network for person re-identification[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2014:152-159.
[14] LIU H, FENG J, QI M, et al. End-to-end comparative attention networks for person re-identification[J]. IEEE Transactions on Image Processing, 2017, 26(7):3492-3506.
[15] ZHENG L, ZHANG H, SUN S, et al. Person re-identification in the wild[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2017:3346-3355.
[16] ZHENG L, HUANG Y, LU H, et al. Pose invariant embedding for deep person re-identification[J]. arXiv E-print, 2018:arXiv:1701.07732.
[17] ZHAO H, TIAN M, SUN S, et al. Spindle net:person re-identification with human body region guided feature decomposition and fusion[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2017:907-915.
[18] PAISITKRIANGKRAI S, SHEN C, van den HENGEL A. Learning to rank in person re-identification with metric ensembles[C]//Proceedings of the 2015 Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2015:1846-1855.
[19] MA B, SU Y, JURIE F. Covariance descriptor based on bio-inspired features for person re-identification and face verification[J]. Image and Vision Computing, 2014, 32(6/7):379-390

基于深度多视图特征距离学习的行人重识别

Person re-identification based on deep multi-view feature distance learning

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	宋中山, 梁家锐, 郑禄, 刘振宇, 帖军. 基于双向门控尺度特征融合的遥感场景分类[J]. 计算机应用, 2021, 41(9): 2726-2735.
[2]	李康康, 张静. 基于注意力机制的多层次编码和解码的图像描述模型[J]. 计算机应用, 2021, 41(9): 2504-2509.
[3]	张永斌, 常文欣, 孙连山, 张航. 基于字典的域名生成算法生成域名的检测方法[J]. 计算机应用, 2021, 41(9): 2609-2614.
[4]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[5]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[6]	牟长宁, 王海鹏, 周丕宇, 侯鑫行. 基于图卷积神经网络的串联质谱从头测序[J]. 计算机应用, 2021, 41(9): 2773-2779.
[7]	王贺兵, 张春梅. 基于非对称卷积-压缩激发-次代残差网络的人脸关键点检测[J]. 计算机应用, 2021, 41(9): 2741-2747.
[8]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[9]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[10]	黄程程, 董霄霄, 李钊. 基于二维Winograd算法的深流水线5×5卷积方法[J]. 计算机应用, 2021, 41(8): 2258-2264.
[11]	曾祥银, 郑伯川, 刘丹. 基于深度卷积神经网络和聚类的左右轨道线检测[J]. 计算机应用, 2021, 41(8): 2324-2329.
[12]	高钦泉, 黄炳城, 刘文哲, 童同. 基于改进CenterNet的竹条表面缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1933-1938.
[13]	武光利, 李雷霆, 郭振洲, 王成祥. 基于改进的双向长短期记忆网络的视频摘要生成模型[J]. 计算机应用, 2021, 41(7): 1908-1914.
[14]	谭道强, 曾诚, 乔金霞, 张俊. 基于混合注意力模型的阴影检测方法[J]. 计算机应用, 2021, 41(7): 2076-2081.
[15]	吴则举, 焦翠娟, 陈亮. 基于改进Faster R-CNN的轮胎缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1939-1946.