Lightweight and multi-pose face recognition method based on deep learning

doi:10.11772/j.issn.1001-9081.2019071272

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (3): 704-709.DOI: 10.11772/j.issn.1001-9081.2019071272

• Artificial intelligence • Previous Articles Next Articles

Lightweight and multi-pose face recognition method based on deep learning

GONG Rui^1,2, DING Sheng^1,2,3, ZHANG Chaohua^1,2, SU Hao^1,2

1. College of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan Hubei 430065, China;
2. Hubei Provincial Key Laboratory of Intelligent Information Processing and Real-time Industrial System(Wuhan University of Science and Technology), Wuhan Hubei 430065, China;
3. Fujian Provincial Key Laboratory of Data Intensive Computing(Quanzhou Normal University), Quanzhou Fujian 362000, China

Received:2019-07-22 Revised:2019-09-26 Online:2019-10-25 Published:2020-03-10
Supported by:
This work is partially supported by the Open Project of the Fujian Provincial Key Laboratory of Data Intensive Computing (BD201805).

基于深度学习的轻量级和多姿态人脸识别方法

龚锐^1,2, 丁胜^1,2,3, 章超华^1,2, 苏浩^1,2

1. 武汉科技大学计算机科学与技术学院, 武汉 430065;
2. 智能信息处理与实时工业系统湖北省重点实验室(武汉科技大学), 武汉 430065;
3. 福建省大数据管理新技术与知识工程重点实验室(泉州师范大学), 福建泉州 362000

通讯作者: 龚锐
作者简介:龚锐(1995-),男,湖北赤壁人,硕士研究生,主要研究方向:深度学习、计算机视觉;丁胜(1975-),男,湖北武汉人,副教授,博士,CCF会员,主要研究方向:计算机视觉;章超华(1996-),男,江西抚州人,硕士研究生,主要研究方向:深度学习、计算机视觉;苏浩(1996-),男,湖北武汉人,硕士研究生,主要研究方向:迁移学习、计算机视觉。
基金资助:
福建省大数据管理新技术与知识工程重点实验室开放课题（BD201805）。

Abstract

Abstract: At present, the face recognition methods based on deep learning have the problems of large model parameter size and slow feature extraction speed, and the existing face datasets have the problem of single pose, which cannot achieve good recognition effect in the actual face recognition task. Aiming at this problem, a multi-pose face dataset was established, and a lightweight multi-pose face recognition method was proposed. Firstly, the MTCNN (Multi-Task cascaded Convolutional Neural Network) algorithm was used by the method for face detection, and the high-level features included in the last network of MTCNN were used for face tracking. Then, the face pose was judged according to the positions of the detected face key points, the current face features were extracted by the neural network with ArcFace as loss function, and the current face features were compared with the face features of the corresponding pose in the face database to obtain the face recognition result. The experimental results show that the accuracy of the proposed method is 96.25% on the multi-pose face dataset, which is 2.67% higher than that on the face dataset with single pose. It shows that the proposed multi-pose face recognition method can effectively improve the recognition accuracy.

Key words: deep learning, face recognition, multi-pose, lightweight, Multi-Task cascaded Convolutional Neural Network (MTCNN), ArcFace

摘要： 目前基于深度学习的人脸识别方法存在识别模型参数量大、特征提取速度慢的问题，而且现有人脸数据集姿态单一，在实际人脸识别任务中无法取得好的识别效果。针对这一问题建立了一种多姿态人脸数据集，并提出了一种轻量级的多姿态人脸识别方法。首先，使用多任务级联卷积神经网络（MTCNN）算法进行人脸检测，并且使用MTCNN最后包含的高层特征做人脸跟踪；然后，根据检测到的人脸关键点位置来判断人脸姿态，通过损失函数为ArcFace的神经网络提取当前人脸特征，并将当前人脸特征与相应姿态的人脸数据库中的人脸特征比对得到人脸识别结果。实验结果表明，提出方法在多姿态人脸数据集上准确率为96.25%，相较于单一姿态的人脸数据集，准确率提升了2.67%，所提方法能够有效提高识别准确率。

关键词: 深度学习, 人脸识别, 多姿态, 轻量级, 多任务级联卷积神经网络, ArcFace

CLC Number:

TP183

GONG Rui, DING Sheng, ZHANG Chaohua, SU Hao. Lightweight and multi-pose face recognition method based on deep learning[J]. Journal of Computer Applications, 2020, 40(3): 704-709.

龚锐, 丁胜, 章超华, 苏浩. 基于深度学习的轻量级和多姿态人脸识别方法[J]. 计算机应用, 2020, 40(3): 704-709.

References

[1] JOLLIFFE I T. Principal component analysis[J]. Journal of Marketing Research,2002,25(4):513.
[2] BELKIN M,NIYOGI P. Laplacian eigenmaps and spectral techniques for embedding and clustering[C]//Proceedings of the 14th International Conference on Neural Information Processing Systems. Cambridge:MIT Press,2001:585-591.
[3] HE X,NIYOGI P. Locality preserving projections[C]//Proceedings of the 16th International Conference on Neural Information Processing Systems. Cambridge:MIT Press,2003:153-160.
[4] WRIGHT J,YANG A Y,GANESH A,et al. Robust face recognition via sparse representation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2009,31(2):210-227.
[5] RUSSAKOVSKY O,DENG J,SU H,et al. ImageNet large scale visual recognition challenge[J]. International Journal of Computer Vision,2015,115(3):211-252.
[6] SIMONYAN K,ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL].[2018-04-10]. https://arxiv.org/pdf/1409.1556.pdf.
[7] SZEGEDY C,LIU W,JIA Y,et al. Going deeper with convolutions[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2015:1-9.
[8] HE K,ZHANG X,REN S,et al. Identity mappings in deep residual networks[C]//Proceedings of the 2016 European Conference on Computer Vision,LNCS 9908. Cham:Springer,2016:630-645.
[9] HOWARD A G,ZHU M,CHEN B,et al. MobileNets:efficient convolutional neural networks for mobile vision applications[EB/OL].[2018-10-15]. https://arxiv.org/pdf/1704.04861.pdf.
[10] ZHANG X,ZHOU X,LIN M,et al. ShuffleNet:an extremely efficient convolutional neural network for mobile devices[EB/OL].[2018-10-07]. https://arxiv.org/pdf/1707.01083.pdf.
[11] CHEN S,LIU Y,GAO X,et al. MobileFaceNets:efficient CNNs for accurate real-time face verification on mobile devices[EB/OL].[2018-06-15]. https://arxiv.org/ftp/arxiv/papers/1804/1804.07573.pdf.
[12] SCHROFF F,KALENICHENKO D,PHILBIN J. FaceNet:a unified embedding for face recognition and clustering[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2015:815-823.
[13] WEN Y,ZHANG K,LI Z,et al. A discriminative feature learning approach for deep face recognition[C]//Proceedings of the 2016 European Conference on Computer Vision,LNCS 9911. Cham:Springer,2016:499-515.
[14] LIU W,WEN Y,YU Z,et al. SphereFace:deep hypersphere embedding for face recognition[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2017:6738-6746.
[15] WANG H,WANG Y T,ZHOU Z,et al. CosFace:large margin cosine loss for deep face recognition[EB/OL].[2018-04-03]. https://arxiv.org/pdf/1801.09414.pdf.
[16] DENG J,GUO J,XUE N,et al. ArcFace:additive angular margin loss for deep face recognition[EB/OL].[2019-02-09]. https://arxiv.org/pdf/1801.07698.pdf.
[17] ZHANG K,ZHANG Z,LI Z,et al. Joint face detection and alignment using multitask cascaded convolutional networks[J]. IEEE Signal Processing Letters,2016,23(10):1499-1503.
[18] MA N,ZHANG X,ZHENG H,et al. ShuffleNet V2:practical guidelines for efficient CNN architecture design[EB/OL].[2018-12-10]. https://arxiv.org/pdf/1807.11164.pdf.
[19] SANDLER M,HOWARD A,ZHU M,et al. MobileNetV2:inverted residuals and linear bottlenecks[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2018:4510-4520.
[20] 任梓涵, 杨双远. 基于视觉跟踪的实时视频人脸识别[J]. 厦门大学学报(自然科学版),2018,57(3):438-444. (REN Z H, YANG S Y. Real-time face recognition in videos based on visual tracking[J]. Journal of Xiamen University (Natural Science), 2018,57(3):438-444.)
[21] 方国康, 李俊, 王垚儒. 基于深度学习的ARM平台实时人脸识别[J]. 计算机应用,2019,39(8):2217-2222. (FANG G K, LI J,WANG Y R. Real-time face recognition based on ARM platform based on deep learning[J]. Journal of Computer Applications,2019,39(8):2217-2222.)
[22] HUANG G B,MATTAR M,BERG T,et al. Labeled faces in the wild:a database for studying face recognition in unconstrained environments[EB/OL].[2019-01-20]. https://people.cs.umass.edu/~elm/papers/lfw.pdf.
[23] SENGUPTA S,CHEN J C,CASTILLO C,et al. Frontal to profile face verification in the wild[C]//Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision. Piscataway:IEEE,2016:1-9.
[24] MOSCHOGLOU S,PAPAIOANNOU A,SAGONAS C,et al. AgeDB:the first manually collected,in-the-wild age database[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Piscataway:IEEE, 2017:1997-2005.

Lightweight and multi-pose face recognition method based on deep learning

基于深度学习的轻量级和多姿态人脸识别方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	Jing QIN, Zhiguang QIN, Fali LI, Yueheng PENG. Diagnosis of major depressive disorder based on probabilistic sparse self-attention neural network [J]. Journal of Computer Applications, 2024, 44(9): 2970-2974.
[2]	Xiyuan WANG, Zhancheng ZHANG, Shaokang XU, Baocheng ZHANG, Xiaoqing LUO, Fuyuan HU. Unsupervised cross-domain transfer network for 3D/2D registration in surgical navigation [J]. Journal of Computer Applications, 2024, 44(9): 2911-2918.
[3]	Yunchuan HUANG, Yongquan JIANG, Juntao HUANG, Yan YANG. Molecular toxicity prediction based on meta graph isomorphism network [J]. Journal of Computer Applications, 2024, 44(9): 2964-2969.
[4]	Shunyong LI, Shiyi LI, Rui XU, Xingwang ZHAO. Incomplete multi-view clustering algorithm based on self-attention fusion [J]. Journal of Computer Applications, 2024, 44(9): 2696-2703.
[5]	Yanjun LI, Yaodong GE, Qi WANG, Weiguo ZHANG, Chen LIU. Improved KLEIN algorithm and its quantum analysis [J]. Journal of Computer Applications, 2024, 44(9): 2810-2817.
[6]	Yexin PAN, Zhe YANG. Optimization model for small object detection based on multi-level feature bidirectional fusion [J]. Journal of Computer Applications, 2024, 44(9): 2871-2877.
[7]	Yuhan LIU, Genlin JI, Hongping ZHANG. Video pedestrian anomaly detection method based on skeleton graph and mixed attention [J]. Journal of Computer Applications, 2024, 44(8): 2551-2557.
[8]	Yanjie GU, Yingjun ZHANG, Xiaoqian LIU, Wei ZHOU, Wei SUN. Traffic flow forecasting via spatial-temporal multi-graph fusion [J]. Journal of Computer Applications, 2024, 44(8): 2618-2625.
[9]	Qianhong SHI, Yan YANG, Yongquan JIANG, Xiaocao OUYANG, Wubo FAN, Qiang CHEN, Tao JIANG, Yuan LI. Multi-granularity abrupt change fitting network for air quality prediction [J]. Journal of Computer Applications, 2024, 44(8): 2643-2650.
[10]	Yiqun ZHAO, Zhiyu ZHANG, Xue DONG. Anisotropic travel time computation method based on dense residual connection physical information neural networks [J]. Journal of Computer Applications, 2024, 44(7): 2310-2318.
[11]	Song XU, Wenbo ZHANG, Yifan WANG. Lightweight video salient object detection network based on spatiotemporal information [J]. Journal of Computer Applications, 2024, 44(7): 2192-2199.
[12]	Yongjin ZHANG, Jian XU, Mingxing ZHANG. Lightweight algorithm for impurity detection in raw cotton based on improved YOLOv7 [J]. Journal of Computer Applications, 2024, 44(7): 2271-2278.
[13]	Xun SUN, Ruifeng FENG, Yanru CHEN. Monocular 3D object detection method integrating depth and instance segmentation [J]. Journal of Computer Applications, 2024, 44(7): 2208-2215.
[14]	Zheng WU, Zhiyou CHENG, Zhentian WANG, Chuanjian WANG, Sheng WANG, Hui XU. Deep learning-based classification of head movement amplitude during patient anaesthesia resuscitation [J]. Journal of Computer Applications, 2024, 44(7): 2258-2263.
[15]	Huanhuan LI, Tianqiang HUANG, Xuemei DING, Haifeng LUO, Liqing HUANG. Public traffic demand prediction based on multi-scale spatial-temporal graph convolutional network [J]. Journal of Computer Applications, 2024, 44(7): 2065-2072.