基于三维矫正和相似性学习的无约束人脸验证

doi:10.11772/j.issn.1001-9081.2018041068

计算机应用 ›› 2018, Vol. 38 ›› Issue (10): 2788-2793.DOI: 10.11772/j.issn.1001-9081.2018041068

• 2018中国粒计算与知识发现学术会议(CGCKD 2018)论文 • 上一篇下一篇

基于三维矫正和相似性学习的无约束人脸验证

徐昕, 梁久祯

常州大学信息科学与工程学院, 江苏常州 213164

收稿日期:2018-03-20 修回日期:2018-05-16 出版日期:2018-10-10 发布日期:2018-10-13
通讯作者: 梁久祯
作者简介:徐昕(1995-),女,江苏泰州人,硕士研究生,主要研究方向:人工智能、图像处理、人脸识别;梁久祯(1968-),男,山东泰安人,教授,博士,主要研究方向:人工智能。
基金资助:
国家自然科学基金资助项目（61170121）；浙江省公益技术研究社会发展项目（2017C33223）。

Unconstrained face verification based on 3D frontalization and similarity learning

XU Xin, LIANG Jiuzhen

College of Information Science & Engineering, Changzhou University, Changzhou Jiangsu 213164, China

Received:2018-03-20 Revised:2018-05-16 Online:2018-10-10 Published:2018-10-13
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61170121), the Social Development Project for Public Welfare Technology Research of Zhejiang Province (2017C33223).

摘要/Abstract

摘要： 针对无约束条件下的人脸图像样本少、面部姿态变化大、被遮挡以及背景复杂等问题，提出一种结合三维人脸矫正与相似性学习相结合的人脸验证算法（sub-SL）。首先，通过三维人脸矫正方法对人脸图像进行姿态矫正，将图像中的人脸矫正为标准正面脸；其次，裁剪该正面脸的脸部相关区域，去除复杂的图像背景；最后，利用基于个体子空间的相似性学习方法对图像对之间的相似度进行度量，完成人脸验证。实验采用了几个以LFW（Labeled Faces in the Wild）数据库为基础的经过预处理操作（例如人脸矫正、裁剪等）后建立起来的数据库。在基于局部三值模式（LTP）的特征提取方法并且训练图像对数为625的实验中，sub-SL算法的识别率比利用马氏距离进行度量学习的算法sub-ML以及结合了马氏距离与相似性学习的度量学习算法sub-SML分别高出了15.6%和8.4%。实验结果表明，sub-SL算法能够有效提高无约束条件下人脸识别的准确率。

关键词: 无约束图像, 人脸验证, 三维人脸矫正, 相似性学习, 度量学习

Abstract: Focusing on the problems of small samples, large face pose changes, occlusion and complex background, under unconstrained condition, a face verification method based on 3D frontalization and similarity learning was proposed. Firstly, the 3D frontalization progress was applied to generate the frontal face of the face image. Secondly, the complex background was removed by cropping the relevant face regions. Finally, a similarity learning method based on intra-personal subspace was applied to measure the similarity of the image pairs. Experiments were conducted on several databases that were built up by preprocessing the Labeled Faces in the Wild (LFW) database. the difference between these databases and original LFW is their images have been preprocessed. In the experiment with Local Ternary Pattern (LTP) descriptor as the feature extraction method and 625 training image pairs, the recognition rate of the proposed algorithm Similarity Learning over subspace (sub-SL) was 15.6% and 8.4% higher than that of Metric Learning over subspace (sub-ML) and Similarity Metric Learning over subspace (sub-SML) respectively. Experimental results show that the proposed algorithm can effectively improve the accuracy of face verification under unconstrained conditions.

Key words: unconstrained image, face verification, 3D face frontalization, similarity learning, metric learning

中图分类号:

TP317.4

徐昕, 梁久祯. 基于三维矫正和相似性学习的无约束人脸验证[J]. 计算机应用, 2018, 38(10): 2788-2793.

XU Xin, LIANG Jiuzhen. Unconstrained face verification based on 3D frontalization and similarity learning[J]. Journal of Computer Applications, 2018, 38(10): 2788-2793.

参考文献

[1] HU J, LU J, TAN Y P. Discriminative deep metric learning for face verification in the wild[C]//Proceedings of the 2014 IEEE Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2014:1875-1882.
[2] SUN Y, WANG X, TANG X. Hybrid deep learning for face verification[C]//Proceedings of the 2013 IEEE International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 2013:1489-1496.
[3] SUN Y, WANG X, TANG X. Deep learning face representation by joint identification-verification[EB/OL].[2018-01-10]. http://papers.nips.cc/paper/5416-deep-learning-face-representation-by-joint-identification-verification.pdf.
[4] ZHU Z, LUO P, WANG X, et al. Recover canonical-view faces in the wild with deep neural networks[EB/OL].[2018-01-10]. https://arxiv.org/pdf/1404.3543.
[5] BEYMER D, POGGIO T. Image representations for visual learning[J]. Science, 1996, 272(5270):1905.
[6] VETTER T, POGGIO T. Linear object classes and image synthesis from a single example image[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, 19(7):733-742.
[7] BLANZ V, VETTER T. Face Recognition Based on Fitting a 3D morphable model[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(9):1063-1074.
[8] KEMELMACHER-SHLIZERMAN I, BASRI R. 3D face reconstruction from a single image using a single reference face shape[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 33(2):394-405.
[9] FU Y, YAN S, HUANG T S. Correlation metric for generalized feature extraction[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(12):2229-2235.
[10] NGUYEN H V, BAI L. Cosine similarity metric learning for face verification[C]//Proceedings of the 2010 Asian Conference on Computer Vision. Berlin:Springer, 2010:709-720.
[11] HUANG K, YING Y, CAMPBELL C. GSML:a unified framework for sparse metric learning[C]//Proceedings of the Ninth IEEE International Conference on Data Mining. Washington, DC:IEEE Computer Society, 2009:189-198.
[12] CAO Q, YING Y, LI P. Similarity metric learning for face recognition[C]//Proceedings of the 2014 IEEE International Conference on Computer Vision. Piscataway, NJ:IEEE, 2014:2408-2415.
[13] HASSNER T, HAREL S, PAZ E, et al. Effective face frontalization in unconstrained images[C]//Proceedings of the 2015 IEEE Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2015:4295-4304.
[14] USF human ID 3-D database[DB/OL].[2018-01-10].http://www.cse.usf.edu/~sarkar/SudeepSarkar/3D_Face_Data.html.
[15] COOTES T F, EDWARDS G J, TAYLOR C J. Active appearance models[C]//Proceedings of the 1998 European Conference on Computer Vision. Berlin:Springer,1998:484-498.
[16] COOTES T F, EDWARDS G J, TAYLOR C J. Active appearance models[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001,23(6):681-685.
[17] XIONG X, TORRE F D L. Supervised descent method and its applications to face alignment[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE, 2013:532-539.
[18] KING D E. Dlib-ml:a machine learning toolkit[EB/OL].[2018-01-10]. http://www.jmlr.org/papers/volume10/king09a/king09a.pdf.
[19] VIOLA P, JONES M J. Robust real-time face detection[J]. International Journal of Computer Vision, 2004, 57(2):137-154.
[20] HUANG G B, MATTAR M, BERG T, et al. Labeled faces in the wild:a database forstudying face recognition in unconstrained environments[EB/OL].[2018-01-10]. https://hal.inria.fr/inria-00321923/document.
[21] TAIGMAN Y, WOLF L, HASSNER T. Multiple one-shots for utilizing class label information[EB/OL].[2018-01-10]. http://courses.cs.tau.ac.il/~wolf/papers/TWH_BMVC09_Multishot.pdf.
[22] COVER T M, HART P E. Nearest neighbor pattern classification[J]. IEEE Transactions on Information Theory, 1967, 13(1):21-27.
[23] CORTES C, VAPNIK V. Support-vector networks[J]. Machine Learning, 1995, 20(3):273-297.
[24] YANG M, van GOOL L, ZHANG L. Sparse variation dictionary learning for face recognition with a single training sample per person[C]//Proceedings of the 2013 IEEE International Conference on Computer Vision. Piscataway, NJ:IEEE, 2013:689-696.

基于三维矫正和相似性学习的无约束人脸验证

Unconstrained face verification based on 3D frontalization and similarity learning

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 6

编辑推荐

Metrics

[1]	魏文钰, 杨文忠, 马国祥, 黄梅. 基于深度学习的行人再识别技术研究综述[J]. 计算机应用, 2020, 40(9): 2479-2492.
[2]	傅泰铭, 陈燕, 李陶深. 基于线性分配的难负样本挖掘度量学习[J]. 计算机应用, 2020, 40(2): 352-357.
[3]	吕亚丽, 苗钧重, 胡玮昕. 基于标签进行度量学习的图半监督学习算法[J]. 计算机应用, 2020, 40(12): 3430-3436.
[4]	邓杨, 谢宁, 杨阳. 基于孪生检测网络的实时视频追踪算法[J]. 计算机应用, 2019, 39(12): 3440-3444.
[5]	黎万英, 黄瑞章, 丁志远, 陈艳平, 徐立洋. 基于用户行为特征的多维度文本聚类[J]. 计算机应用, 2018, 38(11): 3127-3131.
[6]	张耿宁, 王家宝, 李阳, 苗壮, 张亚非, 李航. 基于特征融合与核局部Fisher判别分析的行人重识别[J]. 计算机应用, 2016, 36(9): 2597-2600.