Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (7): 2096-2103.DOI: 10.11772/j.issn.1001-9081.2019122184

• Virtual reality and multimedia computing • Previous Articles     Next Articles

Face liveness detection method based on near-infrared and visible binocular vision

DENG Xiwen, FENG Ziliang, QIU Chenpeng   

  1. College of Computer Science, Sichuan University, Chengdu Sichuan 610065, China
  • Received:2019-12-30 Revised:2020-03-03 Online:2020-07-10 Published:2020-03-29
  • Supported by:
    This work is partially supported by the Joint Fund of National Natural Science Foundation of China and Civil Aviation Administration of China (U1833115).

基于近红外与可见光双目视觉的活体人脸检测方法

邓茜文, 冯子亮, 邱晨鹏   

  1. 四川大学 计算机学院, 成都 610065
  • 通讯作者: 邓茜文
  • 作者简介:邓茜文(1996-),女,四川绵阳人,硕士研究生,主要研究方向:图像处理、计算机视觉;冯子亮(1970-),男,四川南充人,研究员,博士,主要研究方向:空管应用系统、图像处理;邱晨鹏(1992-),男,河南焦作人,硕士,主要研究方向:图像处理、计算机视觉。
  • 基金资助:
    国家自然科学基金委和民航局联合基金资助项目(U1833115)。

Abstract: Aiming at the problem that face recognition systems are suspectable to be affected by forgery attacks, a face liveness detection method based on near-infrared and visible binocular vision was proposed. Firstly, the binocular device was used to obtain the face images of near-infrared and visible light synchronously. Then, the facial feature points of two images were extracted, and the binocular relation was used to match the feature points and obtain their depth information, which was used for three-dimensional point cloud reconstruction. Secondly, all facial feature points were divided into four regions, and the average variance of facial feature points in the depth direction within each region was calculated. Thirdly, the key feature points of face were selected. With the nasal tip point as the reference point, the spatial distances between the nasal tip point and the key feature points were calculated. Finally, the feature vectors were constructed by using the depth value variances and spatial distances of facial feature points. And Support Vector Machine (SVM) was used for the judgment of real faces. The experimental results show that the proposed method can detect real faces accurately and resist the attacks of fake faces effectively, achieves the recognition rate of 99.0% in experimental tests, and is superior in accuracy and robustness to the similar algorithm using depth information of facial feature points for detection.

Key words: face liveness detection, forgery attack, near-infrared, binocular vision, facial feature point

摘要: 针对人脸识别系统易受伪造攻击的问题,提出了一种基于近红外与可见光双目视觉的活体人脸检测方法。首先,采用近红外与可见光双目装置同步获取人脸图像,提取两图像的人脸特征点,利用双目关系实现特征点的匹配并获取其深度信息,再利用深度信息进行三维点云重建;然后,将全部人脸特征点划分为四个区域,计算各区域内人脸特征点在深度方向的平均方差;接着,选取人脸关键特征点,以鼻尖点为参照点,计算鼻尖点到人脸关键特征点之间的空间距离;最后,利用人脸特征点的深度值方差和空间距离来构造特征向量,使用支持向量机(SVM)实现活体人脸判断。实验结果表明,所提方法能够准确检测活体人脸以及有效抵御伪造人脸的攻击,在实验测试中达到99.0%的识别率,在准确性和鲁棒性上优于利用人脸特征点深度信息进行检测的同类算法。

关键词: 活体人脸检测, 伪造攻击, 近红外, 双目视觉, 人脸特征点

CLC Number: