Abstract:Focused on the low positioning accuracy of Explicit Shape Regression (ESR) for some facical occlusion and excessive facial expression samples, an adaptive window regression method was proposed. Firstly, the priori information was used to generate an accurate face area box for each image, feature mapping of faces was performed by using the center point of the face area box, and similar transformation was performed to obtain multiple initial shapes. Secondly, an adaptive window adjustment strategy was given, in which the feature window size was adaptively adjusted based on the mean square error of the previous regression. Finally, based on the feature selection strategy of Mutual Information (MI), a new correlation calculation method was proposed, and the most relevant features were selected in the candidate pixel set. On the three public datasets LFPW, HELEN and COFW, the positioning accuracy of the proposed method is increased by 7.52%, 5.72% and 5.89% respectively compared to ESR algorithm. The experimental results show that the adaptive window regression method can effectively improve the positioning accuracy of face feature points.
[1] VIOLA P, JONES M. Rapid object detection using a boosted cascade of simple features[C]// Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2001: 511. [2] 陈凯星, 刘赟, 王金海,等. 基于遗传机制和高斯变差的自动前景提取方法[J]. 计算机应用, 2017, 37(11): 3231-3237.(CHEN K X,LIU Y, WANG J H, et al. Foreground extraction with genetic and difference of Guassian[J]. Journal of Computer Applications, 2017, 37(11): 3231-3237.) [3] 张欢欢, 洪敏, 袁玉波. 基于极端学习机的人脸特征深度稀疏自编码方法[J]. 计算机应用,2018, 38(11): 3193-3198.(ZHANG H H, HONG M, YUAN Y B. Deep sparse auto-encoder using extreme learning machine for facial feature[J]. Journal of Computer Applications, 2018, 38(11): 3193-3198.) [4] COOTES T F, TAYLOR C J, COOPER D H, et al. Active shape models-their training and application[J]. Computer Vision & Image Understanding, 1995, 61(1): 38-59. [5] COOTES T F, EDWARDS G J, TAYLOR C J. Active appearance models[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(6): 681-685. [6] KAZEMI V, SULLIVAN J. One millisecond face alignment with an ensemble of regression trees[C]// Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2014: 1867-1874. [7] DOLLAR P, WELINDER P, PERONA P. Cascaded pose regression[C]// Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2010: 1078-1085. [8] OZUYSAL M, CALONDER M, LEPETIT V, et al. Fast keypoint recognition using random ferns[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(3): 448-461. [9] CAO X, WEI Y, WEN F, et al. Face alignment by explicit shape regression[C]// Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2012: 2887-2894. [10] REN S, CAO X, WEI Y, et al. Face alignment at 3000 fps via regressing local binary features[C]// Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2014: 1685-1692. [11] BURGOS-ARTIZZU X P, PERONA P, DOLLAR P. Robust face landmark estimation under occlusion[C]// Proceedings of the 2013 IEEE International Conference on Computer Vision. Washington, DC: IEEE Computer Society, 2014: 1513-1520. [12] XIONG X, TORRE F D L. Supervised descent method and its applications to face alignment[C]// Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2013: 532-539. [13] SUN Y, WANG X, TANG X. Deep convolutional network cascade for facial point detection[C]// Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2013: 3476-3483. [14] ZHOU E, FAN H, CAO Z, et al. Extensive facial landmark localization with coarse-to-fine convolutional network cascade[C]// Proceedings of the 2013 IEEE International Conference on Computer Vision Workshops. Washington, DC: IEEE Computer Society, 2013: 386-391. [15] 贾项南, 于凤芹, 陈莹. 改进的显式形状回归人脸特征点定位算法[J]. 计算机应用, 2018, 38(5): 1289-1293. (JIA X N, YU F Q, CHEN Y. Improved explicit shape regression for face alignment algorithm[J]. Journal of Computer Applications, 2018, 38(5): 1289-1293.) [16] YU L, LIU H. Efficient feature selection via analysis of relevance and redundancy[J]. Journal of Machine Learning Research, 2004, 5(12): 1205-1224. [17] 黄玉琴, 潘华伟. 基于分类外形搜索的人脸特征点定位[J/OL]. 计算机应用研究, 2019, 36(5)[2018-09-20]. http://www.arocmag.com/article/02-2019-05-056.html.(HUANG Y Q, PAN H W. Face alignment based on classified shape searching[J/OL]. Application Research of Computers, 2019, 36(5)[2018-09-20]. http://www.arocmag.com/article/02-2019-05-056.html.) [18] BELHUMEUR P N, JACOBS D W, KRIEGMAN D J, et al. Localizing parts of faces using a consensus of exemplars[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(12): 2930-2940. [19] LE V, BRANDT J, LIN Z, et al. Interactive facial feature localization[C]// Proceedings of the 12th European Conference on Computer Vision. Berlin: Springer-Verlag, 2012: 679-692.