To solve the problem of complex background and robustness in facial expression recognition, a novel method for facial expression recognition was proposed, which combined Active Shape Model (ASM) differential texture features and Local Directional Pattern (LDP) features in decision-making level by Dempster-Shafer (DS) evidence theory. ASM differential texture features could shield the differences between individuals effectively. Meanwhile it could try to retain expression information. LDP is a robust feature descriptor, which computes the edge response values in different directions and used these to encode the image texture. So LDP features have strong anti-noise capability and can capture the subtle changes caused by facial expression. With the consideration of different expression recognition rates for different features, different weight coefficients were selected to calculate probability assignment value during the process of DS evidence fusion. By conducting the experiments on JAFFE database and Cohn-Kanade database, the average recognition of facial expression can reach to 97.08% and is 1% higher than the method using single LDP feature. The experimental results show that the recognition rate and the robustness of facial expression are promoted.
夏海英, 徐鲁辉. 基于主动形状模型差分纹理和局部方向模式特征融合的人脸表情识别[J]. 计算机应用, 2015, 35(3): 783-786.
XIA Haiying, XU Luhui. Facial expression recognition based on feature fusion of active shape model differential texture and local directional pattern. Journal of Computer Applications, 2015, 35(3): 783-786.
[1] EKMAN P. Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique[J]. Psychological Bulletin, 1994, 115(2): 268-287. [2] MURTHY G R S, JADON R S. Effectiveness of eigenspaces for facial expressions recognition[J]. International Journal of Computer Theory and Engineering, 2009, 1(5): 638-642. [3] LI M, YUAN B. A novel statistical linear discriminant analysis for image matrix: two-dimensional Fisherfaces[C]//Proceedings of the 7th International Conference on Signal Processing. Piscataway: IEEE, 2004:1419-1422. [4] DEND H-B, JIN L-W, ZHEN L-X, et al. A new facial expression recognition method based on local Gabor filter bank and PCA plus LDA[J]. International Journal of Information Technology, 2005,11(11):86-96. [5] SHAN C, GONG S, McOWAN P W. Facial expression recognition based on local binary patterns:a comprehensive study[J]. Image and Vision Computing, 2008,27(6):803-816. [6] CAO Y, ZHENG W, ZHAO L, et al. Expression recognition using elastic graph matching[C]//Proceedings of the 1st International Conference on Affective Computing and Intelligent Interaction. Berlin: Springer, 2005:8-15. [7] HOMMEL S, HANDMANN U. AAM based continuous facial expression recognition for face image sequences[C]//Proceedings of the 12th International Symposium on Computational Intelligence and Informatics. Piscataway: IEEE, 2011:189-194. [8] MISTRY V J, GOYANIM M. A literature survey on facial expression recognition using global features[J]. International Journal of Engineering and Advanced Technology, 2013,2(4):653-657. [9] SHARMA A, DUBEY A. Facial expression recognition using virtual neutral image synthesis[EB/OL].[2014-08-07]. http://www.cs.umd.edu/~bhokaal/files/documents/Virtual%20expression.pdf. [10] KOUTLAS A, FOTIADIS D. An automatic region based methodology for facial expression recognition[C]//Proceedings of the 2008 IEEE International Conference on Systems, Man and Cybernetics. Piscataway: IEEE, 2008:662-666. [11] JABID T, KABIR M H, CHAE O. Local Directional Pattern (LDP)-a robust image descriptor for object recognition[C]//Proceedings of the 7th IEEE International Conference on Advanced Video and Signal Based Surveillance. Piscataway: IEEE, 2010:482-487. [12] JABID T, KABIR M H, CHAE O. Local Directional Pattern (LDP) for face recognition[C]//Proceeding of Digest of Technical Papers International Conference on Consumer Electronics. Piscataway: IEEE, 2010:329-330. [13] JABID T, KABIR M H, CHAE O. Facial expression recognition using Local Directional Pattern (LDP)[C]//Proceedings of the 17th IEEE International Conference on Image Processing. Piscataway: IEEE, 2010:1605-1608. [14] HUANG X, ZHAO G, PIETIKAINEN M, et al. Dynamic facial expression recognition using boosted component-based spatiotemporal features and multi-classifier fusion[C]//Proceeding of the 12th International Conference on Advanced Concepts for Intelligent Vision Systems. Berlin: Springer, 2010:312-322. [15] COOTES T F, TAYLOR C J. Statistical models of appearance for computer vision[EB/OL].[2014-07-11]. http://personalpages.manchester.ac.uk/staff/timothy.f.cootes/Models/app_models.pdf. [16] CHE H, LYU F, XIANG Z. Defects identification by SVM-DS fusion decision-making with multiple features[J]. Journal of Mechanical Engineering, 2010,46(16):101-105.(车红昆,吕福在,项占琴.多特征SVM-DS融合决策的缺陷识别[J].机械工程学报,2010,46(16):101-105.)