计算机应用

• 人工智能与仿真 •    下一篇

基于耦合Multi-HMM和深度图像数据的人体动作识别

张全贵,蔡丰,李志强   

  1. 辽宁工程技术大学
  • 收稿日期:2017-08-08 修回日期:2017-09-10 发布日期:2017-09-10 出版日期:2017-09-30
  • 通讯作者: 蔡丰
  • 作者简介:张全贵 (1978—),男,辽宁葫芦岛人,副教授,博士,CCF会员(39373M),主要研究方向:计算机视觉、机器学习,数据挖掘; 蔡丰(1992—),女,辽宁大连人,硕士研究生,主要研究方向:计算机视觉; 李志强(1993—),男,辽宁锦州人,硕士研究生,主要研究方向:计算机视觉,数据挖掘。
  • 基金资助:

    辽宁省自然科学基金面上项目2015020100

Human action recognition based on coupled multi-HMM and depth image data

  • Received:2017-08-08 Revised:2017-09-10 Online:2017-09-10 Published:2017-09-30
  • Contact: Feng CAI
  • About author:ZHANG Quangui, born in 1978, Ph. D., associate professor. His research interests include computer vision, machine learning, data mining. CAI Feng, born in 1992, M. S. candidate. Her research interests include computer vision. LI Zhiqiang,born in 1993, M. S. candidate. His research interests include computer vision, data mining.
  • Supported by:
    This work is partially supported byLiaoning Provincial Natural Science Foundation Project (2015020100).

摘要:

为解决使用RGB图像进行特征提取时容易受外界因素干扰,且计算复杂度高等问题,采用一种更加有效的解决方案,即使用深度数据进行人体动作识别。利用Kinect采集的关节点数据,首先将人体关节划分成五个区域,对每个区域的向量夹角离散化从而描述不同的状态,再通过Baum-Welch算法学习出各区域的多HMM(Multi-HMM)模型,并使用前向算法建立生成区域与动作类别概率矩阵。在此基础上,对区域及动作类别进行内耦合和间耦合分析,从而表达各关节点之间的交互关系。最后使用基于耦合的KNN(K最邻近)算法完成整体的动作识别。通过实验测试对五种动作的识别率均达到90%以上,并与3D Trajectories等方法进行对比,实验得到的综合识别率高于对比方法,具有明显的优势。

关键词: Kinect, 人体动作识别, 划分区域, Multi-HMM(多隐马尔可夫)模型, 耦合KNN(耦合K最邻近)

Abstract:

In order to solve the problem that the feature extraction was easy to be affected by external factors and the computational complexity was high.Using a more effective solution, that was the use of depth data for human motion recognition. Using the joint data collected by Kinect, the human joint was divided into five regions. The vector angle of each region was discretized to describe the different states, and then the Baum-Welch algorithm was used to study the multi- HMM(multi-Hidden Markov Model)model, and used the forward algorithm to establish the generation region and action class probability matrix. On this basis, the regional and action categories were internally coupled and coupled to analyze, thus expressing the interaction between the joints. Finally, the KNN algorithm based on coupling was used to complete the motion recognition. Through the experimental test, the recognition rate of the five actions was more than 90%, and compared with the methods such as 3D Trajectories. The comprehensive recognition rate obtained by the experiment was higher than the contrast methods, and has obvious advantages.

Key words:

中图分类号: