计算机应用 ›› 2012, Vol. 32 ›› Issue (12): 3392-3396.DOI: 10.3724/SP.J.1087.2012.03392

• 图形图像技术 • 上一篇    下一篇

基于特征包支持向量机的手势识别

张秋余,王道东,张墨逸,刘景满   

  1. 兰州理工大学 计算机与通信学院,兰州 730050
  • 收稿日期:2012-07-20 修回日期:2012-08-29 发布日期:2012-12-29 出版日期:2012-12-01
  • 通讯作者: 王道东
  • 作者简介:张秋余(1966-),男,河北辛集人,研究员,博士生导师,CCF高级会员,主要研究方向:图像理解与识别、多媒体信息安全;〓王道东(1986-),男,甘肃白银人,硕士研究生,主要研究方向:图像处理、模式识别、运动手势识别、人机交互;〓张墨逸(1985-),女,甘肃武威人,讲师,硕士,CCF会员,主要研究方向:图像理解与识别、运动手势识别、人机交互;〓刘景满(1986-),男,山东菏泽人,硕士研究生,主要研究方向:图像处理与模式识别、手势跟踪、人机交互。
  • 基金资助:
    国家自然科学基金资助项目

Hand gesture recognition based on bag of features and support vector machine

ZHANG Qiu-yu,WANG Dao-dong,ZHANG Mo-yi,LIU Jing-man   

  1. School of Computer and Communication, Lanzhou University of Technology, Lanzhou Gansu 730050, China
  • Received:2012-07-20 Revised:2012-08-29 Online:2012-12-29 Published:2012-12-01
  • Contact: WANG Dao-dong

摘要: 针对类肤色信息或复杂背景的影响,难以通过手势分割得到精确手势轮廓而对后期手势识别率与实时交互的影响,提出了一种基于特征包支持向量机(BOF-SVM)的手势识别方法。采用SIFT算法提取手势图像局部不变性特征点,将手势局部特征向量(尺度不变特征变换(SIFT)描述子)进行K-means聚类生成视觉码书,并通过视觉码书量化每一幅手势图像的视觉码字集合,以此获得手势图像的固定维数的表征向量来训练支持向量机(SVM)多类分类器。该方法只需框定手势所在区域,无需精确地分割人手。实验表明,该方法对9种交互手势的平均识别率达到92.1%,并具有很好的鲁棒性及实时性,能适应环境的变化。

关键词: 手势识别, 尺度不变特征变换, 特征包, 视觉码书, BOF-SVM模型

Abstract: According to the influence of approximate skin color information or complex background, it is hard to get precise gesture contour by hand gesture segmentation, which will have effect on later gesture recognition rate and real-time interaction. Therefore, this paper proposed a gesture recognition method based on the BOF-SVM (Bag Of Features-Support Vector Machine). At first, local invariant features of the gesture images were extracted by the Scale Invariant Feature Transformation (SIFT) algorithm. Then the visual code book was generated by gesture local eigenvector (SIFT descriptors) through K-means clustering. And visual code set of every image got quantized by visual code book. As a result, the characterized vector of gesture images with fixed dimensional was obtained to train multi-class SVM classifier. This method only needed to frame the gesture area instead of segmenting gesture accurately. The experimental results indicate that the average recognition rate of the nine interactive hand gestures based on this method can reach 92.1%. Besides, it has good robustness and efficiency, and can adapt to the changes of environment.

Key words: Hand Gesture Recognition, SIFT(Scale Invariant Feature Transformation), Bag of Feature(BOF), Visual Code Book, BOF-SVM model

中图分类号: