基于改进深度信息的手势分割与定位

doi:10.11772/j.issn.1001-9081.2017.01.0251

计算机应用 ›› 2017, Vol. 37 ›› Issue (1): 251-254.DOI: 10.11772/j.issn.1001-9081.2017.01.0251

• 计算机视觉与虚拟现实 • 上一篇下一篇

基于改进深度信息的手势分割与定位

林海波, 王圣彬, 张毅

国家信息无障碍研发中心(重庆邮电大学), 重庆 400065

收稿日期:2016-08-20 修回日期:2016-09-06 出版日期:2017-01-10 发布日期:2017-01-09
通讯作者: 王圣彬
作者简介:林海波(1965-),男,重庆人,教授,硕士,主要研究方向:智能系统与机器人;王圣彬(1989-),男,江苏徐州人,硕士研究生,主要研究方向:模式识别;张毅(1966-),男,重庆人,教授,博士,主要研究方向:机器人导航、多模人机交互。
基金资助:
重庆市教委科学技术研究项目（KJ130512）。

Gesture segmentation and positioning based on improved depth information

LIN Haibo, WANG Shengbin, ZHANG Yi

National Engineering Research and Development Center for Information Accessibility(Chongqing University of Posts and Telecommunications), Chongqing 400065, China

Received:2016-08-20 Revised:2016-09-06 Online:2017-01-10 Published:2017-01-09
Supported by:
This work is supported by the Scientific and Technological Research Project Funds of Chongqing Municipal Education Commission (KJ130512).

摘要/Abstract

摘要： 针对基于Kinect深度信息分割的手势往往包含手腕易造成后续手势误识别的问题，提出一种改进深度信息的手势分割与定位算法。首先，基于深度信息阈值限定在实验空间中检测出手势二值图；然后，根据普通手势特征，提出基于手势端点检测和可变阈值算法分割出准确手势。为得到稳定的分割效果，对分割手势进行形态学处理，最后选取基于手势重心坐标和最大内切圆圆心坐标的联合手势定位法定位手势。实验结果表明，该手势分割方法比已有分割方法更准确可靠，联合手势定位比Kinect软件开发工具包骨骼数据定位和手势重心定位稳定，无奇异点。

关键词: 深度信息, 手势分割, 手势定位, 可变阈值, 最大内切圆

Abstract: Aiming at the problem that segmented gesture by Kinect depth information usually contains wrist data, which easily causes subsequent false gesture recognition, a gesture segmentation and positioning algorithm based on improved depth information was proposed. Firstly, the gesture binary image was detected based on depth information threshold limit in experimental space. Secondly, according to characteristics of common gestures, accurate gesture was segmented by gesture endpoint detection and variable threshold algorithm. In order to obtain stable segmentation results, morphological processing of segmented gesture was conducted. Lastly, the gesture positioning algorithm was proposed based on the method of combining gesture gravity center coordinates and maximum inscribed circle center coordinates. The experimental results show that the proposed gesture segmentation method has better accuracy and stability than the existing algorithm. The combined gesture positioning is more stable than gesture gravity center positioning and skeletal data positioning of Kinect Software Development Kit (SDK) and it has no singular points.

Key words: depth information, gesture segmentation, gesture positioning, variable threshold, maximum inscribed circle

中图分类号:

TP391.413

林海波, 王圣彬, 张毅. 基于改进深度信息的手势分割与定位[J]. 计算机应用, 2017, 37(1): 251-254.

LIN Haibo, WANG Shengbin, ZHANG Yi. Gesture segmentation and positioning based on improved depth information[J]. Journal of Computer Applications, 2017, 37(1): 251-254.

参考文献

[1] LIU X, FUJIMURA K. Hand gesture recognition using depth data[C]//Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition. Piscataway, NJ:IEEE, 2004:529-534.
[2] 罗元,何超,王艳,等.基于深度预分割结合Camshift跟踪算法的动态手势识别方法[J].半导体光电,2015,36(1):155-159.(LUO Y, HE C, WANG Y, et al. A novel dynamic hand gesture recognition method based on depth pre-segmentation combining with Camshift tracking algorithm[J]. Semiconductor Optoelectronics, 2015, 36(1):155-159.)
[3] 麦健桦.基于自然手势的机器人控制[D].广州:华南理工大学,2013:12-14.(MAI J H. Robotic control based on natural gesture[D]. Guangzhou:South China University of Technology, 2013:12-14.)
[4] 李振.基于手势识别的远程控制机械手的设计[D].武汉:武汉理工大学,2014:22-29.(LI Z. Design of remote control of manipulator based on gesture recognition[D]. Wuhan:Wuhan University of Technology, 2014:22-29.)
[5] YANG W J, WANG C M. Depth information and motion context feature based dynamic hand gesture detection and recognition[J]. Journal of Information and Computational Science, 2015, 12(10):3775-3782.
[6] LEE T, HOLLERER T. Handy AR:markerless inspection of augmented reality objects using fingertip tracking[C]//Proceedings of the 2007 IEEE International Symposium on Wearable Computers. Washington, DC:IEEE Computer Society, 2007:83-90.
[7] REN Z, YUAN J, MENG J, et al. Robust part-based hand gesture recognition using Kinect sensor[J]. IEEE Transactions on Multimedia, 2013, 15(5):1110-1120.
[8] ELSAADANY O S, ABDELWAHAB M M. Real-time 2DHoG-2DPCA algorithm for hand gesture recognition[C]//ICIAP 2013:Proceedings of the 17th International Conference on Image Analysis and Processing, LNCS 8157. Berlin:Springer, 2013:601-610.
[9] YAO Y, ZHANG F, FU Y. Real-time hand gesture recognition using RGB-D sensor[M]//Computer Vision and Machine Learning with RGB-D Sensors. New York:Springer International Publishing, 2014:289-313.
[10] QIN S, ZHU X, YANG Y, et al. Real-time hand gesture recognition from depth images using convex shape decomposition method[J]. Journal of Signal Processing Systems, 2014, 74(1):47-58.
[11] QIN S, ZHU X, YU H, et al. Real-time markerless hand gesture recognition with depth camera[M]//Advances in Multimedia Information Processing-PCM 2012. Berlin:Springer, 2012:186-197.
[12] 陈子毫.基于深度信息的手势检测与跟踪[D].广州:华南理工大学,2012:20-29.(CHEN Z H. Gesture detection and tracking based on depth information[D]. Guangzhou:South China University of Technology, 2012:20-29.)
[13] SUAREZ J, MURPHY R R. Hand gesture recognition with depth images:A review[C]//2012 IEEE RO-MAN:Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication. Piscataway, NJ:IEEE, 2012:411-417.
[14] NIKHIL S, MOHAN S, RAMYA B, et al. Design and development of a DSP processor based reconfigurable hand gesture recognition system for real time applications[C]//Proceedings of the 2010 International Conference on Signal and Image Processing. Piscataway, NJ:IEEE, 2010:39-44.
[15] 张世辉,张煜婕,孔令富.一种基于深度图像的自遮挡检测方法[J].小型微型计算机系统,2010,31(5):964-968.(ZHANG S H, ZHANG Y J, KONG L F. Self-occlusion detection approach based on depth image[J]. Journal of Chinese Computer Systems, 2010, 31(5):964-968.)

基于改进深度信息的手势分割与定位

Gesture segmentation and positioning based on improved depth information

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 7

编辑推荐

Metrics

[1]	袁泉, 张建峰, 伍立志. 基于改进LBE特征的RGB-D显著性检测[J]. 计算机应用, 2018, 38(5): 1432-1435.
[2]	邱辉, 王坤, 杨豪璞. 基于时间对抗的网络报警深度信息融合方法[J]. 计算机应用, 2016, 36(2): 499-504.
[3]	张恒, 刘大勇, 刘艳丽, 聂晨曦. 融合深度信息的BRISK改进算法[J]. 计算机应用, 2015, 35(8): 2285-2290.
[4]	范文婕, 王命延, 杨文姬. 基于深度图像的指尖和掌心特征提取方法[J]. 计算机应用, 2015, 35(6): 1791-1794.
[5]	宦海, 黄凌霄, 张雨, 卢松. 基于最大内切圆的椭圆孔组检测[J]. 计算机应用, 2015, 35(4): 1101-1105.
[6]	何埜, 李光耀, 肖莽, 谢力, 彭磊, 唐可. 基于深度信息的图像修复算法[J]. 计算机应用, 2015, 35(10): 2955-2958.
[7]	王亚龙张奇志周亚丽. 基于Kinect的三维视觉里程计的设计[J]. 计算机应用, 2014, 34(8): 2371-2374.