基于虚拟手的人机交互关键技术

doi:10.11772/j.issn.1001-9081.2015.10.2945

计算机应用 ›› 2015, Vol. 35 ›› Issue (10): 2945-2949.DOI: 10.11772/j.issn.1001-9081.2015.10.2945

基于虚拟手的人机交互关键技术

杨晓文, 张志纯, 况立群, 韩燮

中北大学计算机与控制工程学院, 太原 030051

收稿日期:2015-04-13 修回日期:2015-05-30 出版日期:2015-10-10 发布日期:2015-10-14
通讯作者: 杨晓文(1980-),女,天津人,副教授,博士研究生,CCF会员,主要研究方向:计算机仿真、人机交互,xiaowen_yang@163.com
作者简介:张志纯(1987-),男,河北保定人,硕士研究生,主要研究方向:人机交互;况立群(1976-),男,江西高安人,副教授,博士研究生,主要研究方向:计算机仿真、可视化;韩燮(1964-),女,山西文水人,教授,博士生导师,博士,CCF会员,主要研究方向:计算机仿真、虚拟现实。
基金资助:
国家自然科学基金资助项目(61379080);国家科技支撑计划项目(2013BAH45F02);山西省回国留学人员重点资助项目(2013-078)。

Key technologies of human-computer interaction based on virtual hand

YANG Xiaowen, ZHANG Zhichun, KUANG liqun, HAN Xie

School of Computer Science and Control Engineering, North University of China, Taiyuan Shanxi 030051, China

Received:2015-04-13 Revised:2015-05-30 Online:2015-10-10 Published:2015-10-14

摘要/Abstract

摘要： 基于虚拟手的人机交互技术是虚拟现实中的研究热点。对其中的关键技术进行了研究,采用多边形网格建模方法,建立了虚拟手的逼真几何模型;基于Virtools平台开发了数据手套的数据采集模块,提出使用基于初始值的数据转换方法,解决了开始运动时的跳变问题,同时对手指的外展运动,使用约束值方法进行处理,提高了虚拟手与真实人手匹配一致性;最后,针对虚拟手与虚拟物体的操作交互,提出了一种基于有效阈值角度的抓取算法。通过Virtools平台进行验证,实验结果表明:虚拟手模型逼真度高,手型变化自然;同时实现了虚拟手对虚拟物体的操作交互,具有很强的实用性。

关键词: 人机交互, 虚拟现实, 初始值, Virtools, 抓取算法

Abstract: Human-computer interaction technology based on virtual hand is a research focus of virtual reality. The key technologies were studied, the modeling method of polygon mesh was used and a realistic geometric model of virtual hand was established. The data acquisition module of data glove based on Virtools was developed and a method of data conversion based on initial value was proposed, the phenomenon of jump was solved when the virtual hand begin to move. For the fingers outreach motion, the method of constraint value was used, and the matching consistency of virtual hand with the real hand was increased. At last, for the interaction operation of virtual hand with virtual objects, a crawl algorithm based on effective threshold angle was put forward. Verified by Virtools platform, high fidelity of the virtual hand model is got, the shape of the hand changes naturally. Meanwhile, the interaction operation of virtual hand to virtual objects is implemented and it has a strong practicability.

Key words: human-computer interaction, virtual reality, initial value, Virtools, crawling algorithm

中图分类号:

TP391.9

杨晓文, 张志纯, 况立群, 韩燮. 基于虚拟手的人机交互关键技术[J]. 计算机应用, 2015, 35(10): 2945-2949.

YANG Xiaowen, ZHANG Zhichun, KUANG liqun, HAN Xie. Key technologies of human-computer interaction based on virtual hand[J]. Journal of Computer Applications, 2015, 35(10): 2945-2949.

参考文献

[1] DIX A, FINLAY J, ABOWD G D, et al. Human-computer interaction [M]. 3rd ed. Upper Saddle River: Prentice Hall, 2004:1-10.
[2] CHEN W, DONG S, YUE W, et al. Research on man-machine interaction of handheld mobile computing [J]. Journal of Computer Applications, 2005,25(10):2219-2223.(陈文广,董士海,岳玮宁,等.手持移动计算中的人机交互技术研究[J].计算机应用,2005,25(10):2219-2223.)
[3] ZHAO M. The design and realization of hand motion tracking system based on Virtools [D]. Guangzhou: South China University of Technology, 2012:23-26.(赵明.基于Virtools的手部运动跟踪系统的设计与实现[D].广州:华南理工大学,2012:23-26.)
[4] ZHANG Z, YANG X, KUANG L, et al. The research of gesture simulation based on Virtools and 5DT data glove [J]. Science Technology and Engineering, 2015,15(4):140-144.(张志纯,杨晓文,况立群,等.基于Virtools和5DT数据手套的手势仿真研究[J].科学技术与工程,2015,15(4):140-144.)
[5] LIU C, XU Q. Design and application of interaction & control module for a data glove [J]. Computer Simulation, 2009,26(3):251-255.(刘春,徐菁.一种数据手套交互控制模块的设计与应用[J].计算机仿真,2009,26(3):251-255.)
[6] YIN L, HAN J, WANG Y, et al. Study on virtual hand control for virtual reality [J]. Journal of System Simulation, 2009,21(2):448-451.(殷磊,韩静,王烨,等.虚拟现实环境下虚拟手控制技术研究[J].系统仿真学报,2009,21(2):448-451.)
[7] FAN J, ZHOU G, HU L. Virtual hand interaction system based on Fastrack and data glove [J]. Journal of Anhui Agricultural Sciences, 2013,41(25):10524-10527.(樊景超,周国民,胡林.基于Fastrack和数据手套的虚拟手交互系统研究[J].安徽农业科学,2013,41(25):10524-10527.)
[8] LIU Y, WANG G, YOU X. Modeling of virtual hand and arm based on data glove and tracker [J]. Journal of Institute of Surveying and Mapping, 2005,22(4):273-274.(刘颖真,万刚,游雄.基于数据手套和跟踪器的虚拟手臂建模[J].测绘学院学报,2005,22(4):273-274.)
[9] HU L, LIU C, WANG L. Research on implementation of data glove interaction module in XNA[J]. Journal of Shenyang Institute of Aeronautical Engineering, 2011,28(5):9-13.(胡乐华,刘春,王林林.XNA环境下数据手套交互模块的研究与实现[J].沈阳航空航天大学学报,2011,28(5):9-13.)
[10] REN C, DAI S. Implementation of cyber-glove based realistic virtual hand [J]. Journal of System Simulation, 2008,20(22):6214-6217.(任程,戴树岭.基于数据手套的逼真虚拟手的实现[J].系统仿真学报,2008,20(22):6214-6217.)
[11] LI K, WANG S, SHAN J. Research and implementation of virtual-hand operating technology [J]. Computer Simulation, 2007,24(3):227-229.(李克彬,王淑琴,单继红.虚拟手操作技术研究及实现[J].计算机仿真,2007,24(3):227-229.)
[12] LIU L, WU P, XIONG W. Research on key technologies of system development of virtual supermarket cognitive rehabilitation training [J]. Journal of Engineering Graphics, 2014,35(1):105-109.(刘林, 伍平平,熊巍.虚拟超市认知康复训练系统开发关键技术研究[J].图学学报,2014,35(1):105-109.)
[13] CHEN W. The study of natural interaction based on virtual hand [D]. Hangzhou: Zhejiang University, 2014:33-42.(陈文锋.灵巧虚拟手自然交互研究[D].杭州:浙江大学,2014:33-42.)

[1]	王江坤, 何坤金, 曹红飞, 王金强, 张燕. 基于光滑粒子流体动力学方法的交互式水流加热仿真[J]. 计算机应用, 2020, 40(5): 1409-1414.
[2]	王毅, 吕健, 尤乾, 赵泽宇, 颜宝明, 朱姝蔓. 基于菲茨定律的虚拟现实任意形状选择模型[J]. 计算机应用, 2020, 40(11): 3320-3326.
[3]	胡敏, 李冲, 路荣荣, 黄宏程. 基于三维视觉指导的运动想象训练性能分析[J]. 计算机应用, 2018, 38(3): 836-841.
[4]	林畅, 李国平, 赵海武, 王国中, 顾晓. 全景视频双环带映射算法[J]. 计算机应用, 2017, 37(9): 2631-2635.
[5]	张文英, 何坤金, 张荣丽, 刘宇兴. 基于开源场景图形的三维可视化与信息管理系统设计[J]. 计算机应用, 2016, 36(7): 2056-2060.
[6]	侯荣波, 康文雄, 房育勋, 黄荣恩, 徐伟钊. 基于时间上下文跟踪学习检测的指尖跟踪方法[J]. 计算机应用, 2016, 36(5): 1371-1377.
[7]	吴赛文, 陈建, 孙晓颖. 面向视频感知的静电力触觉渲染方法[J]. 计算机应用, 2016, 36(4): 1137-1140.
[8]	徐国庆. 在线融合特征的眼睛状态识别算法[J]. 计算机应用, 2015, 35(7): 2062-2066.
[9]	李丹妮, 刘奇, 田琪, 赵雷昱, 何凌, 黄韫栀, 张劲. 面向上颌骨骨折复位手术的虚拟系统设计[J]. 计算机应用, 2015, 35(6): 1730-1733.
[10]	曹彦珏, 安博文, 李启明. 基于后处理的实时景深模拟与应用[J]. 计算机应用, 2015, 35(5): 1439-1443.
[11]	张丹陈兴文赵姝颖李纪伟白钰. 基于Kinect骨骼预定义的体态识别算法[J]. 计算机应用, 2014, 34(12): 3441-3445.
[12]	岑梓源李彬田联房. 基于K-Means++聚类的体绘制高维传递函数设计方法[J]. 计算机应用, 2012, 32(12): 3404-3407.
[13]	周祖微刘森王忆文李辉. 机器视觉电子白板系统的防抖与坐标插值技术[J]. 计算机应用, 2012, 32(12): 3408-3410.
[14]	王保卫申波陈榕. 基于XML的移动设备人机交互引擎[J]. 计算机应用, 2010, 30(9): 2362-2364.
[15]	李艳军李智勇陈思远. 一种面向3D场景的实时自动路径搜索方法[J]. 计算机应用, 2010, 30(1): 85-89.

基于虚拟手的人机交互关键技术

Key technologies of human-computer interaction based on virtual hand

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics