面向视频感知的静电力触觉渲染方法

doi:10.11772/j.issn.1001-9081.2016.04.1137

计算机应用 ›› 2016, Vol. 36 ›› Issue (4): 1137-1140.DOI: 10.11772/j.issn.1001-9081.2016.04.1137

面向视频感知的静电力触觉渲染方法

吴赛文, 陈建, 孙晓颖

吉林大学通信工程学院, 长春 130022

收稿日期:2015-09-06 修回日期:2015-10-29 出版日期:2016-04-10 发布日期:2016-04-08
通讯作者: 孙晓颖
作者简介:吴赛文(1990-),男,河南郑州人,硕士研究生,主要研究方向:虚拟现实、触觉再现; 陈建(1977-),男,山东单县人,副教授,博士,主要研究方向:人机交互、虚拟现实、无线定位; 孙晓颖(1969-),男,吉林公主岭人,教授,博士,主要研究方向:人机交互、触觉再现、无线定位。
基金资助:
国家863计划项目(2013AA013704)。

Electrostatic force tactile rendering method for video perception

WU Saiwen, CHEN Jian, SUN Xiaoying

College of Communication Engineering, Jilin University, Changchun Jilin 130022, China

Received:2015-09-06 Revised:2015-10-29 Online:2016-04-10 Published:2016-04-08
Supported by:
This work is partially supported by the National High Technology Research and Development Program (863 Program) of China (2013AA013704).

摘要/Abstract

摘要： 针对视觉障碍的人获取视频等数字媒体信息受限的问题, 为扩展视频等数字媒体信息的触觉感知通道,提出一种面向视频感知的静电力触觉渲染方法。首先,采用基于像素点的视频帧处理算法,根据手指触摸位置获取当前视频帧的目标像素点,然后将目标像素点彩色信息从RGB模型转换为HSI模型,利用像素点色调分量来映射静电力激励信号频率参量,结合像素点亮度和饱和度分量来映射静电力激励信号幅度参量,合成静电力触觉激励信号,实现对实时视频的触觉渲染和感知。最后,设计动态色彩感知实验和亮度辨识感知实验,结果表明,该方法可实现对视频中物体信息的触觉感知,动态识别平均正确率达90.6%,色彩辨识平均正确率达69.4%,亮度辨识平均正确率达80.0%,所提方法能有效提取视频中的动态特征信息,增强视频触觉渲染的实时性。

关键词: 虚拟现实, 触觉再现, 视频处理, 静电力, 触觉渲染

Abstract: Since the visually impaired person could not enjoy videos and other digital media thoroughly, in order to extend tactile perception channels for video media, an electrostatic force tactile rendering method for video perception was put forward. Firstly, target pixels of the current video frame were acquired according to the location of the finger, and color information of target pixels were transformed from RGB color model to HSI color model. Then the hue parameter of target pixels was used to map stimuli frequencies of electrostatic force, the intensity and saturation parameters of target pixels were used to map stimuli amplitudes of electrostatic force, and the tactile stimuli signal was composited to render the real-time video. Finally, dynamic color perception experiments and identification of brightness perception experiments were designed. The results show that the proposed method can realize to sense the information of objects in the video, the average accuracy of dynamic identification reaches 90.6%, the average accuracy of color identification reaches 69.4%, and the average accuracy of brightness identification reaches 80.0%. The proposed method can extract the dynamic characteristics of video information effectively and enhance the real-time tactile rendering for video.

Key words: virtual reality, haptic display, video processing, electrostatic force, tactile rendering

中图分类号:

TP391.9

吴赛文, 陈建, 孙晓颖. 面向视频感知的静电力触觉渲染方法[J]. 计算机应用, 2016, 36(4): 1137-1140.

WU Saiwen, CHEN Jian, SUN Xiaoying. Electrostatic force tactile rendering method for video perception[J]. Journal of Computer Applications, 2016, 36(4): 1137-1140.

参考文献

[1] 王爱民, 戴金桥. 虚拟现实的力触觉交互技术发展现状与趋势[J]. 测控技术, 2007, 26(10):1-3.(WANG A M, DAI J Q. Current development situation & the future trend of haptic interaction in virtual reality[J]. Measurement & Control Technology, 2007, 26(10):1-3.)
[2] 王冠生, 郑江华, 瓦哈甫·哈力克, 等. 基于Haptic技术的盲人路径诱导辅具应用研究现状[J]. 传感器与微系统, 2013, 32(4):1-4.(WANG G S, ZHENG J H, HALIK W, et al. Research status of applications of route guidance aids for the blind based on haptic technology[J]. Transducer & Microsystem Technologies, 2013, 32(4):1-4.)
[3] XU C, ISRAR A, POUPYREV I, et al. Tactile display for the visually impaired using TeslaTouch[C]//Proceedings of the CHI 2011 Extended Abstracts on Human Factors in Computing Systems. New York:ACM, 2011:317-322.
[4] 吴涓, 宋振中, 吴伟雄, 等. 用于盲人的图像振动触觉显示系统设计[J]. 东南大学学报(自然科学版), 2011, 41(5):973-977.(WU J, SONG Z Z, WU W X, et al. Design of image vibrotactile display system for the blind[J]. Journal of Southeast University (Natural Science Edition), 2011, 41(5):973-977.)
[5] 吴涓, 宋爱国, 李建清.图像的力/触觉表达技术研究综述[J]. 计算机应用研究, 2007, 24(5):1-3.(WU J, SONG A G, LI J Q. Research summarization of image expression with haptic rendering[J]. Application Research of Computers, 2007, 24(5):1-3.)
[6] 李佳璐, 宋爱国, 张小瑞. 彩色图像的纹理力/触觉渲染方法[J]. 计算机辅助设计与图形学学报, 2011, 23(4):719-724.(LI J L, SONG A G, ZHANG X R. A method of haptic texture rendering color image[J]. Journal of Computer-Aided Design & Computer Graphics, 2011, 23(4):719-724.)
[7] VASUDEVAN H, MANIVANNAN M. Tangible images:runtime generation of haptic textures from images[C]//Haptics 2008:Proceedings of the Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Piscataway, NJ:IEEE, 2008:357-360.
[8] ADI W, SULAIMAN S. Haptic texture rendering based on visual texture information:a study to achieve realistic haptic texture rendering[M]//ZAMAN B H, ROBINSON P, PETROU M, et al. Visual Informatics:Bridging Research and Practice, LNCS 5857. Berlin:Springer, 2009:279-287.
[9] CHA J, EID M, SADDIK A E. Touchable 3D video system[J]. ACM Transactions on Multimedia Computing, Communications, and Applications, 2009, 5(4):29.
[10] ISRAR A, BAU O, KIM S C, et al. Tactile feedback on flat surfaces for the visually impaired[C]//CHI 2012:Proceedings of the Extended Abstracts on Human Factors in Computing Systems. New York:ACM, 2012:1571-1576.
[11] BAU O, POUPYREV I, ISRAR A, et al. TeslaTouch:electrovibration for touch surfaces[C]//Proceedings of the 23nd Annual Acm Symposium on User Interface Software and Technology. New York:ACM, 2010:283-292.
[12] KACZMAREK K A, NAMMI K, AGARWAL A K, et al. Polarity effect in electrovibration for tactile display[J]. IEEE Transactions on Biomedical Engineering, 2006, 53(10):2047-2054.
[13] KIM S C, ISRAR A, POUPYREV I. Tactile rendering of 3D features on touch surfaces[C]//Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. New York:ACM, 2013:531-538.
[14] GONZALEZ R C. Digital Image Processing[M]. Chennai, India:Pearson Education, 2009.
[15] WIJEKOON D, CECCHINATO M E, HOGGAN E, et al. Electrostatic modulated friction as tactile feedback:intensity perception[M]//ISOKOSKI P, SPRINGARE J. Haptics:Perception, Devices, Mobility, and Communication, LNCS 7282. Berlin:Springer, 2012:613-624.

面向视频感知的静电力触觉渲染方法

Electrostatic force tactile rendering method for video perception

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	杨佳义, 陈勇. 低照度视频图像自适应补偿增强的设计与实现[J]. 计算机应用, 2020, 40(8): 2372-2377.
[2]	王毅, 吕健, 尤乾, 赵泽宇, 颜宝明, 朱姝蔓. 基于菲茨定律的虚拟现实任意形状选择模型[J]. 计算机应用, 2020, 40(11): 3320-3326.
[3]	胡敏, 李冲, 路荣荣, 黄宏程. 基于三维视觉指导的运动想象训练性能分析[J]. 计算机应用, 2018, 38(3): 836-841.
[4]	林畅, 李国平, 赵海武, 王国中, 顾晓. 全景视频双环带映射算法[J]. 计算机应用, 2017, 37(9): 2631-2635.
[5]	陈珂. 用于视频中车速自动检测的摄像机自动标定方法[J]. 计算机应用, 2017, 37(8): 2307-2312.
[6]	李丹妮, 刘奇, 田琪, 赵雷昱, 何凌, 黄韫栀, 张劲. 面向上颌骨骨折复位手术的虚拟系统设计[J]. 计算机应用, 2015, 35(6): 1730-1733.
[7]	曹彦珏, 安博文, 李启明. 基于后处理的实时景深模拟与应用[J]. 计算机应用, 2015, 35(5): 1439-1443.
[8]	杨晓文, 张志纯, 况立群, 韩燮. 基于虚拟手的人机交互关键技术[J]. 计算机应用, 2015, 35(10): 2945-2949.
[9]	王晓华滕炯华赵春晖. 基于H分量检测的模板更新鲁棒分块跟踪方法[J]. 计算机应用, 2012, 32(05): 1261-1264.
[10]	李艳军李智勇陈思远. 一种面向3D场景的实时自动路径搜索方法[J]. 计算机应用, 2010, 30(1): 85-89.
[11]	崔雪冰冯巧娟崔平非. 基于内容特征的MPEG视频认证方案[J]. 计算机应用, 2010, 30(1): 213-216.
[12]	丁欢万旺根余小清谭小辉. 基于几何参数的植物真实感模拟[J]. 计算机应用, 2009, 29(1): 97-100.
[13]	曾纪国张艳刘陈战守义. 基于三幅图像的曲面造型及纹理提取[J]. 计算机应用, 2007, 27(2): 470-472.
[14]	李峰徐诚郭凯王亚平 . 虚拟样机模型转换及演示技术研究[J]. 计算机应用, 2006, 26(9): 2057-2058.
[15]	黄俊莲吕博学 . 虚拟现实中动画和碰撞的层次细节技术研究及应用[J]. 计算机应用, 2006, 26(11): 2730-2732.