Augmented reality approach based on digital camera and temporal psycho-visual modulation

doi:10.11772/j.issn.1001-9081.2017.08.2298

Journal of Computer Applications ›› 2017, Vol. 37 ›› Issue (8): 2298-2301.DOI: 10.11772/j.issn.1001-9081.2017.08.2298

Previous Articles Next Articles

Augmented reality approach based on digital camera and temporal psycho-visual modulation

LU Xiaoyong¹, YOU Bin¹, LIN Pei-Yu², CHEN Musheng¹

1. School of Software, Nanchang University, Nanchang Jiangxi 330047, China;
2. Department of Information Communication, Yuan Ze University, Chung-Li Taiwan 32003, China

Received:2017-02-08 Revised:2017-05-06 Online:2017-08-12 Published:2017-08-10
Supported by:
This work is partially supported by the Science and Technology Support Program of Jiangxi Province (20131102040039).

基于数字相机和时间心理视觉调制的增强现实技术

卢晓勇¹, 游斌¹, 林珮瑜², 陈木生¹

1. 南昌大学软件学院, 南昌 330047;
2. 元智大学资讯传播学系, 台湾桃园 32003

通讯作者: 游斌
作者简介:卢晓勇(1957-),男,江西南昌人,教授,博士,主要研究方向:信息管理与信息系统、工业工程;游斌(1992-),男,江西南昌人,硕士研究生,主要研究方向:数字图像处理、信息安全、信息管理和信息系统;林珮瑜(1983-),女,台湾人,副教授,博士,主要研究方向:数字图像处理、信息安全;陈木生(1977-),男,江西于都人,博士研究生,主要研究方向:数据挖掘与知识发现、信息管理与信息系统。
基金资助:
江西省科技支撑计划项目（20131102040039）。

Abstract

Abstract: In order to extend the practicality of Augmented Reality (AR), a method based on Temporal Psycho Visual Modulation (TPSM) technology and digital camera to realize AR effect was proposed. First, the AR tags were embedded in the digital screen of the media. Based on the principle difference between the human eye to identify the perception and the digital camera to capture the image formed in the digital screen or projector, the digital camera equipment was used to obtain the digital screen image with AR tags which are not easily to be detected by human eye. Finally, the AR effect was displayed on the smart device that gets the AR tags. Simulation results show that the combination of AR and TPVM technology can accurately identify the AR tags in the image and achieve AR effect, while the human eye can not detect the AR tags. Through the mobile phone instead of 3D glasses and other extra equipment, the use restrictions of AR are reduced, and the practicality of AR is also expanded.

Key words: Augmented Reality (AR), Temporal Psycho Visual Modulation (TPSM), perception, digital camera

摘要： 为了拓展增强现实（AR）的实用性，提出一种基于时间心理视觉调制（TPVM）技术和数字相机来实现AR效果的方法。首先将AR中的标记嵌入数字屏幕的媒体内；然后利用人眼识别感知与数字相机拍摄图像形成在数字屏幕或者投影仪上原理的差异，使用数字相机设备获取数字屏幕图像内人眼不易察觉的AR标记；最后在获取标记的智能设备中显示AR效果。仿真结果显示，将数字相机与TPVM技术相结合，能够很好地将AR标记隐藏在影像中，同时人眼无法察觉，而数字相机则能准确地识别AR标记并实现AR效果。通过手机替代3D眼镜等额外设备，降低了AR的使用限制，拓展其实用性。

关键词: 增强现实, 时间心理视觉调制, 感知, 数字相机

CLC Number:

LU Xiaoyong, YOU Bin, LIN Pei-Yu, CHEN Musheng. Augmented reality approach based on digital camera and temporal psycho-visual modulation[J]. Journal of Computer Applications, 2017, 37(8): 2298-2301.

卢晓勇, 游斌, 林珮瑜, 陈木生. 基于数字相机和时间心理视觉调制的增强现实技术[J]. 计算机应用, 2017, 37(8): 2298-2301.

References

[1] 朱淼良,姚远,蒋云良.增强现实综述[J].中国图象图形学报,2004,9(7):767-774. (ZHU M L, YAO Y, JIANG Y L. A survey on augmented reality[J]. Journal of Image and Graphics,2004, 9(7):767-774.)
[2] WU X, ZHAI G. Temporal psychovisual modulation:A new paradigm of information display[exploratory DSP] [J]. IEEE Signal Processing Magazine, 2013, 30(1):136-141.
[3] QI H, ZHENG D, ZHAO J. Human visual system based adaptive digital image watermarking[J]. Signal Processing, 2008, 88(1):174-188.
[4] HU C, ZHAI G, GAO Z, et al. Simultaneous triple subtitles exhibition via temporal psychovisual modulation[C]//ICIEA 2014:Proceedings of the 20149th IEEE Conference on Industrial Electronics and Applications. Piscataway, NJ:IEEE, 2014:944-947.
[5] ZHAI G, WU X. Defeating camcorder piracy by temporal psychovisual modulation[J]. Journal of Display Technology, 2014, 10(9):754-757.
[6] HU C, ZHAI G, GAO Z, et al. Information security display system based on spatial psychovisual modulation [C]// ICME 2014: Proceedings of the 2014 IEEE International Conference on Multimedia and Expo. Washington, DC: IEEE Computer Society, 2014: 1-4.
[7] KIM H, LEE W, WOO W. CAMAR tag framework: context-aware mobile augmented reality tag framework for dual-reality linkage [C]// ISUVR 2009: Proceedings of the 2009 International Symposium on Ubiquitous Virtual Reality. Washington, DC: IEEE Computer Society, 2009: 39-42.
[8] LU X Y, YOU B, LIN P-Y, Augmented reality via temporal psycho-visual modulation [C]// ICME 2016: Proceedings of the 2016 IEEE International Conference on Multimedia & Expo. Washington, DC: IEEE Computer Society, 2016: 1-4.
[9] HIEN T, HYERIM P, SEON H K, et al. Incorporating geo-tagged mobile videos into context-aware augmented reality applications [C]// BigMM 2016: Proceedings of the 2016 IEEE Second International Conference on Multimedia Big Data. Piscataway, NJ: IEEE, 2016: 295-302.
[10] KE F, HSU Y-C. Mobile augmented-reality artifact creation as a component of mobile computer-supported collaborative learning [J].The Internet and Higher Education, 2015, 26: 33-41
[11] GAO Z, ZHAI G, WU X, et al. DLP based anti-piracy display system [C]// VCIP 2014: Proceedings of the 2014 IEEE Visual Communications and Image Processing Conference. Piscataway, NJ: IEEE, 2014:145-148.
[12] TAYLOR S A. CCD and CMOS imaging array technologies: technology review, EPC-1998-106[R]. Cambridge: Xerox Research Centre Europe, Cambridge Laboratory, 1998: 1-14.
[13] THOMAS J F, MICHAEL W D. Concepts in digital imaging technology, digital cameras readout and frame rates [EB/OL]. [2016-05-23]. http://learn.hamamatsu.com/articles/.
[14] YAMADA T, GOHSHI S, ECHIZEN I. Use of invisible noise signals to prevent privacy invasion through face recognition from camera images [C]// MM 2012: Proceedings of the 20th ACM International Conference on Multimedia. New York: ACM, 2012: 1315-1316.

[1]	Cunyi LIAO, Yi ZHENG, Weijin LIU, Huan YU, Shouyin LIU. Decoupling-fusing algorithm for multiple tasks with autonomous driving environment perception [J]. Journal of Computer Applications, 2024, 44(2): 424-431.
[2]	Shujie QI, Chunyi CHEN, Xiaojuan HU, Haiyang YU. Visual‑saliency‑driven reuse algorithm of indirect lighting in 3D scene rendering [J]. Journal of Computer Applications, 2022, 42(11): 3551-3557.
[3]	TAN Zhaoyi, CHEN Baifan. Enhanced vehicle 3D surround view based on coordinate inverse mapping [J]. Journal of Computer Applications, 2021, 41(4): 1165-1171.
[4]	SUN Qichang, MAI Yongfeng, CHEN Xiaojun. Fast calibration algorithm in surgical navigation system based on augmented reality [J]. Journal of Computer Applications, 2021, 41(3): 833-838.
[5]	LUO Bin, YU Bo. Computation offloading strategy based on particle swarm optimization in mobile edge computing [J]. Journal of Computer Applications, 2020, 40(8): 2293-2298.
[6]	WU Haiyan, LIU Ying. Stylistic multiple features mining based on attention network [J]. Journal of Computer Applications, 2020, 40(8): 2171-2181.
[7]	ZHOU Xiang, TANG Liyu, LIN Ding. Virtual-real registration method of natural features based on binary robust invariant scalable keypoints and speeded up robust features [J]. Journal of Computer Applications, 2020, 40(5): 1403-1408.
[8]	SONG Xiaona, RUI Ting, WANG Xinqing. Semantic segmentation method of road environment combined semantic boundary information [J]. Journal of Computer Applications, 2019, 39(9): 2505-2510.
[9]	TANG Linchuan, DENG Siyu, WU Yanxue, WEN Liuying. Duplicate detection algorithm for massive images based on pHash block detection [J]. Journal of Computer Applications, 2019, 39(9): 2789-2794.
[10]	FU Zhenqi, SHAO Feng. Subjective and objective quality assessment for stereoscopic 3D retargeted images [J]. Journal of Computer Applications, 2019, 39(5): 1434-1439.
[11]	LI Shu, YU Jiong, GUO Binglei, PU Yonglin, YANG Dexian, LIU Su. SQL energy consumption perception model for database load based on SSD [J]. Journal of Computer Applications, 2019, 39(1): 205-212.
[12]	YANG Wenya, SONG Guangle, CUI Chaoran, YIN Yilong. Image aesthetic quality assessment method based on semantic perception [J]. Journal of Computer Applications, 2018, 38(11): 3216-3220.
[13]	GUAN Feifan, YU Mei, SONG Yang, SHAO Hua, JIANG Gangyi. Objective quality assessment method of high dynamic range image [J]. Journal of Computer Applications, 2017, 37(3): 695-698.
[14]	WANG Changzheng, MAO Jianlin, FU Lixa, GUO Ning, QU Weixian. Coverage optimization algorithm for three-dimensional directional heterogeneous sensor network [J]. Journal of Computer Applications, 2016, 36(9): 2362-2366.
[15]	LI Hua, WANG Xuyang, YANG Huamin, HAN Cheng. Illumination direction measurement based on halo analysis in high-dynamic range images [J]. Journal of Computer Applications, 2016, 36(5): 1387-1393.

Augmented reality approach based on digital camera and temporal psycho-visual modulation

基于数字相机和时间心理视觉调制的增强现实技术

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics