基于高动态范围图像中光晕分析的光照方向测算算法

doi:10.11772/j.issn.1001-9081.2016.05.1387

计算机应用 ›› 2016, Vol. 36 ›› Issue (5): 1387-1393.DOI: 10.11772/j.issn.1001-9081.2016.05.1387

基于高动态范围图像中光晕分析的光照方向测算算法

李华, 王旭阳, 杨华民, 韩成

长春理工大学计算机科学技术学院, 长春 130022

收稿日期:2015-10-19 修回日期:2015-12-12 发布日期:2016-05-09 出版日期:2016-05-10
通讯作者: 王旭阳
作者简介:李华(1977-),女,吉林长春人,副教授,硕士,主要研究方向:计算机仿真建模、虚拟现实;王旭阳(1991-),男,吉林长春人,硕士研究生,主要研究方向:虚拟现实、光照一致性;杨华民(1963-),男,吉林长春人,教授,博士生导师,博士,主要研究方向:虚拟现实、数字媒体、图像处理;韩成(1978-),男,吉林长春人,副教授,博士,主要研究方向:虚拟现实、计算机视觉、智能控制。
基金资助:
吉林省重大科技攻关项目(2012ZDGG004)。

Illumination direction measurement based on halo analysis in high-dynamic range images

LI Hua, WANG Xuyang, YANG Huamin, HAN Cheng

College of Computer Science and Technology, Changchun University of Science and Technology, Changchun Jilin 130022, China

Received:2015-10-19 Revised:2015-12-12 Online:2016-05-09 Published:2016-05-10
Supported by:
This work is partially supported by the Major Science and Technology Project of Jilin Province (2012ZDGG004).

摘要/Abstract

摘要： 针对增强现实(AR)系统中复杂场景的光照一致性问题,运用高动态范围(HDR)图像处理技术对标识物图像进行分析,提出一种基于HDR图像中光晕分析的光照方向测算算法。为了提高虚拟物体的沉浸感和真实性,在研究和分析现有的光照恢复算法的基础上,利用二次曲线对的投影不变性原理进行相机标定;为了获得更加详尽的光照信息,使用HDR技术对标识物图像进行处理,提高了测算精确度;参照Lambert光照模型对图像中的光照信息进行分析,将拍摄角度进行分类,实现了对传统测算光源方向算法的改进,可测算出位于摄影球反射范围外的部分光源的方向,扩大了测算范围。设计了针对单一点光源的视角1和视角2测算验证实验,并进行了分析。实验验证表明,所提方法简单易行,具有较强的鲁棒性,能够实现在标识物部分遮挡的情况下,测算出位于摄影球反射范围外部分光源的方向。

关键词: 增强现实, 沉浸感, 光照恢复, 相机标定, 高动态范围

Abstract: Aiming at the illumination consistency of complex scenes in Augmented Reality (AR) system and analyzing the marker images by High-Dynamic Range (HDR) technology, an improved measurement algorithm for illumination direction based on the analysis of halo in HDR images was proposed. In order to improve the immersion and reality of virtual objects, after researching and analyzing the existing illumination recovery algorithms, a camera calibration method was proposed by utilizing the projection invariance of the quadratic curve pair. In order to get detailed light information, HDR was used to process marker image to improve accuracy. Refering to Lambert illumination model, the light information of image was analyzed to classify the shooting angle, and the improvement of traditional light source direction measuring was realized, part of the directions of the light sources outside of the photography ball reflection range was measured. The shooting 1 and shooting 2 of the single point light source were tested and analyzed. The experimental results show that this method is simple, robust, and can measure the direction of partial illumination outside the mirror ball reflection range no matter whether the marker is partially shaded or not.

Key words: Augmented Reality (AR), immersion, illumination recovering, camera calibration, High-Dynamic Range (HDR)

中图分类号:

TP193.41

李华, 王旭阳, 杨华民, 韩成. 基于高动态范围图像中光晕分析的光照方向测算算法[J]. 计算机应用, 2016, 36(5): 1387-1393.

LI Hua, WANG Xuyang, YANG Huamin, HAN Cheng. Illumination direction measurement based on halo analysis in high-dynamic range images[J]. Journal of Computer Applications, 2016, 36(5): 1387-1393.

参考文献

[1] 叶东文, 陈国栋. 混合场景中光照一致性研究[J]. 计算机应用研究, 2015, 32(9):2874-2876. (YE D W, CHEN G D. Research of illumination consistency in hybrid scene[J]. Application Research of Computers, 2015, 32(9):2874-2876.)
[2] 李自力, 朱光喜, 朱耀庭.一种基于会聚双目立体视觉的用户化身模型[J]. 电子与信息学报, 2003, 25(6):763-770. (LI Z L, ZHU G X, ZHU Y T. A customization model based on convergent binocular stereo vision[J]. Journal of Electronics & Information Technology, 2003, 25(6):763-770.)
[3] ZHENG Q, CHELLAPPA R. Estimation of illuminant direction, albedo, and shape from shading[C]//Proceedings of the 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 1991:540-545.
[4] DONG Y, CHEN G, PEERS P, et al. Appearance-from-motion:recovering spatially varying surface reflectance under unknown lighting[J]. ACM Transactions on Graphics (TOG), 2014, 33(6):193.
[5] MADSEN C, LAURSEN R. A scalable GPU-based approach to shading and shadowing for photo-realistic real-time augmented reality[J]. International Conference on Computer Graphics Theory and Applications, 2007, 1(4):252-261.
[6] NAN L, XIE K, SHARF A. A search-classify approach for cluttered indoor scene understanding[J]. ACM Transactions on Graphics (TOG), 2012, 31(6):137.
[7] 周雅, 晏磊, 赵虎. 增强现实系统光照模型建立研究[J]. 中国图象图形学报, 2004, 9(8):968-971. (ZHOU Y, YAN L, ZHAO H. Study on the lighting model of the real world in augmented reality[J]. Journal of Image and Graphics, 2004, 9(8):968-971.)
[8] 丰艳. 增强现实系统虚实无缝融合相关问题研究[D]. 上海:上海大学, 2007:106-138. (FENG Y. Research on seamless fusion of real and virtual scenes in augmented reality system[D]. Shanghai:Shanghai University, 2007:106-138.)
[9] 王珂. 增强现实中虚实光照一致性研究综述[J]. 光电技术应用, 2013, 28(6):6-12. (WANG K. Research on virtual-real illumination consistency in augment reality scene[J]. Electro-Optic Technology Application, 2013, 28(6):6-12.)
[10] 沈沉, 沈向洋, 马颂德. 基于图像的光照模型研究综述[J]. 计算机学报, 2000, 23(12):1261-1269. (SHEN C, SHEN X Y, MA S D. A survey of image-based illumination model[J]. Chinese Journal of Computers, 2000, 23(12):1261-1269.)
[11] 李粉莉, 童小念. 基于增强现实的图像光照一致性模型探讨[J]. 电脑知识与技术, 2011, 7(9):6195-6196. (LI F L, TONG X N. Image illumination coherence based on augment reality[J]. Computer Knowledge and Technology, 2011, 7(9):6195-6196.)
[12] 姚远, 朱淼良. 增强现实场景光源的实时检测方法和真实感渲染框架[J]. 计算机辅助设计与图形学学报, 2006.18(8):1270-1275. (YAO Y, ZHU M L. A framework for lighting detection and scene rendering in AR environment[J]. Journal of Computer-aided Design & Computer Graphics, 2006, 18(8):1270-1275.)
[13] KANBARA M, YOKOYA N. Real-time estimation of light source environment for photorealistic augmented reality[C]//Proceedings of the 17th International Conference on Pattern Recognition. Washington, DC:IEEE Computer Society, 2004:911-914.
[14] 侯志强, 黄安奇, 余旺盛, 等. 基于局部分块和模型更新的视觉跟踪算法[J].电子与信息学报, 2015, 37(6):1357-1364. (HOU Z Q, HUANG A Q, YU W S, et al. Visual object tracking method based on local patch model and model update[J]. Journal of Electronics & Information Technology, 2015, 37(6):1357-1364.)
[15] 彭勃宇, 王崴, 周诚, 等. 面向增强现实的SUSAN-SURF快速匹配算法[J]. 计算机应用研究, 2015, 32(8):538-2542. (PENG B Y, WANG W, ZHOU C, et al. SUSAN-SURF fast matching algorithm for augment reality[J]. Application Research of Computers, 2015, 32(8):2538-2542.)
[16] 张勇, 王志锋, 李丹阳. 一种改进的SIFT特征点匹配方法[J]. 广东通信技术, 2015, 35(5):25-29. (ZHANG Y, WANG Z F, LI D Y. A modified SIFT feature points matching algorithm[J]. Guangdong Communication Technology, 2015, 35(5):25-29.)
[17] 黄伟国, 胡大盟, 杨剑宇, 等. 用于遮挡形状匹配的弦角特征描述[J]. 光学精密工程, 2015, 23(6):1758-1767. (HUANG W G, HU D M, YANG J Y, et al. Chord angle representation for shape matching under occlusion[J]. Optics and Precision Engineering, 2015, 23(6):1758-1767.)
[18] HU M K. Visual pattern recognition by moment invariants[J]. IRE Transactions on Information Theory, 1962, 8(2):179-187.
[19] ZAHN C T, ROSKIES R Z. Fourier descriptors for plane closed curves[J]. IEEE Transactions on Computers, 1972, 100(3):269-281.
[20] MA J, WU C K, LU X R. A fast shape descriptor[J]. Computer Vision, Graphics, and Image Processing, 1986, 34(3):282-291.
[21] 徐正伟, 吴成柯. 二维形状的透视不变性识别[J]. 自动化学报, 1995, 23(4):431-439. (XU Z W, WU C K. Perspective invariance recognition of two-dimensional shape[J]. Acta Automatica Ainica, 1995, 23(4):431-439.)
[22] 韩笑, 廖粤峰. 基于平面二次曲线的非单视点全景相机标定方法[J]. 计算机与现代化, 2015, 18(7):59-64. (HAN X, LIAO Y F. Calibration method for non-single viewpoint omnidirectional cameras based on planar curve[J]. Computer and Modernization, 2015, 18(7):9-64.)
[23] ZHANG Z. Flexible camera calibration by viewing a plane from unknown orientations[C]//Proceedings of the 7th IEEE International Conference on Computer Vision. Piscataway, NJ:IEEE, 1999, 1:666-673.
[24] 李莉. OpenCV耦合改进张正友算法的相机标定算法[J]. 轻工机械, 2015, 33(4):60-63.(LI L. Camera calibration algorithm based on OpenCV and improved Zhang Zhengyou algorithm[J]. Light Industry Machinery, 2015, 33(4):60-63.)
[25] 刘艳, 李腾飞. 对张正友相机标定法的改进研究[J]. 光学技术, 2014, 19(6):565-570. (LIU Y, LI T F. Research of the improved of Zhang's camera calibration method[J]. Optical Technique, 2014, 19(6):565-570.)
[26] 王颁法, 肖昭然, 张斌. 基于Matlab的图像预处理技术在相机标定中的应用研究[J]. 河南科技, 2014(21):66, 81. (WANG B F, XIAO Z R, ZHANG B. Application research based on image preprocessing technology in Matlab for camera calibration[J]. Journal of Henan Science and Technology, 2014(21):66, 81.)
[27] VOGIATZIS G, HERNÁNDEZ C. WITHDRAWN:Video-based, real-time multi-view stereo[J]. Image & Vision Computing, 2012, 4(7):434-441.
[28] 谭茗. 基于视觉的增强现实系统中的光照一致性研究[D]. 长沙:湖南大学, 2009:19-73. (TAN M. The study of consistent illumination in visual-based augmented reality[D]. Changsha:Hunan University, 2009:19-73.)
[29] DEBEVEC P E, MALIK J. Recovering high dynamic range radiance maps from photographs[C]//Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. New York:ACM, 2008:31.
[30] ZHANG Y, YANG Y H. Multiple illuminant direction detection with application to image synthesis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(8):915-920.
[31] BOUGANIS C, BROOKES M. Multiple light source detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(4):509-514.
[32] FENG Y. Estimation of light source environment for illumination consistency of augmented reality[C]//Proceedings of the 2008 Congress on Congress on Image and Signal Processing. Washington, DC:IEEE Computer Society, 2008, 3:771-775.

基于高动态范围图像中光晕分析的光照方向测算算法

Illumination direction measurement based on halo analysis in high-dynamic range images

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	谭兆一, 陈白帆. 基于坐标逆映射的增强型车辆三维全景影像[J]. 计算机应用, 2021, 41(4): 1165-1171.
[2]	孙启昌, 麦永锋, 陈晓军. 基于增强现实的手术导航系统快速标定算法[J]. 计算机应用, 2021, 41(3): 833-838.
[3]	罗斌, 于波. 移动边缘计算中基于粒子群优化的计算卸载策略[J]. 计算机应用, 2020, 40(8): 2293-2298.
[4]	周翔, 唐丽玉, 林定. 基于二进制鲁棒不变尺度关键点-加速稳健特征的自然特征虚实注册方法[J]. 计算机应用, 2020, 40(5): 1403-1408.
[5]	刘颖, 王凤伟, 刘卫华, 艾达, 李芸, 杨凡超. 基于亮度分区模糊融合的高动态范围成像算法[J]. 计算机应用, 2020, 40(1): 233-238.
[6]	王克强, 张雨帅, 王保群. 基于Retinex理论的多曝光图像融合算法[J]. 计算机应用, 2019, 39(7): 2087-2092.
[7]	余韵, 连晓灿, 朱宇航, 谭国平. 增强现实场景下移动边缘计算资源分配优化方法[J]. 计算机应用, 2019, 39(1): 22-25.
[8]	高钦泉, 黄伟萍, 杜民, 韦孟宇, 柯栋忠. 基于双目视觉的盆腔微创手术增强现实导航仿真系统的设计[J]. 计算机应用, 2018, 38(9): 2660-2665.
[9]	卢晓勇, 游斌, 林珮瑜, 陈木生. 基于数字相机和时间心理视觉调制的增强现实技术[J]. 计算机应用, 2017, 37(8): 2298-2301.
[10]	管非凡, 郁梅, 宋洋, 邵华, 蒋刚毅. 高动态范围图像客观质量评价方法[J]. 计算机应用, 2017, 37(3): 695-698.
[11]	张建法, 张峰峰, 孙立宁, 匡绍龙. 基于C形臂的手术导航相机标定方法[J]. 计算机应用, 2016, 36(8): 2327-2331.
[12]	王海鹏, 王正良, 许威威, 范然. 基于三维模型的Android手机端人脸姿态实时估计系统[J]. 计算机应用, 2015, 35(8): 2321-2326.
[13]	王琳, 赵健康, 夏轩, 龙海辉. 基于双目立体视觉技术的桥梁裂缝测量系统[J]. 计算机应用, 2015, 35(3): 901-904.
[14]	胡庆新陈云方静. 基于多尺度分解的色调映射算法[J]. 计算机应用, 2014, 34(3): 785-789.
[15]	尹晓晴李靖熊志辉王炜张茂军. 基于单投影仪与柱面反射镜的沉浸感显示系统[J]. 计算机应用, 2012, 32(11): 3149-3152.