Illumination direction measurement based on halo analysis in high-dynamic range images

doi:10.11772/j.issn.1001-9081.2016.05.1387

Abstract

Abstract: Aiming at the illumination consistency of complex scenes in Augmented Reality (AR) system and analyzing the marker images by High-Dynamic Range (HDR) technology, an improved measurement algorithm for illumination direction based on the analysis of halo in HDR images was proposed. In order to improve the immersion and reality of virtual objects, after researching and analyzing the existing illumination recovery algorithms, a camera calibration method was proposed by utilizing the projection invariance of the quadratic curve pair. In order to get detailed light information, HDR was used to process marker image to improve accuracy. Refering to Lambert illumination model, the light information of image was analyzed to classify the shooting angle, and the improvement of traditional light source direction measuring was realized, part of the directions of the light sources outside of the photography ball reflection range was measured. The shooting 1 and shooting 2 of the single point light source were tested and analyzed. The experimental results show that this method is simple, robust, and can measure the direction of partial illumination outside the mirror ball reflection range no matter whether the marker is partially shaded or not.

Key words: Augmented Reality (AR), immersion, illumination recovering, camera calibration, High-Dynamic Range (HDR)

摘要： 针对增强现实(AR)系统中复杂场景的光照一致性问题,运用高动态范围(HDR)图像处理技术对标识物图像进行分析,提出一种基于HDR图像中光晕分析的光照方向测算算法。为了提高虚拟物体的沉浸感和真实性,在研究和分析现有的光照恢复算法的基础上,利用二次曲线对的投影不变性原理进行相机标定;为了获得更加详尽的光照信息,使用HDR技术对标识物图像进行处理,提高了测算精确度;参照Lambert光照模型对图像中的光照信息进行分析,将拍摄角度进行分类,实现了对传统测算光源方向算法的改进,可测算出位于摄影球反射范围外的部分光源的方向,扩大了测算范围。设计了针对单一点光源的视角1和视角2测算验证实验,并进行了分析。实验验证表明,所提方法简单易行,具有较强的鲁棒性,能够实现在标识物部分遮挡的情况下,测算出位于摄影球反射范围外部分光源的方向。

关键词: 增强现实, 沉浸感, 光照恢复, 相机标定, 高动态范围

CLC Number:

TP193.41

LI Hua, WANG Xuyang, YANG Huamin, HAN Cheng. Illumination direction measurement based on halo analysis in high-dynamic range images[J]. Journal of Computer Applications, 2016, 36(5): 1387-1393.

李华, 王旭阳, 杨华民, 韩成. 基于高动态范围图像中光晕分析的光照方向测算算法[J]. 计算机应用, 2016, 36(5): 1387-1393.

References

[1] 叶东文, 陈国栋. 混合场景中光照一致性研究[J]. 计算机应用研究, 2015, 32(9):2874-2876. (YE D W, CHEN G D. Research of illumination consistency in hybrid scene[J]. Application Research of Computers, 2015, 32(9):2874-2876.)
[2] 李自力, 朱光喜, 朱耀庭.一种基于会聚双目立体视觉的用户化身模型[J]. 电子与信息学报, 2003, 25(6):763-770. (LI Z L, ZHU G X, ZHU Y T. A customization model based on convergent binocular stereo vision[J]. Journal of Electronics & Information Technology, 2003, 25(6):763-770.)
[3] ZHENG Q, CHELLAPPA R. Estimation of illuminant direction, albedo, and shape from shading[C]//Proceedings of the 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 1991:540-545.
[4] DONG Y, CHEN G, PEERS P, et al. Appearance-from-motion:recovering spatially varying surface reflectance under unknown lighting[J]. ACM Transactions on Graphics (TOG), 2014, 33(6):193.
[5] MADSEN C, LAURSEN R. A scalable GPU-based approach to shading and shadowing for photo-realistic real-time augmented reality[J]. International Conference on Computer Graphics Theory and Applications, 2007, 1(4):252-261.
[6] NAN L, XIE K, SHARF A. A search-classify approach for cluttered indoor scene understanding[J]. ACM Transactions on Graphics (TOG), 2012, 31(6):137.
[7] 周雅, 晏磊, 赵虎. 增强现实系统光照模型建立研究[J]. 中国图象图形学报, 2004, 9(8):968-971. (ZHOU Y, YAN L, ZHAO H. Study on the lighting model of the real world in augmented reality[J]. Journal of Image and Graphics, 2004, 9(8):968-971.)
[8] 丰艳. 增强现实系统虚实无缝融合相关问题研究[D]. 上海:上海大学, 2007:106-138. (FENG Y. Research on seamless fusion of real and virtual scenes in augmented reality system[D]. Shanghai:Shanghai University, 2007:106-138.)
[9] 王珂. 增强现实中虚实光照一致性研究综述[J]. 光电技术应用, 2013, 28(6):6-12. (WANG K. Research on virtual-real illumination consistency in augment reality scene[J]. Electro-Optic Technology Application, 2013, 28(6):6-12.)
[10] 沈沉, 沈向洋, 马颂德. 基于图像的光照模型研究综述[J]. 计算机学报, 2000, 23(12):1261-1269. (SHEN C, SHEN X Y, MA S D. A survey of image-based illumination model[J]. Chinese Journal of Computers, 2000, 23(12):1261-1269.)
[11] 李粉莉, 童小念. 基于增强现实的图像光照一致性模型探讨[J]. 电脑知识与技术, 2011, 7(9):6195-6196. (LI F L, TONG X N. Image illumination coherence based on augment reality[J]. Computer Knowledge and Technology, 2011, 7(9):6195-6196.)
[12] 姚远, 朱淼良. 增强现实场景光源的实时检测方法和真实感渲染框架[J]. 计算机辅助设计与图形学学报, 2006.18(8):1270-1275. (YAO Y, ZHU M L. A framework for lighting detection and scene rendering in AR environment[J]. Journal of Computer-aided Design & Computer Graphics, 2006, 18(8):1270-1275.)
[13] KANBARA M, YOKOYA N. Real-time estimation of light source environment for photorealistic augmented reality[C]//Proceedings of the 17th International Conference on Pattern Recognition. Washington, DC:IEEE Computer Society, 2004:911-914.
[14] 侯志强, 黄安奇, 余旺盛, 等. 基于局部分块和模型更新的视觉跟踪算法[J].电子与信息学报, 2015, 37(6):1357-1364. (HOU Z Q, HUANG A Q, YU W S, et al. Visual object tracking method based on local patch model and model update[J]. Journal of Electronics & Information Technology, 2015, 37(6):1357-1364.)
[15] 彭勃宇, 王崴, 周诚, 等. 面向增强现实的SUSAN-SURF快速匹配算法[J]. 计算机应用研究, 2015, 32(8):538-2542. (PENG B Y, WANG W, ZHOU C, et al. SUSAN-SURF fast matching algorithm for augment reality[J]. Application Research of Computers, 2015, 32(8):2538-2542.)
[16] 张勇, 王志锋, 李丹阳. 一种改进的SIFT特征点匹配方法[J]. 广东通信技术, 2015, 35(5):25-29. (ZHANG Y, WANG Z F, LI D Y. A modified SIFT feature points matching algorithm[J]. Guangdong Communication Technology, 2015, 35(5):25-29.)
[17] 黄伟国, 胡大盟, 杨剑宇, 等. 用于遮挡形状匹配的弦角特征描述[J]. 光学精密工程, 2015, 23(6):1758-1767. (HUANG W G, HU D M, YANG J Y, et al. Chord angle representation for shape matching under occlusion[J]. Optics and Precision Engineering, 2015, 23(6):1758-1767.)
[18] HU M K. Visual pattern recognition by moment invariants[J]. IRE Transactions on Information Theory, 1962, 8(2):179-187.
[19] ZAHN C T, ROSKIES R Z. Fourier descriptors for plane closed curves[J]. IEEE Transactions on Computers, 1972, 100(3):269-281.
[20] MA J, WU C K, LU X R. A fast shape descriptor[J]. Computer Vision, Graphics, and Image Processing, 1986, 34(3):282-291.
[21] 徐正伟, 吴成柯. 二维形状的透视不变性识别[J]. 自动化学报, 1995, 23(4):431-439. (XU Z W, WU C K. Perspective invariance recognition of two-dimensional shape[J]. Acta Automatica Ainica, 1995, 23(4):431-439.)
[22] 韩笑, 廖粤峰. 基于平面二次曲线的非单视点全景相机标定方法[J]. 计算机与现代化, 2015, 18(7):59-64. (HAN X, LIAO Y F. Calibration method for non-single viewpoint omnidirectional cameras based on planar curve[J]. Computer and Modernization, 2015, 18(7):9-64.)
[23] ZHANG Z. Flexible camera calibration by viewing a plane from unknown orientations[C]//Proceedings of the 7th IEEE International Conference on Computer Vision. Piscataway, NJ:IEEE, 1999, 1:666-673.
[24] 李莉. OpenCV耦合改进张正友算法的相机标定算法[J]. 轻工机械, 2015, 33(4):60-63.(LI L. Camera calibration algorithm based on OpenCV and improved Zhang Zhengyou algorithm[J]. Light Industry Machinery, 2015, 33(4):60-63.)
[25] 刘艳, 李腾飞. 对张正友相机标定法的改进研究[J]. 光学技术, 2014, 19(6):565-570. (LIU Y, LI T F. Research of the improved of Zhang's camera calibration method[J]. Optical Technique, 2014, 19(6):565-570.)
[26] 王颁法, 肖昭然, 张斌. 基于Matlab的图像预处理技术在相机标定中的应用研究[J]. 河南科技, 2014(21):66, 81. (WANG B F, XIAO Z R, ZHANG B. Application research based on image preprocessing technology in Matlab for camera calibration[J]. Journal of Henan Science and Technology, 2014(21):66, 81.)
[27] VOGIATZIS G, HERNÁNDEZ C. WITHDRAWN:Video-based, real-time multi-view stereo[J]. Image & Vision Computing, 2012, 4(7):434-441.
[28] 谭茗. 基于视觉的增强现实系统中的光照一致性研究[D]. 长沙:湖南大学, 2009:19-73. (TAN M. The study of consistent illumination in visual-based augmented reality[D]. Changsha:Hunan University, 2009:19-73.)
[29] DEBEVEC P E, MALIK J. Recovering high dynamic range radiance maps from photographs[C]//Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. New York:ACM, 2008:31.
[30] ZHANG Y, YANG Y H. Multiple illuminant direction detection with application to image synthesis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(8):915-920.
[31] BOUGANIS C, BROOKES M. Multiple light source detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(4):509-514.
[32] FENG Y. Estimation of light source environment for illumination consistency of augmented reality[C]//Proceedings of the 2008 Congress on Congress on Image and Signal Processing. Washington, DC:IEEE Computer Society, 2008, 3:771-775.