Visual‑saliency‑driven reuse algorithm of indirect lighting in 3D scene rendering

doi:10.11772/j.issn.1001-9081.2021122181

Journal of Computer Applications ›› 2022, Vol. 42 ›› Issue (11): 3551-3557.DOI: 10.11772/j.issn.1001-9081.2021122181

Special Issue: 第二十一届中国虚拟现实大会

• ChinaVR 2021 • Previous Articles Next Articles

Visual‑saliency‑driven reuse algorithm of indirect lighting in 3D scene rendering

Shujie QI, Chunyi CHEN(), Xiaojuan HU, Haiyang YU

School of Computer Science and Technology，Changchun University of Science and Technology，Changchun Jilin 130022，China

Received:2021-12-24 Revised:2022-03-14 Accepted:2022-05-16 Online:2022-05-17 Published:2022-11-10
Contact: Chunyi CHEN
About author:QI Shujie， born in 1996， M. S. candidate. His research interestsinclude realistic 3D graphic drawing.
CHEN Chunyi， born in 1981， Ph. D.， professor. His researchinterests include photorealistic 3D graphic drawing， computer simulation.
HU Xiaojuan， born in 1985， Ph. D.， lecturer. Her researchinterests include machine learning， virtual reality.
YU Haiyang， born in 1989， Ph. D.， lecturer. His research interests include intelligent information processing.
Supported by:
National Natural Science Foundation of China(U19A2063);Science and Technology Development Program of Jilin Province(20180519012JH);Science and Technology Research Project of Education Department of Jilin Province during “the 13th Five?Year Plan”(JJKH20200792KJ)

3D场景渲染的视觉显著性驱动间接光照复用算法

齐淑杰, 陈纯毅(), 胡小娟, 于海洋

长春理工大学计算机科学技术学院，长春 130022

通讯作者: 陈纯毅
作者简介:齐淑杰（1996—），男，山东滨州人，硕士研究生，主要研究方向：真实感三维图形绘制
陈纯毅（1981—），男，重庆人，教授，博士，CCF会员，主要研究方向：真实感三维图形绘制、计算机仿真 chenchunyi@hotmail.com
胡小娟（1985—），女，山东淄博人，讲师，博士，CCF会员，主要研究方向：机器学习、虚拟现实
于海洋（1989—），男，吉林长春人，讲师，博士，主要研究方向：智能信息处理。
基金资助:
国家自然科学基金资助项目(U19A2063);吉林省科技发展计划项目(20180519012JH);吉林省教育厅“十三五”科学技术研究项目(JJKH20200792KJ)

Abstract

Abstract:

In order to accelerate rendering of 3D scenes by path tracing， a visual?saliency?driven reuse algorithm of indirect lighting in 3D scene rendering was proposed. Firstly， according to the characteristics of visual perception that the regions of interest have high saliency， while other regions have low saliency， a 2D saliency map of the scene image was obtained， which consists of color information， edge information， depth information and motion information of the image. Then， the indirect lighting in the high?saliency area was re?rendered， while the indirect lighting of the previous frame was reused in the low?saliency area under certain conditions， thereby accelerating the rendering. Experimental results show that the global lighting effect of the image generated by this method is real， and the rendering speed of the method is improved in several experimental scenes， and the speed can reach up to 5.89 times of that of the high?quality rendering.

Key words: path tracing, indirect lighting, visual perception, saliency map, accelerated rendering

摘要：

为提高路径追踪渲染3D场景的速度，提出3D场景渲染的视觉显著性驱动间接光照复用算法。首先，根据视觉感知中感兴趣区域显著性高、其他区域显著性低的特点得到场景画面的2D显著性图，该显著性图由图像的颜色信息、边缘信息、深度信息以及运动信息构成。然后，重新渲染高显著性区域的间接光照，而低显著性区域则在满足一定条件的情况下复用上一帧的间接光照，达到加速渲染的目的。实验结果表明：该算法生成画面的全局光照效果真实，在多个实验场景下的渲染速度均有提升，速度最高能达到高质量渲染的5.89倍。

关键词: 路径追踪, 间接光照, 视觉感知, 显著性图, 加速渲染

CLC Number:

TP391.41

Shujie QI, Chunyi CHEN, Xiaojuan HU, Haiyang YU. Visual‑saliency‑driven reuse algorithm of indirect lighting in 3D scene rendering[J]. Journal of Computer Applications, 2022, 42(11): 3551-3557.

齐淑杰, 陈纯毅, 胡小娟, 于海洋. 3D场景渲染的视觉显著性驱动间接光照复用算法[J]. 《计算机应用》唯一官方网站, 2022, 42(11): 3551-3557.

Figures/Tables 12

References 18

1	HENDRICH J， MEISTER D， BITTNER J. Parallel BVH construction using progressive hierarchical refinement［J］. Computer Graphics Forum， 2017， 36（2）： 487-494. 10.1111/cgf.13143
2	CHEN Z Q， TAGLIASACCHI A， ZHANG H. BSP‑Net： generating compact meshes via binary space partitioning［C］// Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2020：42-51. 10.1109/cvpr42600.2020.00012
3	张文胜，解骞，钟瑾，等. 基于八叉树邻域分析的光线跟踪加速算法［J］. 图学学报， 2015， 36（3）： 339-344. 10.3969/j.issn.1671-1637.2015.02.013
	ZHANG W S， XIE Q， ZHONG J， et al. Acceleration algorithm in ray tracing by the Octree neighbor finding［J］. Journal of Graphics， 2015， 36（3）： 339-344. 10.3969/j.issn.1671-1637.2015.02.013
4	ZHANG J， GUO H Q， HONG F， et al. Dynamic load balancing based on constrained K‑D tree decomposition for parallel particle tracing［J］. IEEE Transactions on Visualization and Computer Graphics， 2018， 24（1）： 954-963. 10.1109/tvcg.2017.2744059
5	CHEN T S， YU W H， CHEN R Q， et al. Knowledge‑embedded routing network for scene graph generation［C］// Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE， 2019： 6156-6164. 10.1109/cvpr.2019.00632
6	STOKES W A， FERWERDA J A， WALTER B， et al. Perceptual illumination components ［J］. ACM Transactions on Graphics， 2004， 23（3）： 742. 10.1145/1015706.1015795
7	MEYER G W， LIU A H. Color spatial acuity control of a screen subdivision image synthesis algorithm［C］// Proceedings of the SPIE 1666， Human Vision， Visual Processing， and Digital Display III. Bellingham， WA： SPIE， 1992： No.135984. 10.1117/12.135984
8	RAMASUBRAMANIAN M， PATTANAIK S N， GREENBERG D P. A perceptually based physical error metric for realistic image synthesis［C］// Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. New York： ACM， 1999：73-82. 10.1145/311535.311543
9	DRETTAKIS G， BONNEEL N， DACHSBACHER C， et al. An interactive perceptual rendering pipeline using contrast and spatial masking［C］// Proceedings of the 18th Eurographics Symposium on Rendering Techniques. Goslar： Eurographics Association， 2007：297-308.
10	KOCH C， ULLMAN S. Shifts in selective visual attention： towards the underlying neural circuitry［J］. Human Neurobiology， 1985， 4（4）： 219-227.
11	LAVOUÉ G， CORDIER F， SEO H， et al. Visual attention for rendered 3D shapes［J］. Computer Graphics Forum， 2018， 37（2）： 191-203. 10.1111/cgf.13353
12	SUNDSTEDT V， DEBATTISTA K， LONGHURST P， et al. Visual attention for efficient high‑fidelity graphics［C］// Proceedings of the 21st Spring Conference on Computer Graphics. New York： ACM， 2005：169-175. 10.1145/1090122.1090150
13	LONGHURST P， DEBATTISTA K， CHALMERS A. A GPU based saliency map for high‑fidelity selective rendering［C］// Proceedings of the 4th International Conference on Computer Graphics， Virtual Reality， Visualisation and Interaction in Africa. New York： ACM， 2006：21-29. 10.1145/1108590.1108595
14	MENG X X， DU R F， ZWICKER M， et al. Kernel foveated rendering［J］. Proceedings of the ACM on Computer Graphics and Interactive Techniques， 2018， 1（1）： No.5. 10.1145/3203199
15	MCANDREW A. Principles of digital image processing： fundamental techniques［J］. Computing Reviews， 2010， 51（7）： 411-412.
16	GAURAV K， GHANEKAR U. Image steganography based on Canny edge detection， dilation operator and hybrid coding［J］. Journal of Information Security and Applications， 2018， 41： 41-51. 10.1016/j.jisa.2018.05.001
17	XU L M， LV J D. Recognition method for apple fruit based on SUSAN and PCNN［J］. Multimedia Tools and Applications， 2018， 77（6）： 7205-7219. 10.1007/s11042-017-4629-6
18	SCHWARTZ N. Face perception enhances the detection of spatial frequencies between 2-4 cycles per degree （16-32 cycles per face）［J］. Journal of Vision， 2009， 9（8）： No.537. 10.1167/9.8.537

场景	PSNR/dB		SSIM
场景	文献［14］算法	本文算法	文献［14］算法	本文算法
一	48.953 4	49.445 0	0.978 9	0.989 5
二	44.639 3	53.307 2	0.967 4	0.991 8
三	43.671 2	52.006 1	0.970 2	0.989 4

场景	PSNR/dB		SSIM
场景	文献［14］算法	本文算法	文献［14］算法	本文算法
一	48.953 4	49.445 0	0.978 9	0.989 5
二	44.639 3	53.307 2	0.967 4	0.991 8
三	43.671 2	52.006 1	0.970 2	0.989 4

场景	构造显著性图的时间/ms	生成的三角形面片数	绘制时间/ms
场景	构造显著性图的时间/ms	生成的三角形面片数	高质量渲染	文献［14］算法	本文算法
一	7.8	17	10 892	3 879	1 849
二	7.9	15 171	45 054	28 898	14 575
三	8.1	8 185	21 463	9 386	6 121

场景	构造显著性图的时间/ms	生成的三角形面片数	绘制时间/ms
场景	构造显著性图的时间/ms	生成的三角形面片数	高质量渲染	文献［14］算法	本文算法
一	7.8	17	10 892	3 879	1 849
二	7.9	15 171	45 054	28 898	14 575
三	8.1	8 185	21 463	9 386	6 121

场景	每个像素分别发射的光线数
场景	16	64	256	1 024
一	3.071 4	4.876 7	5.842 1	5.890 0
二	2.829 6	3.055 6	3.333 3	3.091 2
三	2.865 9	3.326 1	3.426 3	3.506 1

Visual‑saliency‑driven reuse algorithm of indirect lighting in 3D scene rendering

3D场景渲染的视觉显著性驱动间接光照复用算法

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 12

References 18

Related Articles 15

Recommended Articles

Metrics

[1]	Qiang WANG, Xiaoming HUANG, Qiang TONG, Xiulei LIU. Weakly supervised salient object detection algorithm based on bounding box annotation [J]. Journal of Computer Applications, 2023, 43(6): 1910-1918.
[2]	Quan CHEN, Li LI, Yongle CHEN, Yuexing DUAN. Adversarial attack algorithm for deep learning interpretability [J]. Journal of Computer Applications, 2022, 42(2): 510-518.
[3]	HU Xuemin, YI Chonghui, CHEN Qin, CHEN Xi, CHEN Long. Abnormal crowd behavior detection based on motion saliency map [J]. Journal of Computer Applications, 2018, 38(4): 1164-1169.
[4]	WANG Xin, ZHOU Yun, NING Chen, SHI Aiye. Image saliency detection via adaptive fusion of local and global sparse representation [J]. Journal of Computer Applications, 2018, 38(3): 866-872.
[5]	YANG Fan, LI Jianping, LI Xin, CHEN Leiting. Salient object detection algorithm based on multi-task deep convolutional neural network [J]. Journal of Computer Applications, 2018, 38(1): 91-96.
[6]	CHEN Wenbing, JU Hu, CHEN Yunjie. Salient object detection and extraction method based on reciprocal function and spectral residual [J]. Journal of Computer Applications, 2017, 37(7): 2071-2077.
[7]	GUAN Feifan, YU Mei, SONG Yang, SHAO Hua, JIANG Gangyi. Objective quality assessment method of high dynamic range image [J]. Journal of Computer Applications, 2017, 37(3): 695-698.
[8]	ZHU Zhengyu, WANG Mei. Saliency detection combining foreground and background features based on manifold ranking [J]. Journal of Computer Applications, 2016, 36(9): 2560-2565.
[9]	ZHANG Xu, GAO Jiao, WANG Wanguo, LIU Liang, ZHANG Jingjing. Image mosaic approach of transmission tower based on saliency map [J]. Journal of Computer Applications, 2015, 35(4): 1133-1136.
[10]	LI Junhao, LIU Zhi. Object detection based on visual saliency map and objectness [J]. Journal of Computer Applications, 2015, 35(12): 3560-3564.
[11]	KANG Nian-jin CHEN Zhao-jiong. Large-capacity blind steganography algorithm for color images based on visual perception mechanism [J]. Journal of Computer Applications, 2012, 32(09): 2568-2572.
[12]	DAI Hua WANG Jian-ping. Visual saliency detection algorithm based on Bayes theorem and statistical learning [J]. Journal of Computer Applications, 2012, 32(08): 2288-2290.
[13]	ZHANG Han-bing. Quality evaluation of halftone based on visual perception similarity [J]. Journal of Computer Applications, 2011, 31(10): 2750-2752.
[14]	. Context-aware Focus+Context visualization technique [J]. Journal of Computer Applications, 2011, 31(01): 6-10.
[15]	. Extraction of salient regions in image [J]. Journal of Computer Applications, 2010, 30(06): 1619-1621.