Double ring mapping projection for panoramic video

doi:10.11772/j.issn.1001-9081.2017.09.2631

Journal of Computer Applications ›› 2017, Vol. 37 ›› Issue (9): 2631-2635.DOI: 10.11772/j.issn.1001-9081.2017.09.2631

Previous Articles Next Articles

Double ring mapping projection for panoramic video

LIN Chang, LI Guoping, ZHAO Haiwu, WANG Guozhong, GU Xiao

College of Communication and Information Engineering, Shanghai University, Shanghai 200444, China

Received:2017-03-27 Revised:2017-06-12 Online:2017-09-13 Published:2017-09-10
Supported by:
This work is partially supported by National Natural Science Foundation of China (61271212), the National High Technology Research and Development Program (863 Program) of China (2015AA015903).

全景视频双环带映射算法

林畅, 李国平, 赵海武, 王国中, 顾晓

上海大学通信与信息工程学院, 上海 200444

通讯作者: 赵海武,zhaohaiwu@i.shu.edu.cn
作者简介:林畅(1993-),男,浙江温州人,硕士研究生,主要研究方向:视频编解码、全景视频、视频质量评价;李国平(1974-),男,上海人,高级工程师,博士,主要研究方向:视频编解码、复用技术;赵海武(1973-),男,河北沧州人,高级工程师,博士,主要研究方向:视频编解码、复用技术;王国中(1962-),男,江苏常州人,教授,博士,主要研究方向:视频编解码、多媒体通信;顾晓(1994-),男,上海人,硕士研究生,主要研究方向:视频编解码。
基金资助:
国家自然科学基金资助项目（61271212）；国家863计划项目（2015AA015903）。

Abstract

Abstract: To solve the problem that some area deforms too large and large volume of redundant data in the process of panoramic video mapping, a Double-Ring mapping Projection (DRP) algorithm was proposed. Firstly, according to the geometric characteristics of spherical video and the visual characteristics of Human Visual System (HVS), the spherical video was divided into 14 equal-sized regions by two mutually orthogonal ring areas regions. Then, according to the space domain sampling theorem, the 14 regions corresponding to the spherical video content were mapped to 14 rectangular videos with the same size by Lanczos interpolation method. Finally, according to the characteristics of the latest video coding standard, the 14 rectangular videos were rearranged to get a compact panoramic video in keeping with coding standards. The experimental results show that the DRP algorithm achieve a higher compression efficiency compared with the EquiRectangular mapping Projection (ERP) algorithm, OctaHedral mapping Projection (OHP) algorithm and IcoSahedral mapping Projection (ISP) algorithm. Specifically, compared with the most popular ERP algorithm, the proposed method reduces the bit rate by 8.61% which obviously improves the coding efficiency.

Key words: video coding, panoramic video, Virtual Reality (VR), image interpolation, spherical video mapping, immerse video

摘要： 针对全景视频映射过程中局部区域变形过大、冗余数据量极高的问题，提出了一种双环带映射算法（DRP）。首先，根据球面视频的几何特点，结合人眼视度（HVS）这一视觉特性，用两个相互正交的环形区域，将球面视频分割成14个大小相近的区域；然后根据空域采样定理，采用兰索斯插值法，将这14个区域对应的球面视频内容映射为14个大小相等的矩形视频；最后，根据最新视频编码标准的特点，重新排列这14个矩形视频，得到符合编码器标准的紧凑的全景视频。实验结果表明，与经纬图映射算法（ERP）、八面体映射算法（OHP）、二十面体映射算法（ISP）相比，DRP算法在视频压缩性能方面有良好的表现；其中同最流行的ERP算法相比，码率平均降低8.61%，明显提升了视频编码效率。

关键词: 视频编码, 全景视频, 虚拟现实, 图像插值, 球面映射, 沉浸式视频

CLC Number:

TN919.81

LIN Chang, LI Guoping, ZHAO Haiwu, WANG Guozhong, GU Xiao. Double ring mapping projection for panoramic video[J]. Journal of Computer Applications, 2017, 37(9): 2631-2635.

林畅, 李国平, 赵海武, 王国中, 顾晓. 全景视频双环带映射算法[J]. 计算机应用, 2017, 37(9): 2631-2635.

References

[1] HUANG K C, CHIEN P Y, CHIEN C A, et al. A 360-degree panoramic video system design[C]//Proceedings of the 2014 International Symposium on VLSI Design, Automation and Test. Piscataway, NJ:IEEE, 2014:1-4.
[2] SULLIVAN G J, OHM J, HAN W J, et al. Overview of the High Efficiency Video Coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(12):1649-1668.
[3] 黄铁军.AVS2标准及未来展望[J].电视技术,2014,38(22):7-10.(HUANG T J. AVS2 standard and future prospects[J]. Video Engineering, 2014, 38(22):7-10.)
[4] NG K T, CHAN S C, SHUM H Y. Data compression and transmission aspects of panoramic videos[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2005, 15(1):82-95.
[5] ALFACE P R, MACQ J F, VERZIJP N. Interactive omnidirectional video delivery:a bandwidth-effective approach[J]. Bell Labs Technical Journal, 2012, 16(4):135-147.
[6] TZAVIDAS S, KATSAGGELOS A K. A multicamera setup for generating stereo panoramic video[J]. IEEE Transactions on Multimedia, 2005, 7(5):880-890.
[7] LIN H C, HUANG C C, LI C Y, et al. AHG8:InterDigital's projection format conversion tool[C]//Proceedings of the 4th Meeting Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET-D0021. Chengdu:[s.n.], 2016:7-8.
[8] SRI N A, ANUBHAV S, AMITH D, et al. AHG8:efficient frame packing for icosahedral projection[C]//Proceedings of the 5th Meeting Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET-E0029. Geneva:[s.n.], 2017:1-5.
[9] WANG Y M, WANG R G, WANG Z Y, et al. Projection CE:polerect projection[C]//Proceedings of the 6th Meeting IEEE 1857.9 Working Group, 1857.9-06-M1072. Haikou:[s.n.], 2016:1-3.
[10] JILL B, ELENA A, ADEEL A, et al. JVET common test conditions and evaluation procedures for 360° video[C]//Proceedings of the 5th Meeting Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET-E1030. Geneva:[s.n.], 2017:1-4.
[11] ZHANG C, LU Y, WEN Z. AHG8:Segmented Sphere Projection (SSP) for 360-degree video content[C]//Proceedings of the 4th Meeting Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET-D0030. Chengdu:[s.n.], 2016:1-4.
[12] YU M, LAKSHMAN H, GIROD B. A framework to evaluate omnidirectional video coding schemes[C]//Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality. Washington, DC:IEEE Computer Society, 2015:31-36.
[13] SAVINO P J, DANESH-MEYER H V. Color Atlas and Synopsis of Clinical Ophthalmology-Wills Eye Institute-Neuro-Ophthalmology[M]. Philadelphia, PA:Lippincott Williams & Wilkins, 2012:45-51.
[14] CIANCI P J, FINN B S. High Definition Television:the Creation, Development and Implementation of HDTV Technology[M].[S.l.]:McFarland, 2012:56-58.
[15] TURKOWSKI K. Filters for common resampling tasks[M]//Graphics Gems. San Diego, CA:Academic Press Professional, 1990:147-165.
[16] IEEE Standards Association. Develop Standards[EB/OL].[2017-01-03]. http://standards.ieee.org/develop/wg/AVS_1857_WG.html.
[17] CHEN J, ZHANG J. Projection CE:summary report[C]//Proceedings of the 6th Meeting IEEE 1857.9 Working Group, 1857.9-06-M1072. Haikou:[s.n.], 2016:1-6.
[18] 钟力,胡晓峰.全景视频的信息组织和实现方法[J].小型微型计算机系统,1996,17(12):1-5.(ZHONG L, HU X F. Information organization and implementation of panoramic video[J]. Mini-Micro Systems, 1996, 17(12):1-5.)
[19] 赵沁平.虚拟现实综述[J].中国科学(F辑:信息科学),2009,39(1):2-46.(ZHAO Q P.Virtual reality review[J]. Chinese Science (F Series:Information Science, 2009, 39(1):2-46.)
[20] 黄心渊.虚拟现实技术与应用[M].北京:科学出版社,1999:234-247.(HUANG X Y. Virtual Reality Technology and Application[M]. Beijing:Science Press, 1999:234-247.)

Double ring mapping projection for panoramic video

全景视频双环带映射算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	Junjie LI, Yumei WANG, Zhijun LI, Yu LIU. Survey on tile-based viewport adaptive streaming scheme of panoramic video [J]. Journal of Computer Applications, 2024, 44(2): 536-547.
[2]	Xu YANG, Hongwei GUO, Wanxue LI. Optimized bit allocation algorithm for coding tree unit level [J]. Journal of Computer Applications, 2023, 43(10): 3195-3201.
[3]	Hongwei GUO, Xiangsuo FAN, Shuai LIU, Xiang WEI, Lingli ZHAO. Video coding optimization algorithm based on rate-distortion characteristic [J]. Journal of Computer Applications, 2022, 42(3): 946-952.
[4]	Jieke WANG, Lin LI, Hailong ZHANG, Liping ZHENG. Passive haptic interaction method for multiple virtual targets in vast virtual reality space [J]. Journal of Computer Applications, 2022, 42(11): 3544-3550.
[5]	Shouming HOU, Chaolan JIA, Mingmin ZHANG. Review of eye movement‑based interaction techniques for virtual reality systems [J]. Journal of Computer Applications, 2022, 42(11): 3534-3543.
[6]	JIANG Lin, SHI Jiaqi, LI Yuancheng. Parallel design and implementation of synthetic view distortion change algorithm in reconfigurable structure [J]. Journal of Computer Applications, 2021, 41(6): 1734-1740.
[7]	LUO Zhiwei, LIU Chibiao. Video watermarking algorithm based on H.266/versatile video coding with intra frame dual mode [J]. Journal of Computer Applications, 2021, 41(2): 456-460.
[8]	WANG Yi, LYU Jian, YOU Qian, ZHAO Zeyu, YAN Baoming, ZHU Shuman. Virtual reality arbitrary shape selection model based on Fitts' law [J]. Journal of Computer Applications, 2020, 40(11): 3320-3326.
[9]	ZHOU Yizhao, WANG Xiaodong, ZHANG Lianjun, LAN Qiongqiong. Selective encryption scheme based on Logistic and Arnold transform in high efficiency video coding [J]. Journal of Computer Applications, 2019, 39(10): 2973-2979.
[10]	LI Zhuo, XU Zhe, CHEN Xin, LI Shuqin. Embedded real-time compression for hyper-spectral images based on KLT and HEVC [J]. Journal of Computer Applications, 2018, 38(8): 2393-2397.
[11]	GUO Lei, WANG Xiaodong, XU Bowen, WANG Jian. Fast intra mode prediction decision and coding unit partition algorithm based on high efficiency video coding [J]. Journal of Computer Applications, 2018, 38(4): 1157-1163.
[12]	HU Min, LI Chong, LU Rongrong, HUANG Hongcheng. Performance analysis of motor imagery training based on 3D visual guidance [J]. Journal of Computer Applications, 2018, 38(3): 836-841.
[13]	LIU Yanjun, ZHAO Zhiqiang, LIU Yan, CUI Ying, WANG Dayong, RAN Peng, GUO Yijun. Fast intra algorithm based on quality scalable high efficiency video coding [J]. Journal of Computer Applications, 2018, 38(10): 2960-2964.
[14]	ZHAN Yi, LI Meng. Variable exponent variational model for image interpolation [J]. Journal of Computer Applications, 2017, 37(7): 2067-2070.
[15]	REN Shuai, SUO Li, ZHANG Tao, YANG Tao, MU Dejun. Information hiding algorithm based on 3D high efficiency video coding background [J]. Journal of Computer Applications, 2017, 37(6): 1616-1619.