基于depth-map和分布式视频编码的多视点视频传输方法

doi:10.3724/SP.J.1087.2012.02441

计算机应用 ›› 2012, Vol. 32 ›› Issue (09): 2441-2444.DOI: 10.3724/SP.J.1087.2012.02441

基于depth-map和分布式视频编码的多视点视频传输方法

吴琳¹,金志刚^1*,赵安安²,周圆¹

1.天津大学电子信息工程学院,天津 300072;
2.天津大学软件学院,天津 300072

收稿日期:2012-03-31 修回日期:2012-05-08 发布日期:2012-09-01 出版日期:2012-09-01
通讯作者: 吴琳
作者简介:吴琳(1987-),女,黑龙江佳木斯人,硕士研究生,主要研究方向:网络多媒体、立体视频; 金志刚(1972-),男,上海人,教授,博士生导师,主要研究方向:无线网络、物联网、网络安全、网络管理; 赵安安(1989-),男,陕西延安人,硕士研究生,主要研究方向:网络多媒体; 周圆(1983-),女,河北石家庄人,讲师,博士,主要研究方向:视频通信、立体视频。
基金资助:
国家863计划项目(2008AA01A320)

Multi-view video transmission method based on depth-map and distributed video coding

WU Lin¹,JIN Zhi-gang^1*,ZHAO An-an²,ZHOU Yuan¹

1.School of Electronic Information Engineering,Tianjin University,Tianjin 300072,China;
2.School of Computer Software,Tianjin University,Tianjin 300072,China

Received:2012-03-31 Revised:2012-05-08 Online:2012-09-01 Published:2012-09-01

摘要/Abstract

摘要： 针对多视点视频传输系统数据量庞大的问题,提出一种基于深度图(depth-map)和分布式视频编码(DVC)的不等错误保护(UEP)传输方法。该方法首先基于多个视点提取深度图;然后,在传输过程中传输一个视点及其深度图;最后,经过网络传输,在解码端由一个视点图及其深度图生成其他视点。由于视点图和深度图在解码端的重要程度不同,对需要传输的视点图和深度图采用不同的分布式视频编码方法,进行不平等的错误保护。仿真实验结果表明,所提传输方法比传统的分布式多视点视频编码传输系统具有更好的抗误码性能,提高了传输可靠性,图像的峰值信噪比(PSNR)约提高1.5dB。

关键词: 分布式视频编码, Wyner-Ziv编码, 深度图, 不等错误保护

Abstract: Concerning the large volume of data of multi-view video transmission system, an Unequal Error Protection (UEP) method based on depth-map and Distributed Video Coding (DVC) was proposed. Firstly, the depth-map based on multi-view was extracted. Secondly, one point view and the depth-map were transmitted. Finally, through the network transmission, other point views were generated by the point view and the depth-map at the decoder. Considering their different importance at the decoder, different distributed video coding methods were used in the point view and the depth-map to realize UEP. The simulation results show that the proposed transmission method provides stronger error resilience and higher transmission reliability, and it improves the Peak Signal-to-Noise Ratio (PSNR) of images about 1. 5 dB than traditional distributed multi-view video coding transmission system.

Key words: Distributed Video Coding (DVC), Wyner-Ziv coding, depth-map, Unequal Error Protection (UEP)

中图分类号:

TN919.85

吴琳金志刚赵安安周圆. 基于depth-map和分布式视频编码的多视点视频传输方法[J]. 计算机应用, 2012, 32(09): 2441-2444.

WU Lin,JIN Zhi-gang,ZHAO An-an,ZHOU Yuan. Multi-view video transmission method based on depth-map and distributed video coding[J]. Journal of Computer Applications, 2012, 32(09): 2441-2444.

参考文献

[1]JOHANSON M.Stereoscopic video transmission over the Internet[C]// Proceedings of the 2nd IEEE Workshop on Internet Applications.Piscataway,NJ:IEEE Press,2001:12-19.
[2]杨中华,戴声奎.新的多视点视频编码优化算法[J].计算机应用,2011,31(9):2461-2464.
[3]潘榕,侯正信,刘昱.多视点视频编码去相关颜色校正[J].计算机应用,2010,30(10):2790-2793.
[4]ZHOU Y,HOU C P,XIANG W.Modeling of transmission distortion for multi-view video in packet lossy networks[C]// GLOBECOM 2010:Proceedings of 2010 IEEE Global Telecommunications Conference.Piscataway,NJ:IEEE Press,2010:1-5.
[5]ZHOU Y,HOU C P,XIANG W.Channel distortion modeling for multi-view video transmission over packet-switched networks[J].IEEE Transactions on Circuits and Systems for Video Technology,2011,21(11):1679-1692.
[6]邓智玭,贾克斌,陈锐霖,等.三维视频编码技术的发展与挑战[J].计算机应用,2011,31(9):2453-2456.
[7]MERKLE P,SMOLIC A,MULLER K,et al.Multi-view video plus depth representation and coding[C]// ICIP 2007:Proceedings of IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2007,1:I-201-I-204.
[8]宋晓炜,杨蕾.一种基于中间视点的多视点立体视频FGS可分级方案[J].计算机应用,2007,27(12):3058-3061.
[9]GAN Z L,ZHU X C.The study status and prospective of distributed video coding[J].Signal Processing,2007,23(1):73-78.
[10]GUILLEMOT C,PEREIRA F,TORRES L,et al.Distributed monoview and multiview video coding[J].IEEE Signal Processing Magazine,2007,24(5):67-76.
[11]LI B,WANG Y M,ZHANG L,et al.Fusion side information based on spatio-temporal correlation in distributed multi-view video coding[C]// Proceedings of the 6th International ICST Conference on Communications and Networking in China.Piscataway,NJ:IEEE Press,2011:76-81.
[12]XIONG H K,WANG H,CHEN C W.Conditional random field based side-information fusion for distributed multi-view video coding[C]// Proceedings of 2011 IEEE Visual Communications and Image Processing.Piscataway,NJ:IEEE Press,2011:1-4.
[13]PRADHAN S S,RAMCHANDRAN K.DIstributed Source Coding Using Syndromes (DISCUS):design and construction[J].IEEE Transactions on Information Theory,2003,49(3):626-643.
[14]KHAN N,KHALID N.Developments in distributed video coding[C]// IWSSIP 2008:Proceedings of the 15th International Conference on Systems,Signals and Image Processing.Piscataway,NJ:IEEE Press,2008:165-168.
[15]

SLEPIAN D,WOLF J.Noiseless coding of correlated information sources [J].IEEE Transactions on Information Theory,1973,19(4):471-480.
[16]WYNER A,ZIV J.The rate-distortion function for source coding with side information at the decoder[J].IEEE Transactions on Information Theory,1976,22(1):1-10.
[17]ARTIGAS X,ANGELI E,TOERRES L.Side information generation for multiview distributed video coding using a fusion approach[J].Signal Processing Symposium,2006,7(9):250-253.

基于depth-map和分布式视频编码的多视点视频传输方法

Multi-view video transmission method based on depth-map and distributed video coding

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	张豪, 张强, 邵思羽, 丁海斌. 深度学习在单图像三维模型重建的应用[J]. 计算机应用, 2020, 40(8): 2351-2357.
[2]	喻露, 胡剑锋, 姚磊岳. 基于人体骨架的非标准深蹲姿势检测方法[J]. 计算机应用, 2019, 39(5): 1448-1452.
[3]	曹海燕, 冯桂, 韩雪, 方定邦, 黄鑫达. 基于深度图的3D-HEVC鲁棒视频水印算法[J]. 计算机应用, 2019, 39(3): 869-873.
[4]	梁中豪, 彭德巍, 金彦旭, 郭梁. 基于交通场景区域增强的单幅图像去雾方法[J]. 计算机应用, 2018, 38(5): 1420-1426.
[5]	陈真真, 卿粼波, 何小海, 汪芸. 基于非均匀量化的小波域分布式深度图视频编码[J]. 计算机应用, 2016, 36(4): 1080-1084.
[6]	余亚玲, 张华, 刘桂华, 史晋芳. 基于不确定度评价的Kinect深度图预处理[J]. 计算机应用, 2016, 36(2): 541-545.
[7]	徐海宁, 陈恩庆, 梁成武. 三维动作识别时空特征提取方法[J]. 计算机应用, 2016, 36(2): 568-573.
[8]	陆中秋, 侯振杰, 陈宸, 梁久祯. 基于深度图像与骨骼数据的行为识别[J]. 计算机应用, 2016, 36(11): 2979-2984.
[9]	尚常军, 丁瑞. 基于曲率局部二值模式的深度图像手势特征提取[J]. 计算机应用, 2016, 36(10): 2885-2889.
[10]	段峰峰, 王永滨, 杨丽芳, 潘淑静. 基于主成分分析方向深度梯度直方图的立体视觉深度图特征提取[J]. 计算机应用, 2016, 36(1): 222-226.
[11]	杨全彭进业. 基于深度图像信息的手语识别算法[J]. 计算机应用, 2013, 33(10): 2882-2885.
[12]	王凤琴陈晓雷陈燕. 基于时空联合的解码边信息插值算法[J]. 计算机应用, 2012, 32(08): 2324-2327.
[13]	罗桂娥徐运彬. 基于Quaternion-Gabor小波运动估计的深度图获取技术[J]. 计算机应用, 2012, 32(01): 238-240.
[14]	邓智玭贾克斌陈锐霖伏长虹萧允治. 三维视频编码技术的发展与挑战[J]. 计算机应用, 2011, 31(09): 2453-2456.
[15]	刘然朱庆生易琳许小艳. 基于图像重投影的视图合成[J]. 计算机应用, 2010, 30(4): 898-901.