基于时空域相关性的屏幕内容帧间快速编码算法

doi:10.11772/j.issn.1001-9081.2017.09.2643

计算机应用 ›› 2017, Vol. 37 ›› Issue (9): 2643-2647.DOI: 10.11772/j.issn.1001-9081.2017.09.2643

• 计算机视觉与虚拟现实 • 上一篇下一篇

基于时空域相关性的屏幕内容帧间快速编码算法

胡晴晴, 彭宗举, 陈芬

宁波大学信息科学与工程学院, 浙江宁波 315211

收稿日期:2017-03-13 修回日期:2017-04-24 出版日期:2017-09-10 发布日期:2017-09-13
通讯作者: 彭宗举,pengzongju@nbu.edu.cn
作者简介:胡晴晴(1991-),女,山东枣庄人,硕士研究生,主要研究方向:视频信号处理与编码;彭宗举(1973-),男,四川南充人,教授,博士,主要研究方向:视频图像压缩、多媒体信号处理与通信、感知编码;陈芬(1973-),女,四川邻水人,副教授,博士,主要研究方向:图像信号处理、三维视频编码。
基金资助:
浙江省自然科学基金资助项目（LY16F010002， LY15F010005， LY17F010005）；宁波市自然科学基金资助项目（2015A610127， 2015A610124）；宁波大学科研基金（理）/学科项目（xkxl1502）。

Fast inter-frame coding algorithm for screen content based on temporal-spatial correlation

HU Qingqing, PENG Zongju, CHEN Fen

Faculty of Information Science and Engineering, Ningbo University, Ningbo Zhejiang 315211, China

Received:2017-03-13 Revised:2017-04-24 Online:2017-09-10 Published:2017-09-13
Supported by:
This work is partially supported by the Natural Science Foundation of Zhejiang Province (LY16F010002, LY15F010005, LY17F010005), the Natural Science Foundation of Ningbo (2015A610127, 2015A610124), the Research Foundation (Science) or Subject Project of Ningbo University (xkxl1502).

摘要/Abstract

摘要： 针对屏幕内容视频帧间编码的高复杂度问题，提出了一种基于时空域特性的帧间快速编码算法。首先，根据运动静止检测算法将待编码帧分为静止帧和运动帧；然后，对运动和静止帧分别采用不同的编码策略。对于静止帧，在统计分析时域对应编码单元（CU）分割深度和预测模式的基础上，确定CU最佳分割深度和最优预测模式。对于运动帧中的静止最大编码单元（LCU），利用时域相关特性提前终止CU分割，模式选取则只针对大尺寸模式进行预测；对于运动帧中的运动LCU，根据其相邻LCU的运动静止特性确定CU分割深度以及预测模式。实验结果表明，所提算法相比原始编码平台，在BDBR平均上升3.65%的情况下，编码时间平均节省46.40%。所提算法在率失真性能损失可接受的前提下，有效地降低了屏幕内容视频帧间编码复杂度，有利于屏幕内容视频的实时应用。

关键词: 屏幕内容视频, 帧间快速算法, 时空域相关性, 运动静止特性, 编码单元分割深度, 预测模式

Abstract: Aiming at the high complexity problem of inter-frame coding for screen content video, a fast inter-frame algorithm based on temporal-spatial correlation was proposed. Firstly, the encoding frames were classified to static frames and motion frames according to motion-static detection algorithm. Then, different encoding strategies were used for motion and static frames, respectively. For the static frames, the optimal partition depth and the optimal prediction mode of Coding Unit (CU) were determined based on the CU partition depth and the prediction mode of the temporal correlation. For the static Largest CU (LCU) in the motion frames, the CU partition was terminated prematurely by using the temporal correlation, and the mode selection was only for the large size modes. Whereas for the motion LCU in motion frames, the motion-static characteristic of adjacent LCU was utilized to determine the current CU partition depth and prediction mode. The experimental results show that the proposed method can reduce the average coding time by 46.40% when BDBR is increased by 3.65% compared with the original coding platform. The proposed method can significantly reduce the complexity of screen content inter-frame encoding process in the premise of negligible BDBR (Bjøntegaard Delta Bit Rate) performance loss. Therefore the proposed method is beneficial to the real-time application of screen content video.

Key words: screen content video, fast inter-frame algorithm, temporal-spatial correlation, motion-static characteristic, Coding Unit (CU) partition depth, prediction mode

中图分类号:

TN919.81

胡晴晴, 彭宗举, 陈芬. 基于时空域相关性的屏幕内容帧间快速编码算法[J]. 计算机应用, 2017, 37(9): 2643-2647.

HU Qingqing, PENG Zongju, CHEN Fen. Fast inter-frame coding algorithm for screen content based on temporal-spatial correlation[J]. Journal of Computer Applications, 2017, 37(9): 2643-2647.

参考文献

[1] WIEGAND T, OHM J R, SULLIVAN G J, et al. Special section on the joint call for proposals on High Efficiency Video Coding (HEVC) standardization[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2010, 20(12):1661-1666.
[2] WIEGAND T, SULLIVAN G J, BJONTEGAARD G, et al. Overview of the H.264/AVC video coding standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2003, 13(7):560-576.
[3] JOSHI R, XU J, COHEN R, et al. Screen content coding test model 3 encoder description (SCM 3)[R]. Strasbourg, France:The Joint Collaborative Team on Video Coding, 2014.
[4] CHEN C C, XU X, LIAO R L, et al. Screen content coding using non-square intra block copy for HEVC[C]//Proceedings of the 2014 IEEE International Conference on Multimedia and Expo. Washington, DC:IEEE Computer Society, 2014:1-6.
[5] XU J, JOSHI R, COHEN R A. Overview of the emerging HEVC screen content coding extension[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2016, 26(1):50-62.
[6] ZHANG K, AN J, ZHANG X, et al. Symmetric intra block copy in video coding[C]//Proceedings of the 2015 IEEE International Symposium on Circuits and Systems. Piscataway, NJ:IEEE, 2015:521-524.
[7] CHANG T S, LIAO R L, CHEN C C, et al. RCE3:Results of subtest B.1 on N×2N/2N×N intra block copy[R]. San Jose, USA:The Joint Collaborative Team on Video Coding, 2014.
[8] SUN Y C, CHUANG T D, LAI P L, et al. Palette mode-a new coding tool in screen content coding extensions of HEVC[C]//Proceedings of the 2015 IEEE International Conference on Image Processing. Piscataway, NJ:IEEE, 2015:2409-2413.
[9] LEI J, LI D, PAN Z, et al. Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding[J]. IEEE Transactions on Broadcasting, 2017, 63(1):48-58.
[10] ZHANG H, ZHOU Q, SHI N, et al. Fast intra mode decision and block matching for HEVC screen content compression[C]//Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway, NJ:IEEE, 2016:1377-1381.
[11] ZHANG M, GUO Y, BAI H. Fast intra partition algorithm for HEVC screen content coding[C]//Proceedings of the 2014 IEEE Visual Communications and Image Processing Conference. Piscataway, NJ:IEEE, 2014:390-393.
[12] KWON D K, BUDAGAVI M. Fast intra block copy (IntraBC) search for HEVC screen content coding[C]//Proceedings of the 2014 IEEE International Symposium on Circuits and Systems. Piscataway, NJ:IEEE, 2014:9-12.
[13] DUANMU F, MA Z, WANG Y. Fast CU partition decision using machine learning for screen content compression[C]//Proceedings of the 2015 IEEE International Conference on Image Processing. Piscataway, NJ:IEEE, 2015:4972-4976.
[14] ZHANG H, ZHOU Q, SHI N, et al. Fast intra mode decision and block matching for HEVC screen content compression[C]//Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway, NJ:IEEE, 2016:1377-1381.
[15] KAWAKAMI Y, CHEN G, IKENAGA T. Content based mode and depth skipping with sharp and directional edges for intra prediction in screen content coding[C]//Proceedings of the 2016 IEEE International Colloquium on Signal Processing and Its Applications. Piscataway, NJ:IEEE, 2016:46-49.
[16] LAUDE T, OSTERMANN J. Copy mode for static screen content coding with HEVC[C]//Proceedings of the 2015 IEEE International Conference on Image Processing. Piscataway, NJ:IEEE, 2015:1930-1934.
[17] 陈先义,赵利平,林涛.一种新的用于屏幕图像编码的HEVC帧内模式[J].电子与信息学报,2015,37(11):2685-2690.(CHEN X Y, ZHAO L P, LIN T. A new HEVC intra mode for screen content coding[J]. Journal of Electronics and Information Technology, 2015, 37(11):2685-2690.)
[18] BJONTEGAARD G. Calculation of average PSNR differences between RD-curves[EB/OL]. (2001-05-18)[2016-09-15]. http://wftp3.itu.int/av-arch/video-site/0104_Aus/.
[19] YU H, COHEN R, RAPAKA K, et al. Common test conditions for screen content coding[R]. Sapporo, Japan:The Joint Collaborative Team on Video Coding, 2014.

基于时空域相关性的屏幕内容帧间快速编码算法

Fast inter-frame coding algorithm for screen content based on temporal-spatial correlation

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 6

编辑推荐

Metrics

[1]	刘妍君, 赵志强, 刘艳, 崔盈, 汪大勇, 冉鹏, 郭毅军. 基于质量可伸缩高性能视频编码的帧内快速算法[J]. 计算机应用, 2018, 38(10): 2960-2964.
[2]	蔡春亭, 冯桂, 王驰, 韩雪. 基于帧内预测模式多划分的HEVC鲁棒视频水印算法[J]. 计算机应用, 2017, 37(6): 1772-1776.
[3]	张明辉, 冯桂. 基于纹理方向的高效视频编码鲁棒视频水印[J]. 计算机应用, 2015, 35(9): 2531-2534.
[4]	赵超, 赵海武, 王国中, 李国平, 滕国伟. 快速AVS2帧内预测选择算法[J]. 计算机应用, 2015, 35(11): 3284-3287.
[5]	夏定元周艳芬. 复杂度可伸缩的帧间模式选择[J]. 计算机应用, 2010, 30(3): 625-627.
[6]	葛晛晛，张俊峰，郝重阳，王宇，席迎来. 基于混合特征的H.264/AVC快速帧内预测模式决策[J]. 计算机应用, 2005, 25(08): 1811-1814.