计算机应用 ›› 2016, Vol. 36 ›› Issue (4): 1092-1095.DOI: 10.11772/j.issn.1001-9081.2016.04.1092

• 虚拟现实与数字媒体 • 上一篇    下一篇

多阶导数自适应视频超分辨率重建

吉晓红, 熊淑华, 何小海, 陈洪刚   

  1. 四川大学 电子信息学院, 成都 610065
  • 收稿日期:2015-09-06 修回日期:2015-10-09 出版日期:2016-04-10 发布日期:2016-04-08
  • 通讯作者: 何小海
  • 作者简介:吉晓红(1989-),女,河南濮阳人,硕士研究生,主要研究方向:图像超分辨率重建; 熊淑华(1969-),女,四川广安人,副教授,博士,主要研究方向:多媒体通信; 何小海(1964-),男,四川绵阳人,教授,博士,主要研究方向:图像处理; 陈洪刚(1991-),男,四川达州人,硕士研究生,主要研究方向:图像超分辨率重建。
  • 基金资助:
    国家自然科学基金资助项目(61471248);四川省教育厅2014年研究生教育改革创新项目(2014-教-034)。

Adaptive video super-resolution reconstruction algorithm based on multi-order derivative

JI Xiaohong, XIONG Shuhua, HE Xiaohai, CHEN Honggang   

  1. College of Electronics and Information Engineering, Sichuan University, Chengdu Sichuan 610065, China
  • Received:2015-09-06 Revised:2015-10-09 Online:2016-04-10 Published:2016-04-08
  • Supported by:
    This work is partially supported by the National Natural Science Foundation of China (61471248), the Graduate Education Reform and Innovation Project of Sichuan Provincial Education Department (2014-J-034).

摘要: 传统视频超分辨率重建算法在去除噪声的同时,很难有效保持图像边缘细节信息。针对该问题,构建了一种结合多阶导数数据项和自适应正则化项的视频超分辨率重建算法。在正则化重建模型的基础上,该算法对数据项进行改进,引入能更好描述噪声统计特性的噪声多阶导数,并利用去噪效果较好的全变分(TV)和非局部均值(NLM)正则化项对视频超分辨率重建过程进行约束。此外,为了更好地保持图像细节信息,采用区域空间自适应曲率差分算法提取结构信息,从而对正则化系数进行自适应加权。实验结果表明:在噪声方差为3时,与核回归算法和聚类算法相比,该算法重建视频主观效果边缘更加锐化,局部结构更加正确、清晰;重建视频的均方误差(MSE)平均下降幅度分别为25.75%和22.50%;峰值信噪比(PSNR)分别平均提升了1.35 dB和1.14 dB。所提算法能够在去除噪声的同时有效保持图像的细节特征。

关键词: 视频超分辨率, 正则化, 区域空间自适应, 多阶导数, 图像重建

Abstract: The traditional video super-resolution reconstruction algorithm cannot preserve the details of the image edge effectively while removing the noise. In order to solve this problem, a video super-resolution reconstruction algorithm combining adaptive regularization term with multi-order derivative data item was put forward. Based on the regularization reconstruction model, the multi-order derivative of the noise, which described the statistical characteristics of the noise well, was introduced into the improved data item; meanwhile, Total Variation (TV) and Non-Local Mean (NLM) which has better denoising effect were used as the regularization items to constrain the reconstruction process. In addition, to preserve the details better, the coefficient of regularization was weighted adaptively according to the structural information, which was extracted by the regional spatially adaptive curvature difference algorithm. In the comparison experiments with the kernel-regression algorithm and the clustering algorithm when the noise variance is 3, the video reconstructed by the proposed algorithm has sharper edge, the structure is more accurate and clear; and the average Mean Squared Error (MSE) is decreased by 25.75% and 22.50% respectively; the Peak Signal-to-Noise Ratio (PSNR) is increased by 1.35 dB and 1.14 dB respectively. The results indicate that the proposed algorithm can effectively preserve the details of the image while removing the noise.

Key words: video super-resolution, regularization, regional spatially adaptive, multi-order derivative, image reconstruction

中图分类号: