Image inpainting algorithm based on non-subsampled contourlet transform

doi:10.11772/j.issn.1001-9081.2017.02.0553

Journal of Computer Applications ›› 2017, Vol. 37 ›› Issue (2): 553-558.DOI: 10.11772/j.issn.1001-9081.2017.02.0553

Previous Articles Next Articles

Image inpainting algorithm based on non-subsampled contourlet transform

ZOU Weigang¹, ZHOU Zhihui², WANG Yang¹

1. School of Science, Jiangxi University of Science and Technology, Ganzhou Jiangxi 341000, China;
2. Asset Management Division, Jiangxi University of Science and Technology, Ganzhou Jiangxi 341000, China

Received:2016-06-27 Revised:2016-08-07 Online:2017-02-11 Published:2017-02-10
Supported by:
This work is supported by the National Natural Science Foundation of China (61462036), the Natural Sciences Foundation of Jiangxi Province (2009GQS0047, 20151BAB201015), and the Foundation of Jiangxi University of Science and Technology (NSFJ2014-G25), Graduate Excellent Course "Matrix Theory" of Jiangxi University of Science and Technology(XYZK2013011).

基于非降采样轮廓波变换的图像修复算法

邹玮刚¹, 周志辉², 王洋¹

1. 江西理工大学理学院, 江西赣州 341000;
2. 江西理工大学资产管理处, 江西赣州 341000

通讯作者: 邹玮刚,42587617@qq.com
作者简介:邹玮刚(1976-),男,江西进贤人,讲师,硕士,主要研究方向:数字图像处理、粗糙集;周志辉(1985-),男,江西南昌人,助教,硕士,主要研究方向:数字图像处理、数据挖掘;王洋(1995-),男,江西吉水人,主要研究方向:数字图像处理。
基金资助:
国家自然科学基金资助项目（61462036）；江西省自然科学基金资助项目（2009GQS0047，20151BAB201015）；江西理工大学校级科研项目（NSFJ2014-G25）；江西理工大学研究生优质课程“矩阵论”（XYZK2013011）。

Abstract

Abstract: The multi-scale analysis technology has been widely used in the field of digital image processing, the inpainting image with large damaged area has become a hot and difficult spot of image inpainting. Based on the principle of multi-resolution analysis and the traditional method of image inpainting, a new algorithm for image inpainting based on non-subsampled contourlet transform was proposed. Firstly, the image was decomposed into low frequency and high frequency parts by using the non-subsampled contourlet transform, then the parts of different frequency after image decomposition were inpainted respectively. The low frequency components of the image were inpainted by the improved method of texture synthesis. Because after non-subsampled contourlet transform, the information of the corresponding position between the low frequency component and the high frequency component is consistent, the information of corresponding position of other high frequency components could be repaired while the low frequency component was repaired. Finally, the inpainting of the texture image was completed by reconstruction process of non-subsampled contourlet transform. Generally, the selection of image inpainting parameters was appropriate for the best image effect, thus a counter-example was given for authentication. The structural similarity measure among the proposed algorithm and the classical Criminisi algorithm and the wavelet inpainting algorithm has little difference, but the Peak Signal-To-Noise Ratio (PSNR) measurement has different result according to the different texture characteristics of images and the different location characteristics of damaged areas. The simulation results show that the proposed method is very good for the promotion of the non-subsampled Contourlet transform in image inpainting application, and it can get better repair effect while inpainting the image with large damaged area.

Key words: image inpainting, multi-resolution analysis, non-subsampled contourlet transform, dependencies between coefficients, texture characteristic

摘要： 多尺度分析技术已经广泛应用于数字图像处理领域，较大破损区域的图像修复成为图像修复的一个热点和难点。针对该问题，结合多分辨率分析原理与传统的样本块图像修复技术，提出了一种基于非降采样轮廓波变换的图像修复算法。该算法利用非降采样轮廓波变换把图像分解成低频部分和高频部分，并对图像分解后不同频率的部分分别予以修复。其中，图像的低频成分采用改进的纹理合成的方法进行修复。因为图像经过非降采样轮廓波变换后，低频分量与高频分量之间对应位置的信息之间具有一致性的特点，所以在修复低频成分的同时实现其他高频分量对应位置信息的修复。最后通过非降采样轮廓波重构过程完成纹理图像的修复。一般图像修复方法的参数选取以图像的修复效果最佳为宜，给出一个反例进行分析论证。实验发现，所提算法所修复图像的结构相似性测度与经典Criminisi算法和小波修复算法相差不大，但是峰值信噪比（PSNR）测度依据不同图像的纹理结构的特点与破损区域的不同位置特点而不同。仿真实验表明，所提方法很好地推广了非降采样轮廓波变换在图像修复中的应用，并且在修复大区域破损图像时能够获得较好的修复效果。

关键词: 图像修复, 多分辨率分析, 非降采样轮廓波变换, 系数相关性, 纹理特征

CLC Number:

TP391.413

ZOU Weigang, ZHOU Zhihui, WANG Yang. Image inpainting algorithm based on non-subsampled contourlet transform[J]. Journal of Computer Applications, 2017, 37(2): 553-558.

邹玮刚, 周志辉, 王洋. 基于非降采样轮廓波变换的图像修复算法[J]. 计算机应用, 2017, 37(2): 553-558.

References

[1] 李旭超,刘海宽,宋博.能量泛函正则化模型在图像恢复中的应用分析[J].中国图象图形学报,2014,19(9):1247-1259. (LI X C, LIU H K, SONG B. Application analysis of regularization model of energy functional to image restoration[J]. Journal of Image and Graphics, 2014, 19(9):1247-1259.).
[2] CHAN T F, SHEN J J. Non-texture inpainting by Curvature Driven Diffusions (CDD)[J]. Journal of Visual Communication and Image Representation, 2001, 12(4):436-449.
[3] CHAN T F, SHEN J J. Mathematical models for local non-texture inpaintings[J]. SIAM Journal on Applied Mathematics, 2002, 62(3):1019-1043.
[4] 张绚,尹立新,李振杰.一种改进的基于样例的图像修复算法[J].计算机应用与软件,2014,31(10):216-219. (ZHANG X, YIN L X, LI Z J. An improved exemplar-based image inpainting method[J]. Computer Applications and Software, 2014, 31(10):216-219.).
[5] CRIMINISI A, PÉREZ P, TOYAMA K. Object removal by examplar-based inpainting[C]//Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2003:721-728.
[6] XU Z, SUN J. Image inpainting by patch propagation using patch sparsity[J]. IEEE Transactions on Image Processing, 2010, 19(5):1153-1165.
[7] BERTALMIO M, VESE L, SAPIRO G, et al. Simultaneous structure and texture image inpainting[J]. IEEE Transactions on Image Processing, 2003, 12(6):882-889.
[8] 郝岩,许建楼.迭代重加权的小波变分修复模型[J].电子与信息学报,2013,35(12):2916-2920. (HAO Y,XU J L. Iteratively reweighted based wavelet variational inpainting model[J]. Journal of Electronics & Information Technology, 2013, 35(12):2916-2920.).
[9] 胡文瑾,刘仲民,李战明.一种改进的小波域图像修复算法[J].计算机科学,2014,41(5):299-303. (HU W J, LIU Z M, LI Z M. Improved algorithm for image in painting in wavelet domain[J]. Computer Science, 2014, 41(5):299-303.).
[10] 程村.基于边缘自适应小波变换的图像修复算法[J].工程地球物理学报,2013,10(4):576-582. (CHENG C. Image inpainting based on edge adaptive wavalet transform[J]. Chinese Journal of Engineering Geophysics, 2013, 10(4):576-582.).
[11] 刘纯利,张弓.基于小波框架的盲图像修复研究[J].计算机科学,2013,40(4):295-297.(LIU C L, ZHANH G. Wavelet frame based blind image inpainting[J]. Computer Science, 2013, 40(4):295-297.).
[12] 吕永利,姜斌,包建荣.基于像素权值的高效小波图像修复算法[J].信息与控制,2015,44(1):104-109. (LYU Y L, JIANG B, BAO J R. Efficient wavelet image inpainting algorithm based on pixel weight values[J]. Information and Control, 2015, 44(1):104-109.).
[13] 李晋江,张彩明,范辉,等.基于分形的图像修复算法[J].电子学报,2010,38(10):2430-2435. (LI J J, ZHANG C M, FAN H, et al. Image inpainting algorithm based on fractal theory[J]. Acta Electronica Sinica, 2010, 38(10):2430-2435.).
[14] 姚燕,汤进,罗斌.基于迭代分形解码和边缘扩展的图像修复算法[J].计算机工程,2012,38(2):218-220.(YAO Y, TANG J, LUO B. Image inpainting algorithm based on iterative fractal decoding and edge expansion[J]. Computer Engineering, 2012, 38(2):218-220.).
[15] 杨秀红,郭宝龙.基于分形的数字图像修补算法[J].光电子·激光,2010,21(9):1402-1407.(YANG X H, GUO B L. A new image inpainting algorithmbased on fractal theory[J]. Journal of Optoelectronics·Laser, 2010, 21(9):1402-1407.).
[16] 焦李成,谭山.图像的多尺度几何分析:回顾与展望[J].电子学报,2003,31(12):1975-1981. (JIAO L C, TAN S. Development and prospect of image multiscale geometric analysis[J]. Acta Electronica Sinica, 2003, 31(12A):1975-1981.).
[17] DO M N, VETTERLI M. Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance[J]. IEEE Transactions on Image Processing, 2002, 11(2):146-158.
[18] 李宣妮,王慧琴,吴萌.轮廓波系数引导的数字图像修复算法研究[J].计算机工程与应用,2015,51(19):206-209.(LI X N, WANG H Q, WU M. Research of image inpainting algorithm led by contourlet coefficients[J]. Computer Engineering and Applications, 2015, 51(19):206-209.).
[19] 尚丽,苏品刚,周昌雄.轮廓波和非负稀疏编码收缩的毫米波图像恢复[J].激光与红外,2011,41(9):1049-1053. (SHANG L, SU P G, ZHOU C X. Denoising millimeter wave image using contourlet and sparse coding shrinkage[J]. Laser & Infrared, 2011, 41(9):1049-1053.).
[20] DA CUNHA A L, ZHOU J, DO M N. The nonsubsampled contourlet transform:theory design and applications[J]. IEEE Transactions on Image Processing, 2006, 15(10):3089-3101.
[21] 陈木生.结合NSCT和压缩感知的红外与可见光图像融合[J].中国图象图形学报,2016,21(1):39-44.(CHEN M S. Image fusion of visual and infrared based on NSCT and compressed sensing[J]. Journal of Image and Graphics, 2016, 21(1):39-44.).
[22] 王静静,贾振红,覃锡忠,等.基于NSCT与模糊对比度的图像增强算法[J].计算机工程与设计,2015,36(10):2754-2758. (WANG J J, JIA Z H, QIN X Z, et.al. Image enhancement algorithm based on NSCT and fuzzy contrast[J]. Computer Engineering and Design, 2015, 36(10):2754-2758.).
[23] 吴亚东,张红英,吴斌.数字图像修复技术[M].北京:科学出版社,2010:18,92-94. (WU Y D, ZHANG H Y,WU B. The Techniques of Digital Image Inpainting[M]. Beijing:Science Press, 2010:18, 92-94.).
[24] 何凯,梁然,张涛.基于小波系数相关性的纹理图像快速修复算法[J].天津大学学报:自然科学与工程技术版,2010,43(12):1093-1097.(HE K, LIANG R, ZHANG T. Fast texture image completion algorithm based on dependencies between wavelet coefficients[J]. Journal of Tianjin University, 2010,43(12):1093-1097.)

Image inpainting algorithm based on non-subsampled contourlet transform

基于非降采样轮廓波变换的图像修复算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	Kaili DENG, Weibo WEI, Zhenkuan PAN. Industrial defect detection method with improved masked autoencoder [J]. Journal of Computer Applications, 2024, 44(8): 2595-2603.
[2]	Qiaoling HUANG, Bochuan ZHENG, Zicheng DING, Zedong WU. Improved image inpainting network incorporating supervised attention module and cross-stage feature fusion [J]. Journal of Computer Applications, 2024, 44(2): 572-579.
[3]	Kunting LU, Rongrong FEI, Xuande ZHANG. Remote sensing image pansharpening by convolutional neural network [J]. Journal of Computer Applications, 2023, 43(9): 2963-2969.
[4]	Wanli SHEN, Yujin ZHANG, Wan HU. U-shaped feature pyramid network for image inpainting forensics [J]. Journal of Computer Applications, 2023, 43(2): 545-551.
[5]	Gang CHEN, Yongwei LIAO, Zhenguo YANG, Wenying LIU. Image inpainting algorithm of multi-scale generative adversarial network based on multi-feature fusion [J]. Journal of Computer Applications, 2023, 43(2): 536-544.
[6]	WANG Xiao, WEI Jiawang, YUAN Yubo. Face image inpainting method based on circular fields of feature parts [J]. Journal of Computer Applications, 2020, 40(3): 847-853.
[7]	FENG Lang, ZHANG Ling, ZHANG Xiaolong. Image inpainting based on dilated convolution [J]. Journal of Computer Applications, 2020, 40(3): 825-831.
[8]	YUAN Linjun, JIANG Min, LUO Dunlang, JIANG Jiajun, GUO Jia. Portrait inpainting based on generative adversarial networks [J]. Journal of Computer Applications, 2020, 40(3): 842-846.
[9]	YANG Wenxia, WANG Meng, ZHANG Liang. Semantic face image inpainting based on U-Net with dense blocks [J]. Journal of Computer Applications, 2020, 40(12): 3651-3657.
[10]	LI Xinchun, CAO Zhiqiang, LIN Sen, ZHANG Chunhua. Palmprint and palmvein image fusion recognition algorithm based on super-wavelet domain [J]. Journal of Computer Applications, 2018, 38(8): 2205-2210.
[11]	YANG Wenxia, ZHANG Liang. Image inpainting model based on structure-texture decomposition and local total variation minimization [J]. Journal of Computer Applications, 2018, 38(8): 2386-2392.
[12]	YANG Wenxia, ZHANG Liang. Logarithmic function based non-local total variation image inpainting model [J]. Journal of Computer Applications, 2018, 38(6): 1784-1789.
[13]	MENG Hongyue, ZHAI Donghai, LI Mengxue, CAO Daming. Image inpainting algorithm based on pruning samples referring to four-neighborhood [J]. Journal of Computer Applications, 2018, 38(4): 1111-1116.
[14]	CAO Daming, ZHAI Donghai, MENG Hongyue, LI Mengxue, FENG Yan. Image inpainting algorithm based on priori constraints and statistics [J]. Journal of Computer Applications, 2018, 38(2): 533-538.
[15]	LIN Jinyong, DENG Dexiang, YAN Jia, LIN Xiaoying. Self-adaptive group based sparse representation for image inpainting [J]. Journal of Computer Applications, 2017, 37(4): 1169-1173.