基于深度信息的图像修复算法

doi:10.11772/j.issn.1001-9081.2015.10.2955

计算机应用 ›› 2015, Vol. 35 ›› Issue (10): 2955-2958.DOI: 10.11772/j.issn.1001-9081.2015.10.2955

基于深度信息的图像修复算法

何埜, 李光耀, 肖莽, 谢力, 彭磊, 唐可

同济大学电子与信息工程学院, 上海 201804

收稿日期:2015-05-13 修回日期:2015-07-06 出版日期:2015-10-10 发布日期:2015-10-14
通讯作者: 李光耀(1965-),男,安徽安庆人,教授,博士,主要研究方向:图形图像学、虚拟现实,saiheye2009@163.com
作者简介:何埜(1992-),男,安徽安庆人,硕士研究生,主要研究方向:数字图像处理、机器学习;肖莽(1982-),男,江西吉安人,博士研究生,主要研究方向:数字图像处理、机器学习;谢力(1992-),男,浙江台州人,博士研究生,主要研究方向:数字图像处理、机器学习;彭磊(1977-),男,山东泰安人,博士研究生,主要研究方向:数字图像处理;唐可(1991-),男,重庆人,硕士研究生,主要研究方向:数字图像处理。
基金资助:
国家自然科学基金资助项目(60771065,51378365)。

Image completion algorithm based on depth information

HE Ye, LI Guangyao, XIAO Mang, XIE Li, PENG Lei, TANG Ke

College of Electronics and Information Engineering, Tongji University, Shanghai 201804, China

Received:2015-05-13 Revised:2015-07-06 Online:2015-10-10 Published:2015-10-14

摘要/Abstract

摘要： 针对图像修复结果中存在物体结构上的不连续性和不完整性的问题,提出一种基于深度信息的图像修复算法。首先,通过建立平面参数马尔可夫模型来推测图像中像素点所在场景空间中的深度信息,从而划分出图像中的共面区域,定位匹配块的目标位置;其次,根据透视投影原理推导出相应的变换矩阵,指导对匹配块的几何变换;最后,设计含义深度项的目标代价函数,通过全局优化选择最优修复效果。实验的主观效果对比和峰值信噪比(PSNR)数据都表明该方法更为优越。

关键词: 图像修复, 深度信息, 透视投影, 全局优化

Abstract: Aiming at the problem of object structure discontinuity and incompleteness occurred in image completion, an image completion algorithm based on depth information was proposed. Firstly, the plane parameter Markov random field model was established to speculate depth information of the pixels in the image where the scene situate, then the coplanar region in the image determined, and the target matching blocks were located. Secondly, according to the principle of perspective projection, the transformation matrix was derived, which guided the geometric transformation of the matching blocks. Finally, the target cost function which includes the depth term was designed. Experimental results show the proposed algorithm has superiority in both subjective details and Peak Signal-to-Noise Ratio (PNSR) statistics.

Key words: image completion, depth information, perspective projection, global optimization

中图分类号:

TP391.41

何埜, 李光耀, 肖莽, 谢力, 彭磊, 唐可. 基于深度信息的图像修复算法[J]. 计算机应用, 2015, 35(10): 2955-2958.

HE Ye, LI Guangyao, XIAO Mang, XIE Li, PENG Lei, TANG Ke. Image completion algorithm based on depth information[J]. Journal of Computer Applications, 2015, 35(10): 2955-2958.

参考文献

[1] CRIMINISI A, PEREZ P, TOYAMA K. Region filling and object removal by exemplar-based image inpainting[J]. IEEE Transactions on Image Processing, 2004, 13(9): 1200-1212.
[2] LUO K, LI D, FENG Y, et al. Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based rendering[J]. Journal of Zhejiang University SCIENCE A, 2009, 10(12): 1738-1749.
[3] MANSFIELD A, PRASAD M, ROTHER C, et al. Transforming image completion[EB/OL]. [2014-10-10]. http://www.msr-waypoint.net/en-us/um/people/pkohli/papers/mprskg_bmvc2011.pdf.
[4] DARABI S, SHECHTMAN E, BARNES C, et al. Image melding: combining inconsistent images using patch-based synthesis[EB/OL]. [2014-10-10]. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.364.5147&rep=rep1&type=pdf.
[5] HUANG J B, KANG S B, AHUJA N, et al. Image completion using planar structure guidance[J]. ACM Transactions on Graphics, 2014, 33(4): 129.
[6] SAXENA A, SUN M, NG A Y. Learning 3-D scene structure from a single still image[C]//ICCV 2007: Proceedings of the 11th IEEE International Conference on Computer Vision. Piscataway: IEEE Press, 2007:1-8.
[7] GEIGER A, ZIEGLER J, STILLER C. StereoScan: dense 3D reconstruction in real-time[C]//Proceedings of the 2011 IEEE Intelligent Vehicles Symposium. Piscataway: IEEE Press,2011: 963-968.
[8] HILL F, KELLEY S. Computer graphics using OpenGL, 3/E[M]. Upper Saddle River: Prentice Hall, 2007.
[9] LEI J, LI S, ZHU C, et al. Depth coding based on depth-texture motion and structure similarities[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2015, 25(2): 275-286.
[10] LIPSKI C, KLOSE F, MAGNOR M. Correspondence and depth-image based rendering a hybrid approach for free-viewpoint video[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(6): 942-951.
[11] COMANICIU D, MEER P. Mean shift: a robust approach toward feature space analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5): 603-619.
[12] HE K, SUN J. Statistics of patch offsets for image completion[C]//Proceedings of ECCV 2012. Berlin: Springer-Verlag, 2012: 16-29.

[1]	王肖, 魏嘉旺, 袁玉波. 基于特征部位圆形域的人脸图像修复方法[J]. 计算机应用, 2020, 40(3): 847-853.
[2]	袁琳君, 蒋旻, 罗敦浪, 江佳俊, 郭嘉. 基于生成对抗网络的人像修复[J]. 计算机应用, 2020, 40(3): 842-846.
[3]	冯浪, 张玲, 张晓龙. 基于扩张卷积的图像修复[J]. 计算机应用, 2020, 40(3): 825-831.
[4]	杨文霞, 王萌, 张亮. 基于密集连接块U-Net的语义人脸图像修复[J]. 计算机应用, 2020, 40(12): 3651-3657.
[5]	杨文霞, 张亮. 基于图像结构纹理分解及局部总变分最小化的图像修复模型[J]. 计算机应用, 2018, 38(8): 2386-2392.
[6]	解本铭, 韩明明, 张攀, 张威. 飞机牵引车语音识别的动态时间规整优化算法[J]. 计算机应用, 2018, 38(6): 1771-1776.
[7]	杨文霞, 张亮. 基于对数函数的非局部总变分图像修复模型[J]. 计算机应用, 2018, 38(6): 1784-1789.
[8]	袁泉, 张建峰, 伍立志. 基于改进LBE特征的RGB-D显著性检测[J]. 计算机应用, 2018, 38(5): 1432-1435.
[9]	孟红月, 翟东海, 李梦雪, 曹大命. 参照四邻域裁剪样本的图像修复算法[J]. 计算机应用, 2018, 38(4): 1111-1116.
[10]	王晓静, 彭虎, 邓长寿, 黄海燕, 张艳, 谭旭杰. 基于均匀局部搜索和可变步长的萤火虫算法[J]. 计算机应用, 2018, 38(3): 715-721.
[11]	曹大命, 翟东海, 孟红月, 李梦雪, 冯炎. 基于先验约束和统计的图像修复算法[J]. 计算机应用, 2018, 38(2): 533-538.
[12]	李巍, 吕乃光, 董明利, 娄小平. 凸松弛全局优化机器人手眼标定[J]. 计算机应用, 2017, 37(5): 1451-1455.
[13]	林金勇, 邓德祥, 颜佳, 林晓英. 基于自适应相似组稀疏表示的图像修复算法[J]. 计算机应用, 2017, 37(4): 1169-1173.
[14]	邹玮刚, 周志辉, 王洋. 基于非降采样轮廓波变换的图像修复算法[J]. 计算机应用, 2017, 37(2): 553-558.
[15]	李梦雪, 翟东海, 孟红月, 曹大命. 划分特征子区域的图像修复算法[J]. 计算机应用, 2017, 37(12): 3541-3546.

基于深度信息的图像修复算法

Image completion algorithm based on depth information

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics