非线性约束下的准单应变换图像拼接算法

doi:10.11772/j.issn.1001-9081.2020101637

计算机应用 ›› 2021, Vol. 41 ›› Issue (8): 2318-2323.DOI: 10.11772/j.issn.1001-9081.2020101637

所属专题：多媒体计算与计算机仿真

• 多媒体计算与计算机仿真 • 上一篇下一篇

非线性约束下的准单应变换图像拼接算法

王怀, 王展青

武汉理工大学理学院, 武汉 430070

收稿日期:2020-10-21 修回日期:2020-12-11 出版日期:2021-08-10 发布日期:2021-01-27
通讯作者: 王怀
作者简介:王怀(1995-),男,湖北荆州人,硕士研究生,主要研究方向:图像拼接;王展青(1965-),男,湖北咸宁人,教授,博士,主要研究方向:数字图像处理、模式识别、信息计算。

Nonlinear constraint based quasi-homography warps for image stitching

WANG Huai, WANG Zhanqing

School of Science, Wuhan University of Technology, Wuhan Hubei 430070, China

Received:2020-10-21 Revised:2020-12-11 Online:2021-08-10 Published:2021-01-27

摘要/Abstract

摘要： 针对准单应变换图像拼接算法造成图像非重叠区域存在纵向投影失真的问题，提出了一种基于非线性约束的图像拼接算法。首先，该算法利用非线性约束来平滑过渡分界线左右的图像区域；然后，利用抛物线方程替换准单应变换的直线方程；最后，利用网格化的方法提高图像纹理映射的速度，并利用基于最佳缝合线的方法融合图像。对于尺寸为1 200像素×1 600像素的图像，所提算法的纹理映射耗时波动范围为4~7 s，并且其斜线结构的平均偏离程度在11~31。与准单应变换图像拼接算法相比较，所提算法的纹理映射的耗时降低了55%~67%，斜线结构的平均偏离程度降低了36%~62%，可见所提算法既矫正了斜线几何结构也提高了图像拼接效率。实验结果表明，所提算法在改善拼接图像视觉效果的方面具有更好的结果。

关键词: 图像拼接, 非重叠区域, 非线性约束, 图像变形, 畸变矫正, 准单应变换

Abstract: In order to solve the problem of longitudinal projection distortion in non-overlapping regions of images caused by the quasi-homography warp algorithm for image stitching, an image stitching algorithm based on nonlinear constraint was proposed. Firstly, the nonlinear constraint was used to smoothly transit the image regions around the dividing line. Then, the linear equation of quasi-homography warp was replaced by a parabolic equation. Finally, the mesh-based method was used to improve the speed of image texture mapping and the method based on optimal stitching line was used to fuse the images. For images of 1 200 pixel×1 600 pixel, the time consumption range of texture mapping by the proposed algorithm is 4 s to 7 s, and the proposed algorithm has the average deviation degree of diagonal structure is 11 to 31. Compared with the quasi-homography warp algorithm for image stitching, the proposed algorithm has the time consumption of texture mapping reduced by 55% to 67%, and the average deviation degree of diagonal structure reduced by 36% to 62%. It can be seen that the proposed algorithm not only corrects the oblique diagonal structure, but also improves the efficiency of image stitching. Experimental results show that the proposed algorithm has better results in improving the visual effect of stitched images.

Key words: image stitching, non-overlapping region, nonlinear constraint, image warping, distortion correction, quasi-homography warp

中图分类号:

TP391.41

王怀, 王展青. 非线性约束下的准单应变换图像拼接算法[J]. 计算机应用, 2021, 41(8): 2318-2323.

WANG Huai, WANG Zhanqing. Nonlinear constraint based quasi-homography warps for image stitching[J]. Journal of Computer Applications, 2021, 41(8): 2318-2323.

参考文献

[1] 何川, 周军. 具有直线结构保护的网格化图像拼接[J]. 中国图象图形学报,2018,23(7):973-983.(HE C,ZHOU J. Meshbased image stitching algorithm with linear structure protection[J]. Journal of Image and Graphics,2018,23(7):973-983.)
[2] SZELISKI R,SHUM H Y. Creating full view panoramic image mosaics and environment maps[C]//Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. New York:ACM,1997:251-258.
[3] BROWN M,LOWE D G. Automatic panoramic image stitching using invariant features[J]. International Journal of Computer Vision,2007,74(1):59-73.
[4] GAO J H,KIM S J,BROWN M S. Constructing image panoramas using dual-homography warping[C]//Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2011:49-56.
[5] LIN W Y,LIU S Y,MATSUSHITA Y,et al. Smoothly varying affine stitching[C]//Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2011:345-352.
[6] ZARAGOZA J,CHIN T J,BROWN M S,et al. As-projective-aspossible image stitching with moving DLT[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2013:2339-2346.
[7] GAO J H,LI Y,CHIN T J,et al. Seam-driven image stitching[C]//Proceedings of the 34th Annual Conference of the European Association for Computer Graphics. Geneva:Eurographics Association,2013:45-48.
[8] ZHANG F, LIU F. Parallax-tolerant image stitching[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2014:3262-3269.
[9] LIN K M,JIANG N J,CHEONG L F,et al. SEAGULL:seamguided local alignment for parallax-tolerant image stitching[C]//Proceedings of the 14th European Conference on Computer Vision, LNCS 9907. Cham:Springer,2016:370-385.
[10] CHANG C H,SATO Y,CHUANG Y Y. Shape-preserving halfprojective warps for image stitching[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2014:3254-3261.
[11] LIN C C, PANKANTI S U, RAMAMURTHY K N, et al. Adaptive as-natural-as-possible image stitching[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE,2015:1155-1163.
[12] LI N,XU Y F,WANG C. Quasi-homography warps in image stitching[J]. IEEE Transactions on Multimedia,2018,20(6):1365-1375.
[13] HARTLEY R,ZISSERMAN A. Camera models[M]//Multiple View Geometry in Computer Vision. 2nd ed. Cambridge:Cambridge University Press,2004:153-177.
[14] 王森, 杨克俭. 基于双线性插值的图像缩放算法的研究与实现[J]. 自动化技术与应用,2008,27(7):44-45,35.(WANG S, YANG K J. An image scaling algorithm based on bilinear interpolation with VC++[J]. Techniques of Automation and Applications,2008,27(7):44-45,35.)
[15] HARTLEY R I. In defence of the 8-point algorithm[C]//Proceedings of the 5th International Conference on Computer Vision. Piscataway:IEEE,1995:1064-1070.
[16] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision,2004,60(2):91-110.

非线性约束下的准单应变换图像拼接算法

Nonlinear constraint based quasi-homography warps for image stitching

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	牟琦, 唐洋, 李占利, 李洪安. 基于网格运动统计算法和最佳缝合线的密集重复结构图像快速拼接方法[J]. 计算机应用, 2020, 40(1): 239-244.
[2]	修春波, 马云菲, 潘肖楠. 基于距离融合的图像特征点匹配方法[J]. 计算机应用, 2019, 39(11): 3158-3162.
[3]	李加亮, 蒋品群. 结合变形函数和幂函数权重的图像拼接[J]. 计算机应用, 2019, 39(10): 3060-3064.
[4]	韩李涛, 刘海龙, 孔巧丽, 阳凡林. 基于多核计算环境的地貌晕渲并行算法[J]. 计算机应用, 2017, 37(7): 1911-1915.
[5]	郑继明, 苏慧嘉. 基于颜色分量间相关性的图像拼接篡改检测方法[J]. 计算机应用, 2017, 37(10): 2903-2906.
[6]	李鹏俊, 李建增, 宋瑶, 张岩, 杜玉龙. 基于仿真的无人机遥感图像拼接误差分析[J]. 计算机应用, 2015, 35(4): 1116-1119.
[7]	张旭, 高佼, 王万国, 刘俍, 张晶晶. 基于显著图的输电线路杆塔图像拼接方法[J]. 计算机应用, 2015, 35(4): 1133-1136.
[8]	杜丙新. 基于相对定向和小区域融合的视频图像拼接[J]. 计算机应用, 2015, 35(1): 220-223.
[9]	袁全桥苏波赵旭东李生红. 基于高频小波子带马尔可夫特征的图像拼接检测[J]. 计算机应用, 2014, 34(5): 1477-1481.
[10]	王铁建刘艳丽. 基于加速鲁棒特征的广角图像自动拼接校正算法[J]. 计算机应用, 2012, 32(09): 2576-2579.
[11]	吴庆双付仲良. 一种鲁棒的序列图像自动拼接方法[J]. 计算机应用, 2012, 32(02): 499-503.
[12]	狄颖辰陈云坪陈莹莹陈彦. 无人机图像拼接算法综述[J]. 计算机应用, 2011, 31(01): 170-174.
[13]	王成良杨鹏蔡耀泽王振国. 孔壁全景图获取中的图像拼接技术研究[J]. 计算机应用, 2010, 30(2): 344-347.
[14]	李阳林意. 改进的实时图像拼接方法[J]. 计算机应用, 2010, 30(12): 3233-3235.
[15]	林景亮陈岳林. 多摄像机图像拼接自动色彩均衡算法[J]. 计算机应用, 2010, 30(12): 3236-3237.