基于拼接缝自适应消除和全景图矫直的快速图像拼接算法

doi:10.11772/j.issn.1001-9081.2019030544

计算机应用 ›› 2019, Vol. 39 ›› Issue (10): 3053-3059.DOI: 10.11772/j.issn.1001-9081.2019030544

• 虚拟现实与多媒体计算 • 上一篇下一篇

基于拼接缝自适应消除和全景图矫直的快速图像拼接算法

杨春德, 成燕菲

重庆邮电大学计算机科学与技术学院, 重庆 400065

收稿日期:2019-04-03 修回日期:2019-06-07 发布日期:2019-06-12 出版日期:2019-10-10
通讯作者: 成燕菲
作者简介:杨春德(1964-),男,重庆人,教授,硕士,主要研究方向:数字图像处理、信息与计算理论;成燕菲(1995-),女,重庆人,硕士研究生,主要研究方向:数字图像处理。
基金资助:
重庆市基础与前沿计划项目（cstc2014jcyjA40033，cstc2015jcyjA40034，cstc2014jcyjA10051）。

Fast image mosaic algorithm based on adaptive elimination of stitching seam and panorama alignment

YANG Chunde, CHENG Yanfei

College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China

Received:2019-04-03 Revised:2019-06-07 Online:2019-06-12 Published:2019-10-10
Supported by:
This work is partially supported by the Basic and Frontier Program of Chongqing (cstc2014jcyjA40033, cstc2015jcyjA40034, cstc2014jcyjA 10051).

摘要/Abstract

摘要： 针对图像拼接存在色差过渡不均匀、图像倾斜扭曲及拼接效率低的现象，提出一种基于拼接缝自适应消除和全景图矫直的快速图像拼接算法。首先，用尺度不变特征变换（SIFT）提取图像指定区域特征点并用双向K近邻（KNN）算法进行图像配准，有效提高算法效率；其次，利用动态规划思想提出自适应公式找到最优拼接缝并用图像融合算法对其自适应消除，解决拼接缝色差过渡不均匀问题；最后，针对累积拼接误差形成全景图倾斜的现象，利用边缘检测算法提出自适应拟合四边形矫直模型，把原始全景图矫直为一个全新的全景图。所提算法与分块图像拼接和二叉树图像拼接算法相比，图像质量提升了5.84%~7.83%，拼接时间仅为原来的50%~70%。实验结果表明，该算法不仅通过自适应更新机制减少不同图像背景下拼接缝色差过渡不均匀的现象，从而提高了图像质量；而且提高了拼接效率，降低了全景图倾斜扭曲程度。

关键词: 尺度不变特征变换, 最优拼接缝, 图像融合, 自适应消除, 图像矫直

Abstract: Aiming at the phenomenon that image mosaic, to a certain extent, has uneven chromatic aberration, distortion and low efficiency, an adaptive elimination of image stitching seam and panorama alignment based fast image mosaic algorithm was proposed. Firstly, the Scale-Invariant Feature Transform (SIFT) was used to extract feature points of the specified area of the image and image registration was performed by using bidirectional K-Nearest Neighbor (KNN) algorithm, effectively improving the algorithm efficiency. Secondly, focusing on the uneven chromatic aberration transition of stitching seam, an adaptive formula for finding the optimal stitching seam was proposed based on dynamic programming, and then the seam was adaptively eliminated by image fusion. Finally, for the phenomenon of panoramic tilt caused by accumlated stitching error, an adaptive fitting quadrilateral alignment model based on edge detection algorithm was proposed to make the original panorama into a completely new panorama. Compared with the image mosaic algorithm based on block and the image mosaic algorithm based on binary tree, the proposed algorithm has the image quality improved by 5.84%-7.83% and the stitching time shortened to only 50%-70% of the original. Experimental results show that the proposed algorithm not only reduces the unevenness of chromatic aberration transition of stitching seam in different image backgrounds through adaptive update mechanism, so as to improve the image quality, but also increases the stitching efficiency and reduces the distortion degree of panorama.

Key words: Scale-Invariant Feature Transform (SIFT), optimal stitching seam, image fusion, adaptive elimination, image alignment

中图分类号:

TP391.41

杨春德, 成燕菲. 基于拼接缝自适应消除和全景图矫直的快速图像拼接算法[J]. 计算机应用, 2019, 39(10): 3053-3059.

YANG Chunde, CHENG Yanfei. Fast image mosaic algorithm based on adaptive elimination of stitching seam and panorama alignment[J]. Journal of Computer Applications, 2019, 39(10): 3053-3059.

参考文献

[1] ALCANTARILLA P F, NUEVO J, BARTOLI A. Fast explicit diffusion for accelerated features in nonlinear scale spaces[C]//Proceedings of the 24th British Machine Vision Conference. Durham:BMVA Press, 2013:1-11.
[2] 郑悦, 程红, 孙文邦. 邻域最短距离法寻找最佳拼接缝[J]. 中国图象图形学报, 2014, 19(2):227-233. (ZHENG Y, CHENG H, SUN W B. Finding an optimal seam-line through the shorted distance in the neighborhood[J]. Journal of Image and Graphics, 2014, 19(2):227-233.)
[3] WEI Q, DOBIGEON N, TOURNERET J. Fast fusion of multi-band images based on solving a Sylvester equation[J]. IEEE Transactions on Image Processing, 2015, 24(11):4109-4119.
[4] TONG Y, CHEN J. Compressive sensing image fusion in heterogeneous sensor networks based on shearlet and wavelet transform[J]. EURASIP Journal on Wireless Communications and Networking, 2017, 2017:52.
[5] LARAQUI A, SAAIDI A, SATORI K. MSIP:multi-scale image pre-processing method applied in image mosaic[J]. Multimedia Tools and Applications, 2018, 77(6):7517-7537.
[6] 邹佳彬, 孙伟. 基于提升静态小波变换与联合结构组稀疏表示的多聚焦图像融合[J]. 计算机应用, 2018, 38(3):859-865. (ZOU J B, SUN W. Multi-focus image fusion based on lifting stationary wavelet transform and joint structural group sparse representation[J]. Journal of Computer Applications, 2018, 38(3):859-865.)
[7] BROWN M, LOWE D G. Automatic panoramic image stitching using invariant features[J]. International Journal of Computer Vision 2007, 74(1):59-73.
[8] MIKOLAJCZYK K, SCHMID C. An affine invariant interest point detector[C]//Proceedings of the 2002 European Conference on Computer Vision, LNCS 2350. Berlin:Springer, 2002:128-142.
[9] FISCHLER M A, BOLLES R C. Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM 1981, 24(6):381-395.
[10] WAINE M, ROSSA C, SLOBODA R, et al. 3D shape visualization of curved needles in tissue from 2D ultrasound images using RANSAC[C]//Proceedings of the 2015 IEEE International Conference on Robotics and Automation. Piscataway:IEEE, 2015:4723-4728.
[11] TANG Y, SHIN J, LIAO H C. De-ghosting method for image stitching[J]. International Journal of Digital Content Technology & Its Applications, 2012, 6:17-24.
[12] ZHANG B, LIU Q, IKENAGA T. Ghost-free high dynamic range imaging via moving objects detection and extension[C]//Proceedings of the 2015 Asia-Pacific Signal and Information Processing Association Summit and Conference. Piscataway:IEEE, 2015:459-462.
[13] HUANG C, LIN S, CHEN J. Efficient image stitching of continuous image sequence with image and seam selections[J]. IEEE Sensors Journal, 2015, 15(10):5910-5918.
[14] 方贤勇, 潘志庚, 徐丹. 图像拼接的改进算法[J]. 计算机辅助设计与图形学学报, 2003, 15(11):1362-1365. (FANG X Y, PAN Z G, XU D. An improved algorithm for image mosaics[J]. Journal of Computer-Aided Design & Computer Graphics, 2003, 15(1):1362-1365.)
[15] AHONEN T, HADID A, PIETIKÄINEN M. Face recognition with local binary patterns[C]//Proceedings of the 2004 European Conference on Computer Vision, LNCS 3021. Berlin:Springer, 2004:469-481.
[16] CHOI H C, AHN B H. Image alignment by parameter hypersurface learning[J]. Electronics Letters, 2016, 52(18):1526-1527.
[17] CANNY J. A computational approach to edge detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986, 8(6):679-698.
[18] QU Z, WANG T, AN S Q, et al. Image seamless stitching and straightening based on image block[J]. IET Image Processing, 2018, 12(8):1361-1369.
[19] QU Z, WEI X, CHEN S. An algorithm of image mosaic based on binary tree and eliminating distortion error[J]. PLoS One, 2019, 14(1):e0210354.
[20] 张小利, 李雄飞, 李军. 融合图像质量评价指标的相关性分析及性能评估[J]. 自动化学报, 2014, 40(2):306-315. (ZHANG X L, LI X F, LI J. Validation and correlation analysis of metrics for evaluating performance of image fusion[J]. Acta Automatica Sinica, 2014, 40(2):306-315.)
[21] 黄学优, 张长江. 双树复小波域的MRI图像去噪[J]. 中国图象图形学报, 2016, 21(1):104-113. (HUANG X Y, ZHANG C J. MRI denoising based on dual-tree complex wavelet transform[J]. Journal of Image and Graphics, 2016, 21(1):104-113.)

基于拼接缝自适应消除和全景图矫直的快速图像拼接算法

Fast image mosaic algorithm based on adaptive elimination of stitching seam and panorama alignment

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	张林发, 张榆锋, 王琨, 李支尧. 基于直觉模糊集和亮度增强的医学图像融合[J]. 计算机应用, 2021, 41(7): 2082-2091.
[2]	牛康力, 谌雨章, 沈君凤, 曾张帆, 潘永才, 王绎冲. 基于深度学习的双通道夜视图像复原方法[J]. 计算机应用, 2021, 41(6): 1775-1784.
[3]	吴蕾, 杨晓敏. 改进的基于通道注意力反馈网络的遥感图像融合算法[J]. 计算机应用, 2021, 41(4): 1172-1178.
[4]	胡立华, 左威健, 聂瑶瑶. 基于加权相似性度量的特征匹配方法[J]. 计算机应用, 2021, 41(2): 511-516.
[5]	黄思远, 张敏情, 柯彦, 毕新亮. 基于显著性检测的图像隐写分析方法[J]. 计算机应用, 2021, 41(2): 441-448.
[6]	成亚玲, 柏智, 谭爱平. 基于引导滤波和差分图像的多聚焦图像融合方法[J]. 计算机应用, 2021, 41(1): 220-224.
[7]	李卫中. 基于场景局部特征的多曝光图像融合[J]. 计算机应用, 2020, 40(8): 2365-2371.
[8]	王继霄, 李阳, 王家宝, 苗壮, 张洋硕. 基于SqueezeNet的轻量级图像融合方法[J]. 计算机应用, 2020, 40(3): 837-841.
[9]	刘颖, 王凤伟, 刘卫华, 艾达, 李芸, 杨凡超. 基于亮度分区模糊融合的高动态范围成像算法[J]. 计算机应用, 2020, 40(1): 233-238.
[10]	王书朋, 赵瑶. 基于自适应分割的多曝光图像融合算法[J]. 计算机应用, 2020, 40(1): 252-257.
[11]	牟琦, 唐洋, 李占利, 李洪安. 基于网格运动统计算法和最佳缝合线的密集重复结构图像快速拼接方法[J]. 计算机应用, 2020, 40(1): 239-244.
[12]	张斌, 罗晓清, 张战成. 基于TV-L¹结构纹理分解的图像融合质量评价算法[J]. 计算机应用, 2019, 39(9): 2701-2706.
[13]	薄单, 李宗春, 王晓南, 乔涵文. 适用于倾斜影像的加速KAZE-SIFT特征提取算法[J]. 计算机应用, 2019, 39(7): 2093-2097.
[14]	王克强, 张雨帅, 王保群. 基于Retinex理论的多曝光图像融合算法[J]. 计算机应用, 2019, 39(7): 2087-2092.
[15]	吴宗骏, 吴炜, 杨晓敏, 刘凯, Gwanggil Jeon, 袁皓. 改进的基于稀疏表示的全色锐化算法[J]. 计算机应用, 2019, 39(2): 540-545.