Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (1): 239-244.DOI: 10.11772/j.issn.1001-9081.2019061045

• Virtual reality and multimedia computing • Previous Articles     Next Articles

Fast stitching method for dense repetitive structure images based on grid-based motion statistics algorithm and optimal seam

MU Qi1,2, TANG Yang1, LI Zhanli1, LI Hong'an1   

  1. 1. College of Computer Science and Technology, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China;
    2. College of Mechanical Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China
  • Received:2019-06-20 Revised:2019-08-07 Online:2020-01-10 Published:2019-10-15
  • Contact: 牟琦
  • Supported by:
    This work is partially supported by the China Postdoctoral Science Foundation (2016M602941XB).

基于网格运动统计算法和最佳缝合线的密集重复结构图像快速拼接方法

牟琦1,2, 唐洋1, 李占利1, 李洪安1   

  1. 1. 西安科技大学 计算机科学与技术学院, 西安 710054;
    2. 西安科技大学 机械工程学院, 西安 710054
  • 作者简介:牟琦(1974-),女,陕西西安人,副教授,博士研究生,主要研究方向:人工智能、计算机视觉、图像处理;唐洋(1994-),男,湖北孝感人,硕士研究生,主要研究方向:计算机视觉、图像处理;李占利(1964-),男,陕西周至人,教授,博士,主要研究方向:计算机图形学、图像处理;李洪安(1978-),男,山东武城人,副教授,博士,主要研究方向:图形图像处理、计算机视觉。
  • 基金资助:
    中国博士后科学基金资助项目(2016M602941XB)。

Abstract: For the images with dense repetitive structure, the common algorithms will lead to a large number of false matches, resulting in obvious ghosting in final image and high time consumption. To solve the above problems, a fast stitching method for dense repetitive structure images was proposed based on Grid-based Motion Statistics (GMS) algorithm and optimal seam algorithm. Firstly, a large number of coarse matching points were extracted from the overlapping regions. Then, the GMS algorithm was used for precise matching, and the transformation model was estimated based on the above. Finally, the dynamic-programming-based optimal seam algorithm was adopted to complete the image stitching. The experimental results show that, the proposed method can effectively stitch images with dense repetitive structures. Not only ghosting is effectively suppressed, but also the stitching time is significantly reduced, the average stitching speed is 7.4 times and 3.2 times of the traditional Scale-Invariant Feature Transform (SIFT) and Speeded Up Robust Features (SURF) algorithms respectively, 4.1 times as fast as the area-blocking-based SIFT algorithm, 1.4 times as fast as the area-blocking-based SURF algorithm. The proposed algorithm can effectively eliminate the ghosting of dense repetitive structure splicing and shorten the stitching time.

Key words: image stitching, Grid-based Motion Statistics (GMS) algorithm, precise feature matching, optimal seam, image fusion

摘要: 针对常用的图像拼接算法对具有密集重复结构的图像会产生大量误匹配点从而出现明显鬼影且耗时较长的问题,将网格运动统计(GMS)算法与最佳缝合线算法相结合,提出了一种密集重复结构的图像快速拼接方法。首先,在图像的重叠区域提取大量粗匹配点;接着,采用GMS算法进行精匹配,然后在此基础上估计变换模型;最后,采用基于动态规划思想的最佳缝合线算法完成图像拼接。实验结果表明,将所提算法应用于两组具有密集重复结构的图像上,不仅可以有效消除鬼影,得到理想的拼接效果,而且显著减少了拼接时间;平均拼接速度分别是传统尺度不变特征变换(SIFT)和加速稳健特征(SURF)算法的7.4倍和3.2倍,分别是结合区域分块的SIFT算法和SURF算法的4.1倍和1.4倍。所提算法能够有效地消除密集重复结构拼接时的鬼影,同时缩短了拼接时间。

关键词: 图像拼接, 网格加速统计算法(GMS), 特征精匹配, 最佳缝合线, 图像融合

CLC Number: