Rapid mismatching elimination algorithm based on motion smoothing constraints

doi:10.11772/j.issn.1001-9081.2018030621

Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (9): 2678-2682.DOI: 10.11772/j.issn.1001-9081.2018030621

Previous Articles Next Articles

Rapid mismatching elimination algorithm based on motion smoothing constraints

LI Wei, LI Weixiang, ZHANG Fan, JIE Wei

College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing Jiangsu 211800, China

Received:2018-03-26 Revised:2018-04-27 Online:2018-09-10 Published:2018-09-06
Contact: 李为相
Supported by:
This work is partially supported by the Six Talent Peaks Project in Jiangsu Province (XXR-012).

基于运动平滑约束项的快速误匹配剔除算法

李为, 李为相, 张璠, 揭伟

南京工业大学电气工程与控制科学学院, 南京 211800

通讯作者: 李为相
作者简介:李为(1994—),男,湖北石首人,硕士研究生,主要研究方向:图像处理、模式识别;李为相(1973—),男,河南光山人,副教授,博士,主要研究方向:智能决策、社交网络、图像处理;张璠(1994—),男,浙江金华人,硕士研究生,主要研究方向:推荐系统、社交网络;揭伟(1994—),男,福建龙岩人,硕士研究生,主要研究方向:图像处理、模式识别。
基金资助:
江苏省"六大人才高峰"项目（XXR-012）。

Abstract

Abstract: To solve the problem of huge computation cost and low matching accuracy in the course of iterative calculation while using RANdom SAmple Consensus (RANSAC) algorithm for image splicing, a mismatching elimination algorithm was proposed based on motion smoothing constraint terms. Firstly, feature points were extracted with ORB (Oriented FAST and Rotated BRIEF) algorithm, and initial matching of feature points was implemented based on Hamming distance. Secondly, the statistical neighboring support estimators based on motion smoothing constraint terms were used to achieve rough mismatching elimination, and then spatial geometric constraints were applied to refine mismatching elimination. Finally, grouping sorting was used to solve the model parameters, and weighted averaging was used to realize image fusion. The experimental results show that the mismatching elimination rate is improved by 75.6% compared to the algorithm for reducing the total number of sampling points and 24% compared to adaptive threshold algorithm. This method can effectively eliminate mismatching and realize accurate image mosaic.

Key words: image matching, Oriented FAST (Features from Accelerated Segment Test) and Rotated BRIEF (Binary Robust Independent Elmentary Features)(ORB), motion smoothing constraint term, wrong matching, structural similarity

摘要： 针对图像拼接时用随机抽样一致性（RANSAC）算法迭代计算过程中计算量大、匹配正确率低的问题，提出了一种基于运动平滑约束项的误匹配剔除算法。首先采用快速旋转不变特征（ORB）算法提取特征点，基于汉明距离实现特征点初匹配；其次，基于运动平滑约束项统计邻域支持估计量实现误匹配粗剔除；然后，进一步采用空间几何约束关系实现误匹配精剔除；最后，利用分组排序采样求解模型参数，采用加权平均实现图像融合。实验结果表明，该算法的误匹配剔除率相比缩小抽样点总量算法提升了75.6%，相比自适应阈值算法提升了24%，此方法能有效剔除误匹配，实现图像精确拼接。

关键词: 图像匹配, 快速旋转不变特征, 运动平滑约束项, 误匹配, 结构相似度

CLC Number:

TP391.41

LI Wei, LI Weixiang, ZHANG Fan, JIE Wei. Rapid mismatching elimination algorithm based on motion smoothing constraints[J]. Journal of Computer Applications, 2018, 38(9): 2678-2682.

李为, 李为相, 张璠, 揭伟. 基于运动平滑约束项的快速误匹配剔除算法[J]. 计算机应用, 2018, 38(9): 2678-2682.

References

[1] 黄立勤,陈财淦.全景图拼接中图像融合算法的研究[J].电子与信息学报,2014,36(6):1292-1298.(HUANG L Q, CHEN C G. Study on image fusion algorithm of panoramic image stitching[J]. Journal of Electronics and Information Technology, 2014, 36(6):1292-1298.)
[2] 赵小强,岳宗达.一种面向图像拼接的快速匹配算法[J].南京理工大学学报(自然科学版),2016,40(2):165-171.(ZHAO X Q, YUE Z D. Fast matching algorithm for image mosaic[J]. Journal of Nanjian University of Science and Technology, 2016, 40(2):165-171.)
[3] YUN T, LI W, SUN Y, et al. Study of subtropical forestry index retrieval using terrestrial laser scanning and hemispherical photography[J]. Mathematical Problems in Engineering, 2015, 2015:Article ID 206108.
[4] RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB:an efficient alternative to SIFT or SURF[C]//ICCV'11:Proceedings of the 2011 International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 2011:2564-2571.
[5] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[6] 邢凯盛,凌有铸,陈孟元.ORB特征匹配的误匹配点剔除算法研究[J]. 电子测量与仪器学报,2016,30(8):1255-1262.(XING K S, LING Y Z, CHEN M Y. Mismatching points elimination algorithm for ORB feature matching[J]. Journal of Electronic Measurement and Instrumentation, 2016, 30(8):1255-1262.)
[7] 王茜,宁纪锋,曹宇翔,等.基于SIFT算法的无人机遥感图像拼接技术[J].吉林大学学报(信息科学版),2017,35(2):188-197.(WANG Q, NING J F, CAO Y X, et al. Matching technologies of UAV remote sensing image based on SIFT[J]. Journal of Jilin University (Information Science Edition), 2017, 35(2):188-197.)
[8] YUN T, WANG L. Medical images watermarking scheme based on cellular automata and STDM in curvelet domain[J]. International Review on Computers and Software, 2012, 7(4):1917-1925.
[9] CALONDER M, LEPETIT V, STRECHA C, et al. BRIEF:binary robust independent elementary features[C]//ECCV'10:Proceedings of the 11th European Conference on Computer Vision. Berlin:Springer, 2010:778-792.
[10] CHUM O, MATAS J. Matching with PROSAC-progressive sample consensus[C]//CVPR'05:Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2005:220-226.
[11] BIAN J, LIN W Y, MATSUSHITA Y, et al. GMS:grid-based motion statistics for fast, ultra-robust feature correspondence[C]//CVPR 2017:Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2017:2828-2837.
[12] 杨帆,郭建华,王竞雪.采用结构相似度和几何约束原理的影像误匹配剔除算法[J].信号处理,2016,32(1):83-90.(YANG F, GUO J H, WANG J X. Image mismatching eliminating algorithm using structural similarity and geometric constraint[J]. Journal of Signal Processing, 2016, 32(1):83-90.)
[13] 瞿中,乔高元,林嗣鹏.一种消除图像拼接缝和鬼影的快速拼接算法[J]. 计算机科学,2015,42(3):280-283.(QU Z, QIAO G Y, LIN S P. Fast image stitching algorithm eliminates seam line and ghosting[J]. Computer Science, 2015, 42(3):280-283.)
[14] 谷雨,周阳,任刚,等.结合最佳缝合线和多分辨率融合的图像拼接[J].中国图象图形学报,2017,22(6):842-851.(GU Y, ZHOU Y, REN G, et al. Image stitching by combining optimal seam and multi-resolution fusion[J]. Journal of Image and Graphics, 2017, 22(6):842-851.)
[15] ZHANG F, LIU F. Parallax-tolerant image stitching[C]//CVPR'14:Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2014:3262-3269.
[16] 单小军,唐娉,郑柯.GSSAC:一种用于遥感影像配准的误匹配点检测方法[J].计算机应用研究,2016,33(5):1562-1565.(SHAN X J, TANG P, ZHENG K. GSSAC:false matching points detection method for remote sensing images[J]. Application Research of Computers, 2016, 33(5):1562-1565.)

Rapid mismatching elimination algorithm based on motion smoothing constraints

基于运动平滑约束项的快速误匹配剔除算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	ZHU Lin, YU Haitao, LEI Xinyu, LIU Jing, WANG Ruofan. Brain network feature identification algorithm for Alzheimer's patients based on MRI image [J]. Journal of Computer Applications, 2020, 40(8): 2455-2459.
[2]	QIU Yunfei, LIU Xing. Local feature point matching algorithm with anti-affine property [J]. Journal of Computer Applications, 2020, 40(4): 1133-1137.
[3]	WANG Xiao, WEI Jiawang, YUAN Yubo. Face image inpainting method based on circular fields of feature parts [J]. Journal of Computer Applications, 2020, 40(3): 847-853.
[4]	ZHANG Bin, LUO Xiaoqing, ZHANG Zhancheng. Image fusion quality evaluation algorithm based on TV-L¹ structure and texture decomposition [J]. Journal of Computer Applications, 2019, 39(9): 2701-2706.
[5]	ZHU Chengde, LI Zhiwei, WANG Kai, GAO Yan, GUO Hengchang. Image matching algorithm based on improved RANSAC-GMS [J]. Journal of Computer Applications, 2019, 39(8): 2396-2401.
[6]	WANG Yan, LYU Meng, MENG Xiangfu, LI Yuhao. Image matching method with illumination robustness [J]. Journal of Computer Applications, 2019, 39(1): 262-266.
[7]	CHEN Hong, XIAO Yue, XIAO Chenglong, SONG Hao. Adaptive image matching algorithm based on SIFT operator fused with maximum dissimilarity coefficient [J]. Journal of Computer Applications, 2018, 38(5): 1410-1414.
[8]	YANG Ming, HUANG Ying. Diamond encoding steganography algorithm based on algebraic multigrid [J]. Journal of Computer Applications, 2017, 37(6): 1609-1615.
[9]	HOU Yifan, WANG Dong, XING Shuai, XU Qing, GE Zhongxiao. Design and implementation of online real-time mapping system based on image stereo vision [J]. Journal of Computer Applications, 2016, 36(5): 1450-1454.
[10]	ZHANG Xu, GAO Jiao, WANG Wanguo, LIU Liang, ZHANG Jingjing. Image mosaic approach of transmission tower based on saliency map [J]. Journal of Computer Applications, 2015, 35(4): 1133-1136.
[11]	FANG Zhiwen, CAO Zhiguo, ZHU Lei. Image matching algorithm based on histogram of gradient angle local feature descriptor [J]. Journal of Computer Applications, 2015, 35(4): 1079-1083.
[12]	LIAO Shengyang, HUANG Tianqiang. Fast detection and recovery method for copy-move forgery in time domain of homologous videos based on geometric mean decomposition and structural similarity [J]. Journal of Computer Applications, 2015, 35(3): 821-825.
[13]	WANG Lin, ZHAO Jiankang, XIA Xuan, LONG Haihui. Bridge crack measurement system based on binocular stereo vision technology [J]. Journal of Computer Applications, 2015, 35(3): 901-904.
[14]	SUN Guibin, ZHOU Yong. Community detection algorithm based on structural similarity affinity propagation [J]. Journal of Computer Applications, 2015, 35(3): 633-637.
[15]	LIU Huan ZHU Ping XIAO Rong TANG Weidong. Belly shape modeling with new combined invariant moment based on stereo vision [J]. Journal of Computer Applications, 2013, 33(11): 3183-3186.