Error analysis of unmanned aerial vehicle remote sensing images stitching based on simulation

doi:10.11772/j.issn.1001-9081.2015.04.1116

Abstract

Abstract:

Concerning that the increasement of accumulated error causes serious distortion of Unmanned Aerial Vehicle (UAV) remote sensing images stitching, a projection error correction algorithm based on space intersection was proposed, Using space intersection theory, the spatial coordinates of 3D points were calculated according to correspondence points. Then all 3D points were orthographic projected onto the same space plane, and the orthographic points were projected onto the image plane to get corrected correspondence points, Finally, M-estimator Sample Consensus (MSAC) algorithm was used to estimate the homography matrix, then the stitching image was obtained. The simulation results show that this algorithm can effectively eliminate the projection error, thus achieve the purpose of inhibiting UAV remote sensing image stitching error.

Key words: Unmanned Aerial Vehicle (UAV), image stitching, stitching error, space intersection, M-estimator Sample Consensus (MSAC) algorithm, homography matrix

摘要：

针对多幅无人机遥感图像连续拼接时,累积误差逐渐增大导致拼接的图像严重扭曲变形的问题,提出了一种基于前方交会的投影误差修正算法。该算法根据前方交会原理,解算出同名点对所对应3D点的空间坐标;然后,将所有3D点正射投影到同一物平面上,并将正射点重投影到像平面上,获取校正后的同名点对;最后,利用M估计抽样一致性(MSAC)算法估计单应性矩阵,并进行图像拼接演示。仿真实验结果表明,所提算法能有效地消除投影误差,进而达到抑制无人机遥感图像拼接误差的目的。

关键词: 无人机, 图像拼接, 拼接误差, 空间前方交会, M估计抽样一致性算法, 单应性矩阵

CLC Number:

TP391.9

LI Pengjun, LI Jianzeng, SONG Yao, ZHANG Yan, DU Yulong. Error analysis of unmanned aerial vehicle remote sensing images stitching based on simulation[J]. Journal of Computer Applications, 2015, 35(4): 1116-1119.

李鹏俊, 李建增, 宋瑶, 张岩, 杜玉龙. 基于仿真的无人机遥感图像拼接误差分析[J]. 计算机应用, 2015, 35(4): 1116-1119.

References

[1] SE S, FIROOZFAM P, GOLDSTEIN N, et al. Automated UAV-based mapping for airborne reconnaissance and video exploitation [C]// Proceedings of SPIE 7307, Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications. Bellingham: SPIE Press, 2009: 73070M:1-73070M:7.
[2] XU Y, GONG W, SU A, et al. Multi-viewpoint image mosaicing algorithm for roughly planar scenes[J]. Journal of National University of Defense Technology, 2014, 36(2): 148-155.(徐玉华, 龚文全, 苏昂, 等. 近似平面场景多视点图像拼接算法[J]. 国防科技大学学报, 2014, 36(2): 148-155.)
[3] HE J, LI Y, LU H. Experimental study on UAV image stitching error[J]. Laser and Optoelectronics Progress, 2011, 48(12): 64-68.(何敬, 李永树, 鲁恒. 无人机影像拼接误差实验研究[J]. 激光与光电子学进展, 2011, 48(12): 64-68.)
[4] LIU Q, LIU Y, ZOU L, et al. UAV's image quick mosaic and its errors[J]. The Chinese Journal of Nonferrous Metals, 2012, 22(3): 889-894.(刘庆元, 刘有, 邹磊, 等. 无人机影像的快速拼接及其误差[J]. 中国有色金属学报, 2012, 22(3): 889-894.)
[5] LI C, XUE M, LENG X, et al. Analysis and elimination on aerial recon sequential image stitching accumulative error[J]. Journal of Image and Graphics, 2008, 13(4): 814-819.(李从利, 薛模根, 冷晓艳, 等. 空中侦察序列图像连续拼接的累积误差分析与消除[J]. 中国图象图形学报, 2008, 13(4): 814-819.)
[6] WU Y, YU T, XIE H, et al. Fast automatic stitching for images of unmanned aerial vehicle in emergency response[J]. Journal of Computer-Aided Design and Computer Graphics, 2013, 25(3): 410-416.(吴俣, 余涛, 谢东海. 面向应急响应的无人机图像快速自动拼接[J]. 计算机辅助设计与图形学学报, 2013, 25(3): 410-416.)
[7] WU F. Mathematical methods in computer vision [M]. Beijing: Science Press, 2008.(吴福朝. 计算机视觉中的数学方法[M]. 北京: 科学出版社, 2008.)
[8] XU F, LIU J, WANG X. Distortion correction method for CCD image based on calibration[J]. Chinese Journal of Liquid Crystals and Displays, 2013, 28(4): 633-640.(徐芳, 刘晶红, 王宣. 基于标定的CCD图像畸变校正方法研究[J]. 液晶与显示, 2013, 28(4): 633-640.)
[9] SUN Q, HOU Y, TAN Q. A new method of camera calibration based on segmentation model[J]. Optik, 2013, 124(24): 6991-6995.
[10] YANG S, LI X, ZHU S. The reverse positioning refining algorithm for auto-matching of the remote sensing images[J]. Geomatics and Information Science of Wuhan University, 2013, 38(9): 1083-1087.(杨晟, 李学军, 朱诗兵. 遥感影像匹配中的反定位误匹配剔除算法[J]. 武汉大学学报:信息科学版, 2013, 38(9): 1083-1087.)
[11] SONKA M, HLAVAC V, BOYLE R. Image processing, analysis, and machine vision [M]. 3rd ed. AI H, SU Y, translate. Beijing: Tsinghua University Press, 2011.(SONKA M, HLAVAC V, BOYLE R. 图像处理、分析与机器视觉[M].3版.艾海舟, 苏延超,译. 北京: 清华大学出版社, 2011.)
[12] BROWM M, LOWE D G. Automatic panoramic image stitching using invariant features[J]. International Journal of Computer Vision, 2007, 74(1): 59-73.
[13] YANG B, LI X, YAN L, et al. Mosaic algorithm for aerial remote sensing image and its accuracy evaluation[J]. Computer Engineering, 2014, 40(3): 253-257.(杨彬, 李旭东, 晏磊, 等. 航空遥感图像拼接算法及其精度评价[J]. 计算机工程, 2014, 40(3): 253-257.)
[14] TANG M, LI Y, LU H. Correspondence points matching of UAV images[J]. Opto-Electronic Engineering, 2012, 39(3): 19-24.(唐敏, 李永树, 鲁恒. 无人机影像的同名点匹配[J]. 光电工程, 2012, 39(3): 19-24.)
[15] ZHANG Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11): 1330-1334.
[16] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110.
[17] BAY H, TUYTELAARS T, van GOOL L. Speeded-Up Robust Features (SURF) [J]. Computer Vision and Image Understanding, 2008, 110(3): 346-359.