Fundamental matrix estimation based on three-view constraint

doi:10.11772/j.issn.1001-9081.2014.10.2930

Journal of Computer Applications ›› 2014, Vol. 34 ›› Issue (10): 2930-2933.DOI: 10.11772/j.issn.1001-9081.2014.10.2930

Previous Articles Next Articles

Fundamental matrix estimation based on three-view constraint

LI Cong,ZHAO Hongrui,FU Gang

Institute of Geomatics, Tsinghua University, Beijing 100084, China

Received:2014-04-15 Revised:2014-06-19 Online:2014-10-30 Published:2014-10-01
Contact: ZHAO Hongrui

基于三视图约束的基础矩阵估计

李聪,赵红蕊,傅罡

清华大学地球空间信息研究所，北京 100084

通讯作者: 赵红蕊
作者简介:李聪(1988-)，男，山东潍坊人，硕士研究生，主要研究方向：摄影测量与遥感图像处理；
赵红蕊（1969-），女，河北唐山人，教授，博士，主要研究方向：定量遥感与3S技术；
傅罡（1984-），男，陕西宝鸡人，博士研究生，主要研究方向：数字图像处理、遥感信息提取。
基金资助:
国家863计划项目

Abstract

Abstract:

The matching points cant be decided absolutely by its residuals just relying on epipolar geometry residuals, which influences the selection of optimum inlier set. So a novel fundamental matrix calculation algorithm was proposed based on three-view constraint. Firstly, the initial fundamental matrices were estimated by traditional RANdom SAmple Consensus (RANSAC) method. Then matching points existed in every view were selected, and the epipolar lines of points not in the common view were calculated in fundamental matrix estimation. Distances between the points in common view and the intersection of its matching points epipolar lines were calculated. Under judgment based on the distances, a new optimum inlier set was obtained. Finally, the M-Estimators (ME) algorithm was used to calculate the fundamental matrices based on the new optimum inlier set. Through a mass of experiments in case of mismatching and noise, the results indicate that the algorithm can effectively reduce the influence of mismatch and noise on accurate calculation of fundamental matrices. It gets better accuracy than traditional robust algorithms by limiting distance between point and epipolar line to about 0.3 pixels, in addition, an improvement in stability. So, it can be widely applied to fields such as 3D reconstruction based on image sequence and photogrammetry.

摘要：

考虑到只依赖对极几何关系的匹配点余差并不能完全区分匹配点的正确与否，从而影响内点集选取的情况，提出基于三视图约束的基础矩阵估计算法。首先，使用传统随机抽样一致性（RANSAC）算法计算三视图的任意两对相邻图像间的基础矩阵，确定三视图中共有的匹配点对，并计算估计基础矩阵时非共用图像上的匹配点在共用图像上的极线；然后，计算两条极线的交点与共用图像上对应匹配点间的距离，以距离值的大小作为内点判断的依据，得到新的内点集。在新内点集的基础上，采用M估计算法重新计算基础矩阵。实验结果表明：该方法可以同时降低噪声和错误匹配对基础矩阵精确计算的影响，精度优于传统鲁棒性算法，使点到极线的距离限制在0.3个像素左右，而且计算结果具有稳定性，可以被广泛地应用到基于图像序列的三维重建和摄影测量等领域中。

CLC Number:

TP391.41

LI Cong ZHAO Hongrui FU Gang. Fundamental matrix estimation based on three-view constraint[J]. Journal of Computer Applications, 2014, 34(10): 2930-2933.

李聪赵红蕊傅罡. 基于三视图约束的基础矩阵估计[J]. 计算机应用, 2014, 34(10): 2930-2933.

References

［1］ARMANGUE X, SALVI J. Overall view regarding fundamental matrix estimation ［J］. Image and Vision Computing, 2003,21(2):200-205.
［2］HARTLEY R. Projective reconstruction and invariants from multiple images ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994,16(10):1036-1040.［3］HARTLEY R. In defense of the eight-point algorithm ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997,19(6):580-593.
［4］LUONG Q T, FAUGERAS O. Determining the fundamental matrix with planes: instability and new algorithms ［C］// Proceeding of the 1993 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 1993:489-494.
［5］ZHONG H. Research on methods for estimating the fundamental matrix ［D］. Changchun: Jilin University, 2005.(钟慧湘.基本矩阵计算方法的研究［D］.长春:吉林大学,2005.)
［6］TORR P, MURRAY D. The development and comparison of robust methods for estimating the fundamental matrix ［J］. International Journal of Computer Vision, 1997,24(3):271-300.
［7］LU S, LEI Y, KONG W, et al.Fundamental matrix estimation based on probability analysis and sampling consensus ［J］. Control and Decision, 2012,27(3):425-430.（鲁珊,雷英杰,孔韦韦,等.基于概率抽样一致性的基础矩阵估计算法［J］. 控制与决策,2012,27(3):425-430.）
［8］CARRO A I, MORROS J R. Promeds: an adaptive robust fundamental matrix estimation approach ［C］// Proceedings of the 2012 3DTV-Conference: the True Vision—Capture, Transmission and Display of 3D Video. Piscataway: IEEE Press, 2012:1-4.
［9］TORR P. Bayesian model estimation and selection for epipolar geometry and generic manifold fitting ［J］. International Journal of Computer Vision, 2002,50(1):35-61.
［10］LI Y, VELIPASALAR S, GURSOY M C. An improved evolutionary algorithm for fundamental matrix estimation ［C］// Proceedings of the 10th IEEE International Conference on Advanced Video and Signal Based Surveillance. Piscataway: IEEE Press, 2013:226-231.
［11］CHAN K-H, TANG C-Y, WU Y-L, et al.Robust orthogonal particle swarm optimization for estimating the fundamental matrix ［C］// Proceedings of the 2011 IEEE Visual Communications and Image Processing. Piscataway: IEEE Press, 2011:1-4.
［12］SHI X, LIU F, WANG Y, et al.A fundamental matrix estimation algorithm based on point weighting strategy ［C］// Proceedings of the 2011 International Conference on Virtual Reality and Visualization. Piscataway: IEEE Press, 2011:24-29.
［13］CALDERON D B, MARIA T. An approach for estimating the fundamental matrix ［C］// Proceedings of the 2011 6th Colombian Computing Congress. Piscataway: IEEE Press, 2011:1-6.
［14］BRANDT S S. Maximum likelihood robust regression by mixture models ［J］. Journal of Mathematical Imaging and Vision, 2006,25(1):25-48.
［15］CHEN F, WANG R. Clustering algorithm for the fundamental matrix estimation ［J］. Journal of Computer-Aided Design and Computer Graphics, 2005,17(10):2251-2256.(陈付幸,王润生.基础矩阵估计的聚类分析算法［J］.计算机辅助设计与图形学学报,2005,17(10):2251-2256.)
［16］LU S, LEI Y, KONG W, et al.Robust fundamental matrix estimation based on kernel fuzzy clustering ［J］. Journal of Jilin University: Engineering and Technology Edition, 2012,42(2):434-439.(鲁珊,雷英杰,孔韦韦,等.基于模糊核聚类的鲁棒性基础矩阵估计算法［J］.吉林大学学报:工学版,2012,42(2):434-439.)
［17］FANG L. Research on feature based 3D scene reconstruction techniques from images sequence ［D］. Wuhan: Huazhong University of Science and Technology, 2006.(方磊.基于特征的图像序列三维场景重建技术研究［D］.武汉:华中科技大学,2006.)

[1]	. Pavement defect detection algorithm with enhanced morphological perception [J]. Journal of Computer Applications, 0, (): 0-0.
[2]	. Data augmentation method for abnormal passenger behavior in elevators based on dynamic graph convolutional network [J]. Journal of Computer Applications, 0, (): 0-0.
[3]	. Text-based person retrieval method based on multi-granularity shared semantic center association [J]. Journal of Computer Applications, 0, (): 0-0.
[4]	. Image Caption Method Based on Swin-Transformer and Multi-Scale Feature Fusion [J]. Journal of Computer Applications, 0, (): 0-0.
[5]	Keyi FU, Gaocai WANG, Man WU. Few-shot object detection method based on improved region proposal network and feature aggregation [J]. Journal of Computer Applications, 2024, 44(12): 3790-3797.
[6]	Yudong PANG, Zhixing LI, Weijie LIU, Tianhao LI, Ningning WANG. Small target detection model in overlooking scenes on tower cranes based on improved real-time detection Transformer [J]. Journal of Computer Applications, 2024, 44(12): 3922-3929.
[7]	Xin ZHAO, Xinjie LI, Jian XU, Buyun LIU, Xiang BI. Parallel medical image registration model based on convolutional neural network and Transformer [J]. Journal of Computer Applications, 2024, 44(12): 3915-3921.
[8]	. 3D object detection algorithm based on multiscale network with axial attention [J]. Journal of Computer Applications, 0, (): 0-0.
[9]	. Few-shot skin image classification model based on spatial transformation and feature distribution calibration [J]. Journal of Computer Applications, 0, (): 0-0.
[10]	. Multi-target detection algorithm for traffic intersection images based on YOLOv9 [J]. Journal of Computer Applications, 0, (): 0-0.
[11]	. Semi-supervised object detection framework guided by self-paced learning#br# [J]. Journal of Computer Applications, 0, (): 0-0.
[12]	Lihua HU, Xiaoping LI, Jianhua HU, Sulan ZHANG. Multi-view stereo method based on quadtree prior assistance [J]. Journal of Computer Applications, 2024, 44(11): 3556-3564.
[13]	Cong GU, Qiqiang DUAN, Siyu REN. Polyp segmentation algorithm based on context-aware network [J]. Journal of Computer Applications, 2024, 44(11): 3617-3622.
[14]	Yaobin ZOU, Bin ZHANG. Automatic thresholding method guided by maximizing four-directional weighted Shannon entropy [J]. Journal of Computer Applications, 2024, 44(11): 3565-3573.
[15]	Tao LIU, Shihong JU, Yimeng GAO. Small object detection algorithm from drone perspective based on improved YOLOv8n [J]. Journal of Computer Applications, 2024, 44(11): 3603-3609.

Fundamental matrix estimation based on three-view constraint

基于三视图约束的基础矩阵估计

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics