Feature detection and description algorithm based on ORB-LATCH

doi:10.11772/j.issn.1001-9081.2017.06.1759

Journal of Computer Applications ›› 2017, Vol. 37 ›› Issue (6): 1759-1762.DOI: 10.11772/j.issn.1001-9081.2017.06.1759

Previous Articles Next Articles

Feature detection and description algorithm based on ORB-LATCH

LI Zhuo¹, LIU Jieyu¹, LI Hui², ZHOU Xiaogang¹, LI Weipeng¹

1. Institute of Control Engineering, Rocket Force University of Engineering, Xi'an Shaanxi 710025, China;
2. Military Representative Office of the Rocket Force in the Fourth Research Institute, Xi'an Shaanxi 710025, China

Received:2016-11-23 Revised:2017-01-09 Online:2017-06-10 Published:2017-06-14
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61203007, 61304001).

基于ORB-LATCH的特征检测与描述算法

李卓¹, 刘洁瑜¹, 李辉², 周小刚¹, 李维鹏¹

1. 火箭军工程大学控制工程系, 西安 710025;
2. 火箭军驻第四研究院军事代表室, 西安 710025

通讯作者: 李卓
作者简介:李卓(1992-),男,河北保定人,硕士研究生,主要研究方向:双目视觉导航、车辆定位定向;刘洁瑜(1970-),女,广东增城人,教授,博士,主要研究方向:惯性导航技术、精确制导技术;李辉(1978-),男,山西介休人,工程师,硕士,主要研究方向:导航制导与控制;周小刚(1979-),男,陕西西安人,讲师,博士,主要研究方向:精确制导与突防技术;李维鹏(1992-),男,湖北武汉人,硕士研究生,主要研究方向:移动机器人视觉同步定位与地图构建。
基金资助:
基金项目：国家自然科学基金资助项目（61203007，61304001）。

Abstract

Abstract: The binary descriptor based on Learned Arrangements of Three Patch Codes (LATCH) lacks of scale invariance and its rotation invariance depends upon feature detector, so a new feature detection and description algorithm was proposed based on Oriented fast and Rotated Binary robust independent elementary feature (ORB) and LATCH. Firstly, the Features from Accelerated Segment Test (FAST) was adopted to detect corner feature on the scale space of image pyramid. Then, the intensity centroid method of ORB was used to obtain orientation compensation. Finally, the LATCH was used to describe the feature. The experimental results indicate that, the proposed algorithm has the characteristics of low computational complexity, high real-time performance, rotation invariance and scale invariance. Under the same accuracy, the recall rate of the proposed algorithm is better than ORB and HARRIS-LATCH algorithm, the matching inner rate of the proposed algorithm is higher than ORB algorithm by 4.2 percentage points. In conclusion, the proposed algorithm can reduce the performance gap with histogram based algorithms such as Scale Invariant Feature Transform (SIFT) and Speeded Up Robust Feature (SURF) while maintaining the real-time property, and it can deal with image sequence in real-time quickly and exactly.

Key words: feature detection, binary descriptor, scale invariance, rotation invariance, real-time property

摘要： 针对基于学习安排的三元组（LATCH）二进制描述子不具备尺度不变性且其旋转不变性，需要特征检测子辅助的问题，提出了一种基于快速定向旋转二进制稳健基元独立特征（ORB）和LATCH相结合的特征检测与描述算法。首先，在图像金字塔尺度空间上进行加速段测试特征（FAST）检测；然后，采用ORB灰度质心方法来进行方向补偿；最后，对特征进行LATCH描述。实验结果表明，所提算法具备运算量小、实时性高以及旋转和尺度不变性的特点，在相同的准确率下，其召回率优于ORB和哈里斯-LATCH （HARRIS-LATCH）算法，其匹配内点率比ORB算法提高了4.2个百分点。该算法在保持实时性的同时进一步缩小了与基于直方图的尺度不变特征变换（SIFT）和加速健壮特征（SURF）算法之间的精度差距，可对图像序列进行快速且精确的实时处理。

关键词: 特征检测, 二进制描述子, 尺度不变性, 旋转不变性, 实时性

CLC Number:

TP242.62

LI Zhuo, LIU Jieyu, LI Hui, ZHOU Xiaogang, LI Weipeng. Feature detection and description algorithm based on ORB-LATCH[J]. Journal of Computer Applications, 2017, 37(6): 1759-1762.

李卓, 刘洁瑜, 李辉, 周小刚, 李维鹏. 基于ORB-LATCH的特征检测与描述算法[J]. 计算机应用, 2017, 37(6): 1759-1762.

References

[1] LOWE D G. Object recognition from local scale-invariant features[C]//Proceedings of the Seventh IEEE International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 1999, 2:1150-1157.
[2] BAY H, TUYTELAARS T, GOOL L V. SURF:speeded up robust features[C]//Proceedings of the 9th European Conference on Computer Vision, LNCS 3951. Berlin:Springer, 2006:404-417.
[3] SINHA S N, FRAHM J M, POLLEFEYS M, et al. GPU-based video feature tracking and matching, TR 06-012[R]. Chapel Hill, NC:The University of North Carolina at Chapel Hill, 2006.
[4] CALONDER M, LEPETIT V, STRECHA C, et al. BRIEF:binary robust independent elementary features[C]//Proceedings of the 2010 European Conference on Computer Vision, LNCS 6314. Berlin:Springer, 2010:778-792.
[5] RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB:an efficient alternative to SIFT or SURF[C]//Proceedings of the 2011 IEEE International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 2011:2564-2571.
[6] LEUTENEGGER S, CHLI M, SIEGWQRT R Y. BRISK:binary robust invariant scalable keypoints[C]//Proceedings of the 2011 IEEE International Conference on Computer Vision. Washington, DC:IEEE Computer Society, 2011:2548-2555.
[7] ORTIZ R. Freak:fast retina keypoint[C]//CVPR'12:Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2012:510-517.
[8] RUSINOL M, CHAZALON J, OGIER J M, et al. A comparative study of local detectors and descriptors for mobile document classification[C]//Proceedings of the 2015 13th International Conference on Document Analysis and Recognition. Washington, DC:IEEE Computer Society, 2015:596-600.
[9] MUR-ARTAL R, TARDOS J D. Fast relocalisation and loop closing in keyframe-based SLAM[C]//Proceedings of the 2014 IEEE International Conference on Robotics and Automation. Piscataway, NJ:IEEE, 2014:846-853.
[10] MUR-ARTAL R, MONTIEL J M M, TARDOS J D. ORB-SLAM:a versatile and accurate monocular SLAM system[J]. IEEE Transactions on Robotics, 2015, 31(5):1147-1163.
[11] MUR-ARTAL R, TARDOS J D. ORB-SLAM2:an open-source SLAM system for monocular, stereo and RGB-D cameras[EB/OL].[2016-10-23]. http://xueshu.baidu.com/s?wd=paperuri%3A%28b8dc1828fec6e423409fcd44fbc2e89a%29&filter=sc_long_sign&tn=SE_xueshusource_2kduw22v&sc_vurl=http%3A%2F%2Farxiv.org%2Fpdf%2F1610.06475.pdf&ie=utf-8&sc_us=6804051625971623844.
[12] HEINLY J, DUNN E, FRAHM J M. Comparative evaluation of binary features[C]//Proceedings of the 2012 12th European Conference on Computer Vision, LNCS 7573. Berlin:Springer, 2012:759-773.
[13] LEVI G. Adding rotation invariance to the BRIEF descriptor[EB/OL].
[2016-10-23]. https://gilscvblog.wordpress.com/2013/08/18/a-short-introduction-to-descriptors/.
[14] LEVI G, HASSNER T. LATCH:learned arrangements of three patch codes[C]//Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision. Washington, DC:IEEE Computer Society, 2016:1-9.
[15] ROSTEN E, PORTER R, DRUMMOND T. Faster and better:a machine learning approach to corner detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(1):105-119.
[16] 王蒙,戴亚平,王庆林.一种新的FAST-Snake目标跟踪方法[J].自动化学报,2014,40(6):1108-1115.(WANG M, DAI Y P, WANG Q L. A novel FAST-snake object tracking approach[J]. Acta Automatica Sinica, 2014, 40(6):1108-1115.)
[17] HARRIS C, STEPHENS M. A combined corner and edge detector[EB/OL].
[2016-10-23]. http://www.rose-hulman.edu/class/cs/csse461/handouts/Day29/avc-88-023.pdf.
[18] MIKOLAJCZYK K, SCHMID C. A performance evaluation of local descriptors[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(10):1615-1630.
[19] GEIGER A. Are we ready for autonomous driving? The KITTI vision benchmark suite[C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE Computer Society, 2012:3354-3361.
[20] GEIGER A, LENZ P, STILLER C, et al. Vision meets robotics:the KITTI dataset[J]. International Journal of Robotics Research, 2013, 32(11):1231-1237.

Feature detection and description algorithm based on ORB-LATCH

基于ORB-LATCH的特征检测与描述算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 12

Recommended Articles

Metrics

[1]	LIU Wanghua, LIU Guangshuai, CHEN Xiaowen, LI Xurui. Robust texture representation by combining differential feature and Haar wavelet decomposition [J]. Journal of Computer Applications, 2020, 40(9): 2728-2736.
[2]	ZHAO Xinchen, YANG Nan. Optimizing webcam-based eye tracking system via head pose analysis [J]. Journal of Computer Applications, 2020, 40(11): 3295-3299.
[3]	XIU Chunbo, MA Yunfei, PAN Xiaonan. Image feature point matching method based on distance fusion [J]. Journal of Computer Applications, 2019, 39(11): 3158-3162.
[4]	SUN Zengyou, DUAN Yushuai, LI Ya. Image feature point matching algorithm based on center surround filter detection [J]. Journal of Computer Applications, 2017, 37(12): 3547-3553.
[5]	WANG Zhiwen, JIANG Lianyuan, WANG Yuhang, WANG Rifeng, ZHANG Canlong, HUANG Zhenjin, WANG Pengtao. Behavior representation of multi-athletes for football game video based on scale adaptive local spatial and temporal characteristics [J]. Journal of Computer Applications, 2016, 36(8): 2134-2138.
[6]	BAI Xuebing, CHE Jin, MU Xiaokai, ZHANG Ying. Improved feature points matching algorithm based on speed-up robust feature and oriented fast and rotated brief [J]. Journal of Computer Applications, 2016, 36(7): 1923-1926.
[7]	YU Yafeng, LIU Guangshuai, MA Ziheng, GAO Pan. Improved pairwise rotation invariant co-occurrence local binary pattern algorithm used for texture feature extraction [J]. Journal of Computer Applications, 2016, 36(12): 3389-3393.
[8]	RUAN Feng, ZHANG Hui, LI Xuanlun. Rapid displacement compensation method for liquid impurity detection images [J]. Journal of Computer Applications, 2016, 36(12): 3442-3447.
[9]	ZHANG Heng, LIU Dayong, LIU Yanli, NIE Chenxi. Improved binary robust invariant scalable keypoints algorithm fusing depth information [J]. Journal of Computer Applications, 2015, 35(8): 2285-2290.
[10]	YIN Jun, DONG Lida, CHI Tianyang. Mobile robot motion estimation based on classified feature points [J]. Journal of Computer Applications, 2015, 35(2): 590-594.
[11]	LIU Hongbin DU Ling JI Hongli. Fast geometric resistant video watermarking scheme for gateway copyright protection [J]. Journal of Computer Applications, 2013, 33(12): 3531-3535.
[12]	. Application of fractal theory to software complexity [J]. Journal of Computer Applications, 2010, 30(10): 2730-2734.