Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (5): 1403-1408.DOI: 10.11772/j.issn.1001-9081.2019091621

• Virtual reality and multimedia computing • Previous Articles     Next Articles

Virtual-real registration method of natural features based on binary robust invariant scalable keypoints and speeded up robust features

ZHOU Xiang1,2, TANG Liyu1,2, LIN Ding1,2   

  1. 1.Key Lab of Spatial Data Mining & Information Sharing, Ministry of Education (Fuzhou University), FuzhouFujian 350108, China
    2.National-Local Joint Engineering Research Center of Geospatial Information Technology (Fuzhou University), FuzhouFujian 350108, China
  • Received:2019-09-24 Revised:2019-11-12 Online:2020-05-10 Published:2020-05-15
  • Contact: TANG Liyu, born in 1972, Ph. D., research fellow. Her research interests include geographic visualization and virtual geographic environment, virtual plant.
  • About author:ZHOU Xiang, born in 1995, M. S. candidate. His research interests include geographic visualization and virtual geographic environment. TANG Liyu, born in 1972, Ph. D., research fellow. Her research interests include geographic visualization and virtual geographic environment, virtual plant. LIN Ding, born in 1977, Ph. D., research assistant. Her research interests include geographic visualization and virtual geographic environment.
  • Supported by:

    This work is partially supported by the National Key Research and Development Program of China (2018YFB1004905).

基于二进制鲁棒不变尺度关键点-加速稳健特征的自然特征虚实注册方法

周翔1,2, 唐丽玉1,2, 林定1,2   

  1. 1.空间数据挖掘与信息共享教育部重点实验室(福州大学),福州 350108
    2.地理空间信息技术国家地方联合工程研究中心(福州大学),福州 350108
  • 通讯作者: 唐丽玉(1972—)
  • 作者简介:周翔(1995—),男,安徽马鞍山人,硕士研究生,主要研究方向:地学可视化与虚拟地理环境; 唐丽玉(1972—),女,福建莆田人,研究员,博士,主要研究方向:地学可视化与虚拟地理环境、虚拟植物; 林定(1977—),女,福建福州人,助理研究员,博士,主要研究方向:地学可视化与虚拟地理环境。
  • 基金资助:

    国家重点研发计划项目(2018YFB1004905)。

Abstract:

Concerning the problem that the accuracy and real-time effects of virtual-real registration in Augmented Reality (AR) based on vision are greatly affected by the changes of illumination, occlusion and perspective, which is easy to lead to failure of registration, a virtual-real registration method of natural features based on Binary Robust Invariant Scalable Keypoints-Speeded Up Robust Features (BRISK-SURF) algorithm was proposed. Firstly, Speeded Up Robust Features (SURF) feature extractor was used to detect the feature points. Then, Binary Robust Invariant Scalable Keypoints (BRISK) descriptor was used to describe the feature points in binary, and the feature points were matched accurately and efficiently by combining Hamming distance. Finally, the virtual-real registration was realized according to the homography relationship between images. Experiments were performed from the aspects of image feature matching and virtual-real registration. Results show that the average precision of BRISK-SURF algorithm is basically the same with that of SURF algorithm, is about 25% higher than that of BRISK algorithm, and the average recall of BRISK-SURF is increased by about 10% compared to that of BRISK algorithm; the result of the virtual-real registration method based on BRISK-SURF is close to the reference standard data with high precision and good real-time performance. The Experimental results illustrate that the proposed method has high recognition accuracy, registration precision and real-time effects for images with different illuminations, occlusions and perspectives. Besides, the interactive tourist resource presentation and experience system based on AR is realized by using the proposed method.

Key words: Augmented Reality (AR), Binary Robust Invariant Scalable Keypoints-Speeded Up Robust Features (BRISK-SURF) algorithm, homography matrix, natural feature, virtual-real registration

摘要:

针对基于视觉的增强现实(AR)中虚实注册的准确率和实时效果受光照、遮挡和视角变化影响大,易导致注册失败的问题,提出一种基于二进制鲁棒不变尺度关键点-加速稳健特征(BRISK-SURF)算法的自然特征虚实注册方法。首先,利用加速稳健特征(SURF)特征提取算子检测特征点;然后,采用二进制尺度旋转不变鲁棒(BRISK)特征描述算子对特征点进行二进制描述,结合汉明距离实现准确高速的特征匹配;最后,根据图像间的单应性关系实现虚实注册。从图像特征匹配和虚实注册两方面进行实验,结果显示BRISK-SURF算法的平均准确率与SURF算法基本保持一致,比BRISK算法提高了约25%,平均召回率提高了约10%;基于BRISK-SURF的注册方法的结果接近参考标准数据,精度较高,实时性较好。实验结果表明,所提方法对于光照、遮挡和视角情况不同的图像具有较高的识别准确度、注册精度和实时效果。另外,使用此方法实现了基于AR的交互式旅游资源呈现与体验系统。

关键词: 增强现实, 二进制尺度旋转不变鲁棒-加速稳健特征算法, 单应性矩阵, 自然特征, 虚实注册

CLC Number: