Journal of Computer Applications ›› 2024, Vol. 44 ›› Issue (3): 722-731.DOI: 10.11772/j.issn.1001-9081.2023030313

• Artificial intelligence • Previous Articles     Next Articles

Remote sensing image recommendation method based on content interpretation

Yuqiu LI1, Liping HOU1, Jian XUE1, Ke LYU1,2(), Yong WANG3   

  1. 1.School of Engineering Science,University of Chinese Academy of Sciences,Beijing 100049,China
    2.Peng Cheng Laboratory,Shenzhen Guangdong 518055,China
    3.School of Artificial Intelligence,University of Chinese Academy of Sciences,Beijing 100049,China
  • Received:2023-03-24 Revised:2023-06-16 Accepted:2023-06-19 Online:2023-09-05 Published:2024-03-10
  • Contact: Ke LYU
  • About author:LI Yuqiu, born in 1998, M. S. candidate. His research interests include computer vision, remote sensing image processing.
    HOU Liping, born in 1996, Ph. D. Her research interests include computer vision, deep learning, object detection, remote sensing image processing.
    XUE Jian, born in 1979, Ph. D., professor. His research interests include digital image processing, scientific computing visualization.
    WANG Yong, born in 1975, Ph. D., research fellow. His research interests include modeling and optimization of complex systems, pattern recognition, data mining.
  • Supported by:
    National Natural Science Foundation of China(61731022)

基于内容解译的遥感图像推荐方法

李雨秋1, 侯利萍1, 薛健1, 吕科1,2(), 王泳3   

  1. 1.中国科学院大学 工程科学学院, 北京 100049
    2.鹏城实验室, 广东 深圳 518055
    3.中国科学院大学 人工智能学院, 北京 100049
  • 通讯作者: 吕科
  • 作者简介:李雨秋(1998—),男,山东德州人,硕士研究生,CCF会员,主要研究方向:计算机视觉、遥感图像处理
    侯利萍(1996—),女,河南商丘人,博士,主要研究方向:计算机视觉、深度学习、目标检测、遥感图像处理
    薛健(1979—),男,江苏宜兴人,教授,博士,CCF会员,主要研究方向:数字图像处理、科学计算可视化
    王泳(1975—),男,山东济南人,研究员,博士,主要研究方向:复杂系统建模与优化、模式识别、数据挖掘。
  • 基金资助:
    国家自然科学基金资助项目(61731022)

Abstract:

With the continuous development of remote sensing technology, there has been a significant increase in the volume of remote sensing data. Providing accurate and timely remote sensing information recommendation services has become an urgent problem to solve. Existing remote sensing image recommendation algorithms mainly focus on user portrait, overlooking the influence of image content semantics on recommendation results. To address these issues, a remote sensing image recommendation method based on content interpretation was proposed. Firstly, an object extraction module based on YOLOv3 was used to extract objects from remote sensing images. Then, the location distribution vectors of key objects were integrated as image content information. Additionally, a multi-element user interest portrait was constructed and dynamically adjusted based on the user’s active search history to enhance the personality of recommendation results. Finally, the image content information was matched with the inherent attribute information of image and the user profile model to achieve accurate and intelligent recommendations of remote sensing data. Comparative experiments were conducted on real order data, to compare the proposed method with the newer recommendation method based solely on image attribute information. Experimental results show that the proposed method achieves a 70% improvement in the discrimination of positive and negative samples on the experimental data compared to the recommendation method considering user portrait. When using 10% training data with similar consumption time, the recommendation error rate decreases by 4.0 - 5.6 percentage points compared to the comparison method. When using 100% training data, the recommendation error rate decreases by 0.6 - 1.0 percentage points. These results validate the feasibility and effectiveness of the proposed method.

Key words: remote sensing image, recommendation method, content interpretation, deep learning, object detection

摘要:

随着遥感技术的不断发展,遥感数据呈现出海量增多的趋势,如何提供精准及时的遥感信息推荐服务成为亟待解决的问题。现有的遥感图像推荐算法大多针对用户画像进行设计,忽视了图像内容的语义信息对推荐结果的影响。针对上述问题,提出一种基于内容解译的遥感图像推荐方法。首先,通过基于YOLOv3的目标检测模块对遥感图像进行目标提取;然后,整合关键目标的位置分布向量作为图像内容信息;同时,构建多元素的用户兴趣画像,并根据用户主动搜索历史进行动态调整,以提高推荐结果的个性化程度;最后,将图像内容信息与图像自带属性信息、用户画像模型进行匹配,实现遥感数据的精准智能推荐。在真实订单数据上与较新的仅基于图像属性信息的推荐方法进行对比实验,实验结果表明,所提方法在实验数据上取得的正负样本区分度比考虑用户画像的推荐方法提高了70%;在耗时基本相近的情况下,在使用10%训练数据时,推荐错误率与对比方法相比下降了4.0~5.6个百分点,而在使用100%训练数据时推荐错误率则下降了0.6~1.0个百分点,验证了所提方法的可行性与有效性。

关键词: 遥感图像, 推荐方法, 内容解译, 深度学习, 目标检测

CLC Number: