《计算机应用》唯一官方网站 ›› 2022, Vol. 42 ›› Issue (6): 1965-1971.DOI: 10.11772/j.issn.1001-9081.2021060890

• 多媒体计算与计算机仿真 • 上一篇    

无锚点的遥感图像任意角度密集目标检测方法

杨治佩1,2,3, 丁胜1,2, 张莉3(), 张新宇1,2   

  1. 1.武汉科技大学 计算机科学与技术学院,武汉 430065
    2.智能信息处理与实时工业系统湖北省重点实验室(武汉科技大学),武汉 430065
    3.武汉晴川学院 计算机学院,武汉 430204
  • 收稿日期:2021-06-01 修回日期:2021-08-12 接受日期:2021-08-18 发布日期:2022-06-22 出版日期:2022-06-10
  • 通讯作者: 张莉
  • 作者简介:杨治佩(1996—),男,甘肃庆阳人,硕士研究生,主要研究方向:计算机视觉、深度学习
    丁胜(1975—),男,湖北武汉人,副教授,博士,主要研究方向:计算机视觉
    张新宇(1996—),男,河南焦作人,硕士研究生,主要研究方向:计算机视觉、深度学习。
  • 基金资助:
    湖北省自然科学基金资助项目(2018CFB195)

Anchor-free remote sensing image detection method for dense objects with rotation

Zhipei YANG1,2,3, Sheng DING1,2, Li ZHANG3(), Xinyu ZHANG1,2   

  1. 1.School of Computer Science and Technology,Wuhan University of Science and Technology,Wuhan Hubei 430065,China
    2.Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System (Wuhan University of Science and Technology),Wuhan Hubei 430065,China
    3.College of Computer,Wuhan Qingchuan University,Wuhan Hubei,430204,China
  • Received:2021-06-01 Revised:2021-08-12 Accepted:2021-08-18 Online:2022-06-22 Published:2022-06-10
  • Contact: Li ZHANG
  • About author:YANG Zhipei,born in 1996,M. S. candidate,His research interests include computer vision,deep learning.
    DING Sheng,born in 1975,Ph. D.,associate professor. His research interests include computer vision
    ZHANG Xinyu,born in 1996,M. S. candidate. His research interests include computer vision,deep learning.
  • Supported by:
    Natural Science Foundation of Hubei Province(2018CFB195)

摘要:

针对基于深度学习的遥感图像目标检测方法密集目标漏检率高、分类不准确的问题,建立了一种基于深度学习的无锚点的遥感图像任意角度的密集目标检测方法。首先采用CenterNet作为基线模型,经过主干网络提取特征,并改造原有检测器结构,即加入角度回归分支进行目标角度回归;然后提出一种基于非对称卷积的特征增强模块,并将主干网络提取到的特征图输入特征增强模块,从而增强目标的旋转不变性特征,消除由于目标的旋转、翻转带来的影响,进一步提升目标中心点、尺寸信息的回归精度。采用HourGlass-101作为主干网络时,该方法在DOTA数据集上的平均精度均值(mAP)比旋转区域候选网络(RRPN)提升了7.80个百分点,每秒处理帧数(FPS)提升了7.5;在自建数据集Ship3上,该方法的mAP比RRPN提升了8.68个百分点,FPS提升了6.5。结果表明,所提方法能获得检测精度和速度的平衡。

关键词: 深度学习, 遥感图像, 目标检测, 非对称卷积, 无锚点目标检测

Abstract:

Aiming at the problems of high missed rate and inaccurate classification of dense objects in remote sensing image detection methods based on deep learning, an anchor-free deep learning-based detection method for dense objects with rotation was established. Firstly, CenterNet was used as the baseline network, features were extracted through the backbone network, and the original detector structure was improved, which means an angle regression branch was added to perform object angle regression. Then, a feature enhancement module based on asymmetric convolution was proposed, and the feature map extracted by the backbone network was put into the feature enhancement module to enhance the rotation invariant feature of the object, reduce the influence caused by the rotation and turnover of the object, and improve the regression precision of the center point and size information of the object. When using HourGlass-101 as the backbone network, compared with Rotation Region Proposal Network (RRPN), the proposed method achieved a 7.80 percentage point improvement in Mean Average Precision (mAP) and 7.50 improvement in Frames Per Second (FPS) on DOTA dataset. On the self-built dataset Ship3, the proposed method achieved a 8.68 percentage point improvement in mAP and 6.5 improvement vin FPS. The results show that the proposed method can obtain a balance between detection precision and speed.

Key words: deep learning, remote sensing image, object detection, asymmetric convolution, anchor-free object detection

中图分类号: