Journal of Computer Applications ›› 2022, Vol. 42 ›› Issue (9): 2969-2974.DOI: 10.11772/j.issn.1001-9081.2021071197

• Frontier and comprehensive applications • Previous Articles    

Noctiluca scintillans red tide extraction method from UAV images based on deep learning

Jinghu LI1, Qianguo XING2,3(), Xiangyang ZHENG2, Lin LI2, Lili WANG1   

  1. 1.School Information and Electrical Engineering,Ludong University,Yantai Shandong 264025,China
    2.Yantai Institute of Coastal Zone Research,Chinese Academy of Sciences,Yantai Shandong 264003,China
    3.University of Chinese Academy of Sciences,Beijing 100049,China
  • Received:2021-07-09 Revised:2021-09-14 Accepted:2021-09-14 Online:2021-09-30 Published:2022-09-10
  • Contact: Qianguo XING
  • About author:LI Jinghu, born in 1995, M. S. candidate. His research interests include image processing, pattern recognition.
    ZHENG Xiangyang, born in 1985, Ph. D., research assistant. His research interests include ocean technology.
    LI Lin, born in 1980, M. S. Her research interests include automation, image processing.
    WANG Lili, born in 1978, Ph. D., professor. Her research interests include fiber grating sensing technology.
  • Supported by:
    National Natural Science Foundation of China(42076188);Strategic Priority Research Program of the Earth Science Big Data of Chinese Academy of Science(XDA19060203)

基于深度学习的无人机影像夜光藻赤潮提取方法

李敬虎1, 邢前国2,3(), 郑向阳2, 李琳2, 王丽丽1   

  1. 1.鲁东大学 信息与电气工程学院,山东 烟台 264025
    2.中国科学院 烟台海岸带研究所,山东 烟台 264003
    3.中国科学院大学,北京 100049
  • 通讯作者: 邢前国
  • 作者简介:李敬虎(1995—),男,山东德州人,硕士研究生,主要研究方向:图像处理、模式识别;
    郑向阳(1985—),男,山东日照人,助理研究员,博士,主要研究方向:海洋技术;
    李琳(1980—),女,河北廊坊人,硕士,主要研究方向:自动化、图像处理;
    王丽丽(1978—),女,山东烟台人,教授,博士,主要研究方向:光纤光栅传感技术。
  • 基金资助:
    国家自然科学基金资助项目(42076188);中国科学院地球科学大数据先导专项资助项目(XDA19060203)

Abstract:

Aiming at the problems of low accuracy and poor real-time performance of Noctiluca scintillans red tide extraction in the field of satellite remote sensing, a Noctiluca scintillans red tide extraction method from Unmanned Aerial Vehicle (UAV) images based on deep learning was proposed. Firstly, the high-resolution RGB (Red-Green-Blue) videos collected by UAV were used as the monitoring data, the backbone network was modified to VGG-16 (Visual Geometry Group-16) and the spatial dropout strategy was introduced on the basis of the original UNet++ network to enhance the feature extraction ability and prevent the overfitting respectively. Then, the VGG-16 network pre-trained by using ImageNet dataset was applied to perform transfer learning to increase the network convergence speed. Finally, in order to evaluate the performance of the proposed method, experiments were conducted on the self-built red tide dataset Redtide-DB. The Overall Accuracy (OA), F1 score, and Kappa of the Noctiluca scintillans red tide extraction of the proposed method are up to 94.63%, 0.955 2, 0.949 6 respectively, which are better than those of three traditional machine learning methods — K-Nearest Neighbors (KNN), Support Vector Machine (SVM) and Random Forest (RF) as well as three typical semantic segmentation networks (PSPNet (Pyramid Scene Parsing Network), SegNet and U-Net). Meanwhile, the red tide images of different shooting equipment and shooting environments were used to test the generalization ability of the proposed method, and the corresponding OA, F1 score and Kappa are 97.41%, 0.965 9 and 0.938 2, respectively, proving that the proposed method has a certain generalization ability. Experimental results show that the proposed method can realize the automatic accurate Noctiluca scintillans red tide extraction in complex environments, and provides a reference for Noctiluca scintillans red tide monitoring and research work.

Key words: Noctiluca scintillans, red tide, Unmanned Aerial Vehicle (UAV), deep learning, UNet++, video processing

摘要:

针对目前卫星遥感中夜光藻赤潮识别精度低、实时性差的问题,提出一种基于深度学习的无人机(UAV)影像夜光藻赤潮提取方法。首先,以UAV采集的高分辨率夜光藻赤潮RGB视频影像作为监测数据,在原有UNet++网络基础上,通过修改主干模型为VGG-16,并引入空间dropout策略,分别增强了特征提取能力并防止过拟合;然后,使用ImageNet数据集预先训练的VGG-16网络进行迁移学习,以提高网络收敛速度;最后,为评估所提方法的性能,在自建的赤潮数据集Redtide-DB上进行实验。所提方法的夜光藻赤潮提取总体精度(OA)为94.63%,F1评分为0.955 2,Kappa为0.949 6,优于K近邻(KNN)、支持向量机(SVM)和随机森林(RF)这3种机器学习方法及3种典型语义分割网络(PSPNet、 SegNet和U-Net)。在模型泛化能力测试中,所提方法对不同拍摄设备和拍摄环境的夜光藻赤潮影像表现出一定泛化能力,OA为97.41%,F1评分为0.965 9,Kappa为0.938 2。实验结果表明,所提方法可以实现夜光藻赤潮自动化、高精度的提取,可为夜光藻赤潮监测和研究工作提供参考。

关键词: 夜光藻, 赤潮, 无人机, 深度学习, UNet++, 视频处理

CLC Number: