Rainfall cloud segmentation method in Tibet based on DeepLab v3

doi:10.11772/j.issn.1001-9081.2019122131

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (9): 2781-2788.DOI: 10.11772/j.issn.1001-9081.2019122131

• Frontier & interdisciplinary applications • Previous Articles

Rainfall cloud segmentation method in Tibet based on DeepLab v3

ZHANG Yonghong^1,2, LIU Hao², TIAN Wei³, WANG Jiangeng⁴

1. Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Nanjing University of Information Science and Technology, Nanjing Jiangsu 210044, China;
2. School of Automation, Nanjing University of Information Science and Technology, Nanjing Jiangsu 210044, China;
3. School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing Jiangsu 210044, China;
4. School of Atmospheric Physics, Nanjing University of Information Science and Technology, Nanjing Jiangsu 210044, China

Received:2019-12-19 Revised:2020-02-27 Online:2020-09-10 Published:2020-05-13
Supported by:
This work is partially supported by the National Natural Science Foundation of China (41875027).

基于DeepLab v3的西藏地区降雨云团分割方法

张永宏^1,2, 刘昊², 田伟³, 王剑庚⁴

1. 南京信息工程大学气象灾害预报预警与评估协同创新中心, 南京 210044;
2. 南京信息工程大学自动化学院, 南京 210044;
3. 南京信息工程大学计算机与软件学院, 南京 210044;
4. 南京信息工程大学大气物理学院, 南京 210044

通讯作者: 刘昊
作者简介:张永宏(1974-),男,山东临沂人,教授,博士,主要研究方向:大气遥感检测、图像处理分析;刘昊(1996-),男,江苏镇江人,硕士研究生,主要研究方向:遥感图像处理、大数据分析;田伟(1980-),男,江苏涟水人,副教授,博士,主要研究方向:计算机软件、人工智能降雨估计、大数据处理;王剑庚(1982-),男,甘肃定西人,副教授,博士,主要研究方向:积雪遥感、"地-气"相互作用。
基金资助:
国家自然科学基金资助项目（41875027）。

Abstract

Abstract: Concerning the problem that the numerical prediction method is complex in modeling, the radar echo extrapolation method is easy to generate cumulative error and the model parameters are difficult to set in plateau area, a method for segmenting rainfall clouds in Tibet was proposed based on the improved DeepLab v3. Firstly, the convolutional layers and residual modules in the coding network were used for down-sampling. Then, the multi-scale sampling module was constructed by using the dilated convolution, and the attention mechanism module was added to extract deep high-dimensional features. Finally, the deonvolutional layers in the decoding network were used to restore the feature map resolution. The proposed method was compared with Google semantic segmentation network DeepLab v3 and other models on the validation set. The experimental results show that the method has better segmentation performance and generalization ability, has the rainfall cloud segmented more accurately, and the Mean intersection over union (Miou) reached 0.95, which is 15.54 percentage points higher than that of the original DeepLab v3. On small targets and unbalanced datasets, rainfall clouds can be segmented more accurately by this method, so that the proposed method can provide a reference for the rain cloud monitoring and early warning.

Key words: rainfall cloud segmentation, multi-scale sampling, attention mechanism, DeepLab v3, remote sensing image processing

摘要： 针对高原地区数值预测法建模复杂，雷达回波外推法易产生累积误差且模型参数难以设置的问题，提出了一种基于改进DeepLab v3网络模型的西藏地区降雨云团的分割方法。首先，通过编码网络中的卷积层和残差模块进行下采样；然后，利用空洞卷积构建多尺度采样模块，并且加入注意力机制模块提取深层高维特征；最后，通过解码网络利用反卷积恢复特征图分辨率。将所提方法与谷歌语义分割网络DeepLab v3等模型在验证集上进行比较，实验结果表明所提方法具有更好的分割性能与泛化能力，其降雨云团分割结果更为准确，平均交并比（Miou）达到0.95，与原始DeepLab v3相比提高了15.54个百分点。在小目标上和非平衡数据集上，该方法可以更准确地分割出降雨云团，为降雨云团监测预警提供参考。

关键词: 降雨云团分割, 多尺度采样, 注意力机制, DeepLab v3, 遥感图像处理

CLC Number:

TP183
TP751

ZHANG Yonghong, LIU Hao, TIAN Wei, WANG Jiangeng. Rainfall cloud segmentation method in Tibet based on DeepLab v3[J]. Journal of Computer Applications, 2020, 40(9): 2781-2788.

张永宏, 刘昊, 田伟, 王剑庚. 基于DeepLab v3的西藏地区降雨云团分割方法[J]. 计算机应用, 2020, 40(9): 2781-2788.

References

[1] 陈森发,张文红,张建坤,等. 短期降雨预测的随机微分模型[J]. 系统工程学报, 2004, 19(3):239-243.(CHEN S F, ZHANG W H, ZHANG J K, et al. Short-term rainfall prediction of stochastic differential models[J]. Journal of Systems Engineering, 2004, 19(3):239-243.)
[2] 赵欣,邹良超,倪林. 基于有序聚类的模糊加权马尔可夫模型在降雨预测中的应用[J]. 江西农业学报, 2009, 21(2):110-113. (ZHAO X, ZOU L C, NI L. Application of fuzzy weighted Markov model based on ordered clustering to rainfall prediction[J]. Acta Agriculture Jiangxi, 2009, 21(2):110-113.)
[3] 朱平,李生辰,肖建设,等. 天气雷达回波外推技术应用研究[J]. 气象, 2008, 34(7):3-9.(ZHU P, LI S C, XIAO J S,et al. Study on extrapolation technique of weather radar echo and its application to nowcasting[J]. Meteorological Monthly, 2008, 34(7):3-9.)
[4] 卢乃锰,方翔,刘健,等. 气象卫星的云观测[J]. 气象, 2017, 43(3):257-267.(LU N M, FANG X, LIU J, et al. Understanding clouds by meteorological satellites[J]. Meteorological Monthly, 2017, 43(3):257-267.)
[5] 李森,刘健文,刘玉玲. 基于FY2D静止卫星云图的强对流云团识别[J]. 气象水文海洋仪器, 2010, 27(2):72-78.(LI S, LIU J W, LIU Y L. Detection of strong convective clouds based on FY2D geostationary satellite[J]. Meteorological, Hydrological and Marine Instruments, 2010, 27(2):72-78.)
[6] 赵文化,单海滨. 基于红外窗区与水汽通道对流云团识别方法研究[J]. 气象, 2018, 44(6):814-824.(ZHAO W H, SHAN H B. Study of convective cloud identification based on H₂O/IRW observation[J]. Meteorological Monthly, 2018, 44(6):814-824.)
[7] 周晓丽,杨昌军. 基于FY-2D的新疆区域强对流云识别[J]. 沙漠与绿洲气象, 2017, 11(2):82-87.(ZHOU X L, YANG C J. Identification of strong convective cloud in Xinjiang using FY-2D stationary meteorological satellite data[J]. Desert and Oasis Meteorology, 2017, 11(2):82-87.)
[8] 吴晓京,朱小祥,毛紫阳,等. 风云二号气象卫星红外观测在云团降水监测中的应用[J]. 海洋气象学报, 2019, 39(3):1-10.(WU X J, ZHU X X, MAO Z Y, et al. Algorithm design of convective precipitation monitoring and early warning service using FY-2 infrared data[J]. Journal of Marine Meteorology, 2019, 39(3):1-10.)
[9] WOLF D E, HALL D J, ENDLICH R M. Experiments in automatic cloud tracking using SMS-GOES data[J]. Journal of Applied Meteorology, 1977, 16(11):1219-1230.
[10] MAHOVIĆ N S, ZEINER B. Application of meteosat SEVIRI channel difference 0.6μm-1.6μm in convective cells detection[J]. Atmospheric Research, 2009, 93(1/2/3):270-276.
[11] 许玥,冯梦如,皮家甜,等. 基于深度学习模型的遥感图像分割方法[J]. 计算机应用, 2019, 39(10):2905-2914.(XU Y, FENG M R, PI J T, et al. Remote sensing image segmentation method based on deep learning model[J]. Journal of Computer Applications, 2019, 39(10):2905-2914.)
[12] 周明非,汪西莉. 结合纹理去除的遥感图像分割[J]. 计算机应用, 2017, 37(11):3162-3167.(ZHOU M F, WANG X L. Remote sensing image segmentation with texture removal[J]. Journal of Computer Applications, 2017, 37(11):3162-3167.)
[13] 夏勇,赵荣椿. 基于形态学多重分形的遥感图像多尺度分割[J]. 计算机应用, 2006, 26(9):2071-2073.(XIA Y, ZHAO R C. Multiscale segmentation of remote sensing images based on multifractal exponents[J]. Journal of Computer Applications, 2006, 26(9):2071-2073.)
[14] 陈天华,郑司群,于峻川. 采用改进DeepLab网络的遥感图像分割[J]. 测控技术, 2018, 37(11):34-39.(CHEN T H, ZHENG S Q, YU J C. Remote sensing image segmentation based on improved DeepLab network[J]. Measurement and Control Technology, 2018, 37(11):34-39.)
[15] 宋小娜,芮挺,王新晴. 结合语义边界信息的道路环境语义分割方法[J]. 计算机应用, 2019, 39(9):2505-2510.(SONG X N, RUI T, WANG X Q. Semantic segmentation method of road environment combined semantic boundary information[J]. Journal of Computer Applications, 2019, 39(9):2505-2510.)
[16] 吴宗胜,傅卫平,韩改宁. 基于深度卷积神经网络的道路场景理解[J]. 计算机工程与应用, 2017, 53(22):8-15.(WU Z S, FU W P, HAN G N. Road scene understanding based on deep convolutional neural network[J]. Computer Engineering and Applications, 2017, 53(22):8-15.)
[17] WANG P, CHEN P, YUAN Y, et al. Understanding convolution for semantic segmentation[C]//Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision. Piscataway:IEEE, 2018:1451-1460.
[18] 郑菲,孟朝晖,郭闯世. 基于反卷积特征学习的图像语义分割算法[J]. 计算机系统应用, 2019, 28(1):149-157.(ZHENG F, MENG Z H, GUO C S. Image semantic segmentation algorithm based on deconvolution feature learning[J]. Computer System and Applications, 2019, 28(1):149-157.)

Rainfall cloud segmentation method in Tibet based on DeepLab v3

基于DeepLab v3的西藏地区降雨云团分割方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	LI Kangkang, ZHANG Jing. Multi-layer encoding and decoding model for image captioning based on attention mechanism [J]. Journal of Computer Applications, 2021, 41(9): 2504-2509.
[2]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[3]	DAI Yurou, YANG Qing, ZHANG Fengli, ZHOU Fan. Trajectory prediction model of social network users based on self-supervised learning [J]. Journal of Computer Applications, 2021, 41(9): 2545-2551.
[4]	LIU Yaxuan, ZHONG Yong. Joint extraction method of entities and relations based on subject attention [J]. Journal of Computer Applications, 2021, 41(9): 2517-2522.
[5]	DANG Weichao, LI Tao, BAI Shangwang, GAO Gaimei, LIU Chunxia. Real-time remaining life prediction method of Web software system based on self-attention-long short-term memory network [J]. Journal of Computer Applications, 2021, 41(8): 2346-2351.
[6]	GAO Qinquan, HUANG Bingcheng, LIU Wenzhe, TONG Tong. Bamboo strip surface defect detection method based on improved CenterNet [J]. Journal of Computer Applications, 2021, 41(7): 1933-1938.
[7]	LI Chao, LAN Hai, WEI Xian. Attention-based object detection with millimeter wave radar-lidar fusion [J]. Journal of Computer Applications, 2021, 41(7): 2137-2144.
[8]	LI Yangzhi, YUAN Jiazheng, LIU Hongzhe. Human skeleton-based action recognition algorithm based on spatiotemporal attention graph convolutional network model [J]. Journal of Computer Applications, 2021, 41(7): 1915-1921.
[9]	ZHANG Yang, JIANG Minghu. Authorship identification of text based on attention mechanism [J]. Journal of Computer Applications, 2021, 41(7): 1897-1901.
[10]	WU Wei, LI Zeping, YANG Huawei, LIN Chuan, WANG Zhongde. Deep attention video popularity prediction model fusing content features and temporal information [J]. Journal of Computer Applications, 2021, 41(7): 1878-1884.
[11]	LI Xiang, WANG Weibing, SHANG Xueda. Application of Transformer optimized by pointer generator network and coverage loss in field of abstractive text summarization [J]. Journal of Computer Applications, 2021, 41(6): 1647-1651.
[12]	SHEN Xuewen, WANG Xiaodong, YAO Yu. Spatial frequency divided attention network for ultrasound image segmentation [J]. Journal of Computer Applications, 2021, 41(6): 1828-1835.
[13]	LIU Shize, ZHU Yida, CHEN Runze, LUO Haiyong, ZHAO Fang, SUN Yi, WANG Baohui. Traffic mode recognition algorithm based on residual temporal attention neural network [J]. Journal of Computer Applications, 2021, 41(6): 1557-1565.
[14]	HU Die, FENG Ziliang. Light-weight road image semantic segmentation algorithm based on deep learning [J]. Journal of Computer Applications, 2021, 41(5): 1326-1331.
[15]	LAI Xuemei, TANG Hong, CHEN Hongyu, LI Shanshan. Multimodal sentiment analysis based on feature fusion of attention mechanism-bidirectional gated recurrent unit [J]. Journal of Computer Applications, 2021, 41(5): 1268-1274.