Rectal tumor segmentation method based on improved U-Net model

doi:10.11772/j.issn.1001-9081.2020030318

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (8): 2392-2397.DOI: 10.11772/j.issn.1001-9081.2020030318

• Virtual reality and multimedia computing • Previous Articles Next Articles

Rectal tumor segmentation method based on improved U-Net model

GAO Haijun¹, ZENG Xiangyin², PAN Dazhi^1,3, ZHENG Bochuan^1,3

1. School of Mathematics&Information, China West Normal University, Nanchong Sichuan 637009, China;
2. School of Computer Science, China West Normal University, Nanchong Sichuan 637009, China;
3. Institute of Computing Method and Application Software, China West Normal University, Nanchong Sichuan 637009, China

Received:2020-03-19 Revised:2020-05-02 Online:2020-08-10 Published:2020-05-19
Supported by:
This work is partially supported by the Sichuan Science and Technology Program (2019YFG0299), the Fundamental Research Funds of China West Normal University (19B045).

基于U-Net改进模型的直肠肿瘤分割方法

高海军¹, 曾祥银², 潘大志^1,3, 郑伯川^1,3

1. 西华师范大学数学与信息学院, 四川南充 637009;
2. 西华师范大学计算机学院, 四川南充 637009;
3. 西华师范大学计算方法与应用软件研究所, 四川南充 637009

通讯作者: 郑伯川(1974-),男,四川自贡人,教授,博士,CCF会员,主要研究方向:机器学习、深度学习、计算机视觉,zhengbc@vip.163.com
作者简介:高海军(1992-),男,四川通江人,硕士研究生,CCF会员,主要研究方向:计算机视觉、深度学习、智能计算;曾祥银(1994-),男,四川大竹人,硕士研究生,主要研究方向:机器学习、深度学习;潘大志(1974-),男,四川三台人,教授,博士,CCF会员,主要研究方向:智能计算。
基金资助:
四川省科技计划项目（2019YFG0299）；西华师范大学基本科研项目（19B045）

Abstract

Abstract: In the diagnosis of rectal cancer, if the rectal tumor area can be automatically and accurately segmented from Computed Tomography (CT) images, it will help doctors make a more accurate and rapid diagnosis. Aiming at the problem of rectal tumor segmentation, an automatic segmentation method of rectal tumor based on improved U-Net model was proposed. Firstly, the sub coding modules were embedded in the U-Net model encoder of different levels to improve the feature extraction ability of the model. Secondly, by comparing the optimization performances of different optimizers, the most suitable optimizer was determined to train the model. Finally, data augmentation was performed to the training set to make the model more fully trained, so as to improve the segmentation performance. Experimental results show that compared with U-Net, Y-Net and FocusNetAlpha network models, the segmentation region obtained by the improved model is closer to the real tumor region, and the segmentation performance of this model for small objects is more prominent; at the same time, the proposed model is superior to other three models on three evaluation indexes including precision, recall and Dice coefficient, which can effectively segment the rectal tumor area.

Key words: medical image segmentation, tumor segmentation, rectal tumor, Convolutional Neural Network (CNN), U-Net

摘要： 诊断直肠癌时，如果能够从CT图像中自动准确分割出直肠肿瘤区域，将有助于医生进行更准确和快速的诊断。针对直肠肿瘤分割问题，提出基于U-Net改进模型的直肠肿瘤自动分割方法。首先在U-Net模型的每级编码器中嵌入子编码模块提升模型特征提取能力；其次通过对比不同优化器的优化性能，获得最适合的优化器用于训练模型；最后对训练集进行数据扩充使模型得到更充分的训练，从而提高分割性能。与U-Net、Y-Net和FocusNetAlpha三种网络模型进行的对比实验表明：所提改进模型得到的分割区域与真实肿瘤区域更接近，对小目标的分割性能更突出，该模型的查准率、查全率和Dice系数三个评价指标都优于对比的模型，能有效分割直肠肿瘤区域。

关键词: 医学图像分割, 肿瘤分割, 直肠肿瘤, 卷积神经网络, U-Net

CLC Number:

GAO Haijun, ZENG Xiangyin, PAN Dazhi, ZHENG Bochuan. Rectal tumor segmentation method based on improved U-Net model[J]. Journal of Computer Applications, 2020, 40(8): 2392-2397.

高海军, 曾祥银, 潘大志, 郑伯川. 基于U-Net改进模型的直肠肿瘤分割方法[J]. 计算机应用, 2020, 40(8): 2392-2397.

References

[1] 第七届"泰迪杯"数据挖掘挑战赛——B题:直肠癌淋巴结转移的智能诊断[EB/OL].[2019-04-13].http://www.tipdm.org/u/cms/www/201903/15214944i2k3.pdf. (The Seventh "Teddy Cup" Data Mining Challenge Competition-intelligent diagnosis of lymph node metastasis in rectal cancer[EB/OL].[2020-01-10].http://www.tipdm.org/u/cms/www/201903/15214944i2k3.pdf.)
[2] SIEGEL R L, MILLER K D, SAUER A G, et al. Colorectal cancer statistics, 2020[J]. CA:A Cancer Journal for Clinicians, 2020, 70(3):145-164.
[3] KOLLIGS F T. Diagnostics and epidemiology of colorectal cancer[J]. Visceral Medicine, 2016, 32(3):158-164.
[4] RONNEBERGER O, FISCHER P, BROX T. U-Net:convolutional networks for biomedical image segmentation[C]//Proceedings of the 2015 International Conference on Medical Image Computing and Computer-Assisted Intervention, LNCS 9351. Cham:Springer, 2015:234-241.
[5] ZHOU Z, RAHMAN SIDDIQUEE M M, TAJBAKHSH N, et al. UNet++:a nested U-Net architecture for medical image segmentation[C]//Proceedings of the 2018 International Workshop on Deep Learning in Medical Image Analysis, 2018 International Workshop on Multimodal Learning for Clinical Decision, LNCS 11045. Cham:Springer, 2018:3-11.)
[6] ALOM M Z, YAKOPCIC C, TAHA T M, et al. Nuclei segmentation with Recurrent Residual convolutional neural networks based U-Net (R2U-Net)[C]//Proceedings of the 2018 IEEE National Aerospace and Electronics Conference. Piscataway:IEEE, 2018:228-233.
[7] OKTAY O, SCHLEMPER J, LE FOLGOC L, et al. Attention U-Net:Learning where to look for the pancreas[EB/OL].[2019-04-13].https://arxiv.org/pdf/1804.03999.pdf.
[8] AZAD R, ASADI-AGHBOLAGHI M, FATHY M, et al. Bi-directional ConvLSTM U-Net with densley connected convolutions[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshop. Piscataway:IEEE, 2019:406-415.
[9] KAUL C, MANANDHAR S, PEARS N. FocusNet:an attention-based fully convolutional network for medical image segmentation[C]//Proceedings of the IEEE 16th International Symposium on Biomedical Imaging. Piscataway:IEEE, 2019:455-458.
[10] HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2016:770-778.
[11] LI X, CHEN H, QI X, et al. H-DenseUNet:hybrid densely connected UNet for liver and tumor segmentation from CT volumes[J]. IEEE Transactions on Medical Imaging, 2018, 37(12):2663-2674.
[12] MOHAMMED A K, YILDIRIM-YAYILGAN S, FARUP I, et al. Y-Net:a deep convolutional neural network for polyp detection[C]//Proceedings of the 29th British Machine Vision Conference. Durham:BMVA Press, 2018:No.487.
[13] KAUL C, PEARS N, MANANDHAR S. Divided we stand:a novel residual group attention mechanism for medical image segmentation[EB/OL].[2020-03-17].https://arxiv.org/pdf/1912.02079.pdf.
[14] LITJENS G, KOOI T, BEJNORDI B E, et al. A survey on deep learning in medical image analysis[J]. Medical Image Analysis, 2017, 42:60-88.
[15] TAJBAKHSH N, JEYASEELAN L, LI Q, et al. Embracing imperfect datasets:a review of deep learning solutions for medical image segmentation[J]. Medical Image Analysis, 2020, 63:No.101693.
[16] TAGHANAKI S A, ABHISHEK K, COHEN J P, et al. Deep semantic segmentation of natural and medical images:a review[EB/OL].[2020-03-17].https://arxiv.org/pdf/1910.07655.pdf.
[17] IRVING B, CIFOR A, PAPIEŻ B W, et al. Automated colorectal tumour segmentation in DCE-MRI using supervoxel neighbourhood contrast characteristics[C]//Proceedings of the 2014 International Conference on Medical Image Computing and Computer-Assisted Intervention, LNCS 8673. Cham:Springer, 2014:609-616.
[18] VAN HEESWIJK M M, LAMBREGTS D M J, VAN GRIETHUYSEN J J M, et al. Automated and semiautomated segmentation of rectal tumor volumes on diffusion-weighted MRI:can it replace manual volumetry?[J]. International Journal of Radiation Oncology Biology Physics, 2016, 94(4):824-831.
[19] SOOMRO M H, GIUNTA G, LAGHI A, et al. Segmenting MR images by level-set algorithms for perspective colorectal cancer diagnosis[C]//Proceedings of the 2017 European Congress on Computational Methods in Applied Sciences and Engineering, LNCVB 27. Cham:Springer, 2017:396-406.
[20] 冉昭,简俊明,王蒙蒙,等. 基于全卷积神经网络的直肠癌肿瘤磁共振影像自动分割方法[J].北京生物医学工程, 2019, 38(5):465-471. (RAN Z, JIAN J M, WANG M M, et al. Automatic segmentation method based on full convolution neural network for rectal cancer tumors in magnetic resonance image[J]. Beijing Biomedical Engineering, 2019, 38(5):465-471.)
[21] 段杰,崔志明,沈艺,等. 一种改进FCN的肝脏肿瘤CT图像分割方法[J]. 图形学报, 2020, 41(1):100-107. (DUAN J, CUI Z M, SHEN Y, et al. A CT image segmentation method for liver tumor by an improved FCN[J]. Journal of Graphics, 2020, 41(1):100-107.)
[22] TREBESCHI S, VAN GRIETHUYSEN J J M, LAMBREGTS D M J, et al. Deep learning for fully-automated localization and segmentation of rectal cancer on multiparametric MR[J]. Scientific Reports,2017, 7(1):No.5301.
[23] WANG J, LU J, QIN G, et al. Technical note:a deep learning-based auto segmentation of rectal tumors in MR images[J]. Medical Physics, 2018, 45(6):2560-2564.
[24] LIN T Y, MAIRE M, BELONGIE S, et al. Microsoft COCO:common objects in context[C]//Proceedings of 2014 European Conference on Computer Vision, LNCS 8693. Cham:Springer, 2014:740-755.
[25] DUBEY S R, CHAKRABORTY S, ROY S K, et al. diffGrad:an optimization method for convolutional neural networks[J]. IEEE Transactions on Neural Networks and Learning Systems, 2019(Early Access):1-12.
[26] SUTSKEVER I, MARTENS J, DAHL G, et al. On the importance of initialization and momentum in deep learning[C]//Proceedings of the 30th International Conference on Machine Learning. New York:JMLR.org, 2013:1139-1147.
[27] ZEILER D Z. ADADELTA:an adaptive learning rate method[EB/OL].[2020-03-17].https://arxiv.org/pdf/1212.5701.pdf.
[28] DUCHI J, HAZAN E, SINGER Y. Adaptive subgradient methods for online learning and stochastic optimization[J]. The Journal of Machine Learning Research, 2011, 12:2121-2159.
[29] HINTON G, SRIVASTAVA N, SWERSKY K. Neural networks for machine learning:lecture 6a overview of mini-batch gradient descent[EB/OL].[2020-03-17].https://www.cs.toronto.edu/~hinton/coursera/lecture6/lec6.pdf.
[30] REDDI S J, KALE S, KUMAR S. On the convergence of Adam and beyond[EB/OL].[2020-03-17].https://arxiv.org/pdf/1904.09237.pdf.
[31] KINGMA D P, BA J L. Adam:a method for stochastic optimization[EB/OL].[2020-03-17].https://arxiv.org/pdf/1412.6980.pdf.

Rectal tumor segmentation method based on improved U-Net model

基于U-Net改进模型的直肠肿瘤分割方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	SONG Zhongshan, LIANG Jiarui, ZHENG Lu, LIU Zhenyu, TIE Jun. Remote sensing scene classification based on bidirectional gated scale feature fusion [J]. Journal of Computer Applications, 2021, 41(9): 2726-2735.
[2]	LI Kangkang, ZHANG Jing. Multi-layer encoding and decoding model for image captioning based on attention mechanism [J]. Journal of Computer Applications, 2021, 41(9): 2504-2509.
[3]	ZHANG Yongbin, CHANG Wenxin, SUN Lianshan, ZHANG Hang. Detection method of domains generated by dictionary-based domain generation algorithm [J]. Journal of Computer Applications, 2021, 41(9): 2609-2614.
[4]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[5]	XU Jianglang, LI Linyan, WAN Xinjun, HU Fuyuan. Indoor scene recognition method combined with object detection [J]. Journal of Computer Applications, 2021, 41(9): 2720-2725.
[6]	WANG Hebing, ZHANG Chunmei. Facial landmark detection based on ResNeXt with asymmetric convolution and squeeze excitation [J]. Journal of Computer Applications, 2021, 41(9): 2741-2747.
[7]	CAO Yuhong, XU Hai, LIU Sun'ao, WANG Zixiao, LI Hongliang. Review of deep learning-based medical image segmentation [J]. Journal of Computer Applications, 2021, 41(8): 2273-2287.
[8]	QIN Binbin, PENG Liangkang, LU Xiangming, QIAN Jiangbo. Research progress on driver distracted driving detection [J]. Journal of Computer Applications, 2021, 41(8): 2330-2337.
[9]	HUANG Chengcheng, DONG Xiaoxiao, LI Zhao. Deep pipeline 5×5 convolution method based on two-dimensional Winograd algorithm [J]. Journal of Computer Applications, 2021, 41(8): 2258-2264.
[10]	ZENG Xiangyin, ZHENG Bochuan, LIU Dan. Detection of left and right railway tracks based on deep convolutional neural network and clustering [J]. Journal of Computer Applications, 2021, 41(8): 2324-2329.
[11]	TAN Daoqiang, ZENG Cheng, QIAO Jinxia, ZHANG Jun. Shadow detection method based on hybrid attention model [J]. Journal of Computer Applications, 2021, 41(7): 2076-2081.
[12]	WU Guangli, LI Leiting, GUO Zhenzhou, WANG Chengxiang. Video summarization generation model based on improved bi-directional long short-term memory network [J]. Journal of Computer Applications, 2021, 41(7): 1908-1914.
[13]	GAO Qinquan, HUANG Bingcheng, LIU Wenzhe, TONG Tong. Bamboo strip surface defect detection method based on improved CenterNet [J]. Journal of Computer Applications, 2021, 41(7): 1933-1938.
[14]	YANG Su, OUYANG Zhi, DU Nisuo. Unsupervised parallel hash image retrieval based on correlation distance [J]. Journal of Computer Applications, 2021, 41(7): 1902-1907.
[15]	JIA Heming, LANG Chunbo, JIANG Zichao. Plant leaf disease recognition method based on lightweight convolutional neural network [J]. Journal of Computer Applications, 2021, 41(6): 1812-1819.