《计算机应用》唯一官方网站 ›› 2022, Vol. 42 ›› Issue (8): 2586-2592.DOI: 10.11772/j.issn.1001-9081.2021061093

• 多媒体计算与计算机仿真 • 上一篇    下一篇

基于轻量密集神经网络的医学图像超分辨率重建算法

王一宁1(), 赵青杉1, 秦品乐2, 胡玉兰1, 宗春梅1   

  1. 1.忻州师范学院 计算机系,山西 忻州 034000
    2.中北大学 大数据学院,太原 030051
  • 收稿日期:2021-06-29 修回日期:2021-12-29 接受日期:2022-01-14 发布日期:2022-01-25 出版日期:2022-08-10
  • 通讯作者: 王一宁
  • 作者简介:王一宁(1992—),女,山西长治人,助教,硕士,主要研究方向:深度学习、机器视觉、数字图像处理;
    赵青杉(1972—),男,山西忻州人,教授,硕士,主要研究方向:数据挖掘、演化计算;
    秦品乐(1978—),男,山西长治人,教授,博士,主要研究方向:大数据、机器视觉、三维重建;
    胡玉兰(1985—),女,山西五台人,讲师,硕士,主要研究方向:智能计算、数据挖掘;
    宗春梅(1977—),女,山西忻州人,讲师,硕士,主要研究方向:人工智能、数据挖掘。
  • 基金资助:
    山西省自然科学基金资助项目(2015011045);山西省重点实验室开放课题(2016002);协同创新中心项目(WTSXTCX-01)

Super-resolution reconstruction algorithm of medical image based on lightweight dense neural network

Yining WANG1(), Qingshan ZHAO1, Pinle QIN2, Yulan HU1, Chunmei ZONG1   

  1. 1.Department of Computer Science,Xinzhou Teachers University,Xinzhou Shanxi 034000,China
    2.School of Data Science and Technology,North University of China,Taiyuan Shanxi 030051,China
  • Received:2021-06-29 Revised:2021-12-29 Accepted:2022-01-14 Online:2022-01-25 Published:2022-08-10
  • Contact: Yining WANG
  • About author:WANG Yining, born in 1992, M. S., teaching assistant. Her research interests include deep learning, machine vision, digital image processing.
    ZHAO Qingshan, born in 1972, M. S., professor. His research interests include data mining, evolutionary computation.
    QIN Pinle, born in 1978, Ph. D., professor. His research interests include big data, machine vision, three-dimensional reconstruction.
    HU Yulan, born in 1985, M. S., lecturer. Her research interests include intelligent computing, data mining.
    ZONG Chunmei, born in 1977, M. S., lecturer. Her research interests include artificial intelligence, data mining.
  • Supported by:
    Shanxi Natural Science Foundation(2015011045);Shanxi Province Key Laboratory Open Project(2016002);Collaborative Innovation Center Project(WTSXTCX-01)

摘要:

医学图像的清晰与否直接影响临床诊断。由于成像设备与环境因素的限制,往往不能直接获得高分辨率的图像,且大多数智能终端的硬件并不适合运行大规模深度神经网络模型,因此提出一种拥有较少的层和参数的轻量密集神经网络模型。首先,网络中使用密集块和跳层结构进行全局和局部图像特征学习,并将更多特征信息传入激活函数,从而使网络中浅层低级的图像特征更容易传播到高层,由此提高医学图像超分辨率重建的质量;然后,采用分阶段方法训练网络,并以双任务损失加强网络学习中的监督指导,从而解决高倍图像超分辨率重建导致的网络训练难度增加的问题。实验结果表明,与最近邻(NN)插值、双线性插值、双立方插值、基于卷积神经网络(CNN)的算法以及基于残差神经网络的算法相比,所提模型能更好地重建出医学图像的纹理细节,获得更高的峰值信噪比(PSNR)和结构相似性(SSIM),在训练速度和硬件消耗方面均取得了良好的效果,具有较高的实用价值。

关键词: 超分辨率, 深度学习, 密集块, 反卷积, 双任务损失

Abstract:

The clarity of medical images directly affects the clinical diagnosis. Due to the limitations of imaging equipment and environmental factors, it is often impossible to directly obtain high-resolution images, and the hardware of most smart terminals is not suitable for running large-scale deep neural network models. Therefore, a lightweight dense neural network model with fewer layers and parameters was proposed. First of all, dense block and skip layer structure were used in the network for global and local image feature learning, and more feature information was introduced into the activation function, so that the shallow low-level image features in the network were able to be propagated to the high-layers more easily, thereby improving the super-resolution reconstruction quality of medical images. Then, the multi-stage method was adopted to train the network and the dual-task loss was used to strengthen the supervision and guidance in network learning, which solved the problem of difficulty increase in network training caused by highly magnified image super-resolution reconstruction. Compared with Nearest Neighbor (NN), bilinear interpolation, bicubic interpolation, Convolutional Neural Network (CNN) based algorithm and the residual neural network based algorithm, the proposed model is of high practical value on better reconstructing the texture details of medical images, achieving higher Peak Signal-to-Noise Ratio (PSNR) and Structural SIMilarity (SSIM), as well as achieving good result in both training speed and hardware consumption.

Key words: super-resolution, deep learning, dense block, deconvolution, dual-task loss

中图分类号: