Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (9): 2689-2695.DOI: 10.11772/j.issn.1001-9081.2018030574

Previous Articles     Next Articles

Medical image super-resolution algorithm based on deep residual generative adversarial network

GAO Yuan, LIU Zhi, QIN Pinle, WANG Lifang   

  1. College of Big Data, North University of China, Taiyuan Shanxi 030051, China
  • Received:2018-03-21 Revised:2018-05-04 Online:2018-09-10 Published:2018-09-06
  • Contact: 高媛

基于深度残差生成对抗网络的医学影像超分辨率算法

高媛, 刘志, 秦品乐, 王丽芳   

  1. 中北大学 大数据学院, 太原 030051
  • 通讯作者: 高媛
  • 作者简介:高媛(1972—),女,山西太原人,副教授,硕士,主要研究方向:图像处理、人工智能;刘志(1989—),男,安徽六安人,硕士研究生,主要研究方向:人工智能;秦品乐(1978—),男,山西长治人,副教授,博士,主要研究方向:机器视觉、大数据处理;王丽芳(1977—),女,山西长治人,副教授,博士,主要研究方向:机器视觉、大数据处理。

Abstract: Aiming at the ambiguity caused by the loss of details in the super-resolution reconstruction of medical images, a medical image super-resolution algorithm based on deep residual Generative Adversarial Network (GAN) was proposed. Firstly, a generative network and a discriminative network were designed in the method. High resolution images were generated by the generative network and the authenticities of the images were identified by the discriminative network. Secondly, a resize-convolution was used to eliminate checkerboard artifacts in the upsampling layer of the designed generative network and the batch-normalization layer of the standard residual block was removed to optimize the network. Also, the number of feature maps was further increased in the discriminative network and the network was deepened to improve the network performance. Finally, the network was continuously optimized according to the generative loss and the discriminative loss to guide the generation of high-quality images. The experimental results show that compared with bilinear interpolation, nearest-neighbor interpolation, bicubic interpolation, deeply-recursive convolutional network for image super-resolution and Super-Resolution using a Generative Adversarial Network (SRGAN), the improved algorithm can reconstruct the images with richer texture and more realistic vision. Compared with SRGAN, the proposed algorithm has an increase of 0.21 dB and 0.32% in Peak Signal-to-Noise Ratio (PSNR) and Structural SIMilarity (SSIM). It provides a deep residual generative adversarial network method for the theoretical research of medical image super-resolution, which is reliable and effective in practical applications.

Key words: super-resolution, Generative Adversarial Network (GAN), residual block, skip connection, resize-convolution

摘要: 针对医学影像超分辨率重建过程中细节丢失导致的模糊问题,提出了一种基于深度残差生成对抗网络(GAN)的医学影像超分辨率算法。首先,算法包括生成器网络和判别器网络,生成器网络生成高分辨率图像,判别器网络辨别图像真伪。然后,通过设计生成器网络的上采样采用缩放卷积来削弱棋盘效应,并去掉标准残差块中的批量规范化层以优化网络;进一步增加判别器网络中特征图数量以加深网络等方面提高网络性能。最后,用生成损失和判别损失来不断优化网络,指导生成高质量的图像。实验结果表明,对比双线性内插、最近邻插值、双三次插值法、基于深度递归神经网络、基于生成对抗网络的超分辨率方法(SRGAN),所提算法重建出了纹理更丰富、视觉更逼真的图像。相比SRGAN方法,所提算法在峰值信噪比(PSNR)和结构相似度(SSIM)上有0.21 dB和0.32%的提升。所提算法为医学影像超分辨率的理论研究提供了深度残差生成对抗网络的方法,在其实际应用中可靠、有效。

关键词: 超分辨率, 生成对抗网络, 残差块, 快捷连接, 缩放卷积

CLC Number: