Journal of Computer Applications ›› 2024, Vol. 44 ›› Issue (2): 580-587.DOI: 10.11772/j.issn.1001-9081.2023020187

• Multimedia computing and computer simulation • Previous Articles    

Reconstruction algorithm for undersampled magnetic resonance images based on complex convolution dual-domain cascade network

Hualu QIU1, Suzhen LIN1(), Yanbo WANG1, Feng LIU2, Dawei LI3   

  1. 1.College of Data Science and Technology,North University of China,Taiyuan Shanxi 030051,China
    2.College of Information Technology and Electrical Engineering,The University of Queensland,Brisbane Queensland 4702,Australia
    3.School of Electrical and Control Engineering,North University of China,Taiyuan Shanxi 030051,China
  • Received:2023-02-27 Revised:2023-05-14 Accepted:2023-05-18 Online:2024-02-22 Published:2024-02-10
  • Contact: Suzhen LIN
  • About author:QIU Hualu, born in 2000, M. S. candidate. His research interests include image processing, Magnetic Resonance Imaging (MRI) reconstruction.
    WANG Yanbo, born in 1984, Ph. D., lecturer. His research interests include graph model, image processing.
    LIU Feng, born in 1968, Ph. D., professor. His research interests include MRI hardware design, electromagnetic analysis, cardiac electrical functional imaging.
    LI Dawei, born in 1980, Ph. D., associate professor. His research interests include pattern recognition, machine learning, image processing.
  • Supported by:
    Fundamental Research Program of Shanxi Province(20210302123025)

基于复卷积双域级联网络的欠采样磁共振图像重建算法

邱华禄1, 蔺素珍1(), 王彦博1, 刘峰2, 李大威3   

  1. 1.中北大学 计算机科学与技术学院, 太原 030051
    2.昆士兰大学 信息技术与电子工程学院, 澳大利亚 布里斯班 4702
    3.中北大学 电气与控制工程学院, 太原 030051
  • 通讯作者: 蔺素珍
  • 作者简介:邱华禄(2000—),男,福建三明人,硕士研究生,CCF会员,主要研究方向:图像处理、MRI重建
    王彦博(1984—),男,山西运城人,讲师,博士,CCF会员,主要研究方向:图模型、图像处理
    刘峰(1968—),男,澳大利亚人,教授,博士,主要研究方向:磁共振成像硬件设计、电磁分析、心脏电功能成像
    李大威(1980—),男,河北衡水人,副教授,博士,主要研究方向:模式识别、机器学习、图像处理。
  • 基金资助:
    山西省基础研究计划项目(20210302123025)

Abstract:

At present, most accelerated Magnetic Resonance Imaging (MRI) reconstruction algorithms reconstruct undersampled amplitude images and use real-value convolution for feature extraction, without considering that the MRI data itself is complex, which limits the feature extraction ability of MRI complex data. In order to improve the feature extraction ability of single slice MRI complex data, and thus reconstruct single slice MRI images with clearer details, a Complex Convolution Dual-Domain Cascade Network (ComConDuDoCNet) was proposed. The original undersampled MRI data was used as input, and Residual Feature Aggregation (RFA) blocks were used to alternately extract the dual domain features of the MRI data, ultimately reconstructing the Magnetic Resonance (MR) images with clear texture details. Complex convolution was used as a feature extractor for each RFA block. Different domains were cascaded through Fourier transform or inverse transform, and data consistency layer was added to achieve data fidelity. A large number of experiments were conducted on publicly available knee joint dataset. The comparison results with the Dual-task Dual-domain Network (DDNet) under three different sampling masks with a sampling rate of 20% show that: under the two-dimensional Gaussian sampling mask, the proposed algorithm decreases Normalized Root Mean Square Error (NRMSE) by 13.6%, increases Peak Signal-to-Noise Ratio (PSNR) by 4.3%, and increases Structural SIMilarity (SSIM) by 0.8%; under the Poisson sampling mask, the proposed algorithm decreases NRMSE by 11.0%, increases PSNR by 3.5%, and increases SSIM by 0.1%; under the radial sampling mask, the proposed algorithm decreases NRMSE by 12.3%, increases PSNR by 3.8%, and increases SSIM by 0.2%. The experimental results show that ComConDuDoCNet, combined with complex convolution and dual-domain learning, can reconstruct MR images with clearer details and more realistic visual effects.

Key words: image reconstruction, undersampled image, complex convolution, dual-domain learning, deep learning

摘要:

目前,大多数加速磁共振成像(MRI)的重建算法通过重建欠采样幅值图像,利用实值卷积进行特征提取,没有考虑MRI数据本身是复数,从而限制了对MRI复值数据的特征提取能力。为了提高对单个切片MRI复值数据特征提取能力,从而重建出细节更为清晰的单切片磁共振(MR)图像,提出复卷积双域级联网络(ComConDuDoCNet)。将原始欠采样MRI数据作为输入,使用残差特征聚合(RFA)块交替提取MRI数据的双域特征,最终重建出具有清晰纹理细节的MR图像。每个RFA块使用复卷积作为特征提取器。不同域间通过傅里叶变换或逆变换进行级联,并加入数据一致性层实现数据保真。在公开的膝关节数据集上进行实验,与双任务双域网络(DDNet)在采样率为20%的三种不同采样掩码下的对比结果表明,在二维高斯采样掩码下,所提算法的标准均方根误差(NRMSE)下降了13.6%,峰值信噪比(PSNR)提升了4.3%,结构相似性指数(SSIM)提升了0.8%;在泊松采样掩码下,所提算法的NRMSE下降了11.0%,PSNR提升了3.5%,SSIM提升了0.1%;在径向采样掩码下,所提算法的NRMSE下降了12.3%,PSNR提升了3.8%,SSIM提升了0.2%。实验结果表明,ComConDuDoCNet结合复卷积与双域学习,能够重建出细节更加清晰、视觉效果更加逼真的MR图像。

关键词: 图像重建, 欠采样图像, 复卷积, 双域学习, 深度学习

CLC Number: