Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (7): 2082-2091.DOI: 10.11772/j.issn.1001-9081.2020101539

Special Issue: 多媒体计算与计算机仿真

• Multimedia computing and computer simulation • Previous Articles     Next Articles

Medical image fusion with intuitionistic fuzzy set and intensity enhancement

ZHANG Linfa1, ZHANG Yufeng1, WANG Kun1, LI Zhiyao2   

  1. 1. School of Information Science and Engineering, Yunnan University, Kunming Yunnan 650500, China;
    2. Ultrasound Department, Third Affiliated Hospital of Kunming Medical University, Kunming Yunnan 650118, China
  • Received:2020-10-08 Revised:2021-01-12 Online:2021-07-10 Published:2021-01-27
  • Supported by:
    This work is partially supported by the National Natural Science Foundation of China (61561049, 81771928), the Construction Program of the Key Laboratory of High Altitude Medicine Electronic Information Intelligent Detection and Processing in Yunnan Province.

基于直觉模糊集和亮度增强的医学图像融合

张林发1, 张榆锋1, 王琨1, 李支尧2   

  1. 1. 云南大学 信息学院, 昆明 650500;
    2. 昆明医科大学第三附属医院 超声科, 昆明 650118
  • 通讯作者: 张榆锋
  • 作者简介:张林发(1997-),男,江西赣州人,硕士研究生,主要研究方向:医学图像融合;张榆锋(1965-),男,云南大理人,教授,博士,主要研究方向:信号检测与处理;王琨(1989-),男,云南楚雄人,博士研究生,主要研究方向:图像处理;李支尧(1967-),男,云南德宏人,副教授,硕士,主要研究方向:医学信号、图像处理。
  • 基金资助:
    国家自然科学基金资助项目(61561049,81771928);云南省高校高原医学电子信息智能检测处理重点实验室建设项目。

Abstract: Image fusion technology plays an important role in computer-aided diagnosis. Detail extraction and energy preservation are two key issues in image fusion, and the traditional fusion methods address them simultaneously by designing the fusion method. However, it tends to cause information loss or insufficient energy preservation. In view of this, a fusion method was proposed to solve the problems of detail extraction and energy preservation separately. The first part of the method aimed at detail extraction. Firstly, the Non-Subsampled Shearlet Transform (NSST) was used to divide the source image into low-frequency and high-frequency subbands. Then, an improved energy-based fusion rule was used to fuse the low-frequency subbands, and an strategy based on the intuitionistic fuzzy set theory was proposed for the fusion of the high-frequency subbands. Finally, the inverse NSST was employed to reconstruct the image. In the second part, an intensity enhancement method was proposed for energy preservation. The proposed method was verified on 43 groups of images and compared with other eight fusion methods such as Principal Component Analysis (PCA) and Local Laplacian Filtering (LLF). The fusion results on two different categories of medical image fusion (Magnetic Resonance Imaging (MRI) and Positron Emission computed Tomography (PET), MRI and Single-Photon Emission Computed Tomography (SPECT)) show that the proposed method can obtain more competitive performance on both visual quality and objective evaluation indicators including Mutual Information (MI), Spatial Frequency (SF), Q value, Average Gradient (AG), Entropy of Information (EI), and Standard Deviation (SD), and can improve the quality of medical image fusion.

Key words: medical image fusion, Non-Subsampled Shearlet Transform (NSST), energy-based fusion rule, intuitionistic fuzzy set theory, intensity enhancement

摘要: 图像融合技术在计算机辅助诊断中发挥了重要作用。传统融合方法通过设计融合策略来同时解决图像融合中的两个关键问题,即细节提取和能量保存,而这容易造成信息丢失或能量保存度不足。鉴于此,提出了一种对细节提取和能量保存问题进行分别解决的融合方法。该方法的第一部分旨在进行细节提取,首先,使用非下采样剪切波变换(NSST)将源图像分解成低频和高频子带;然后,通过改进的能量策略来融合低频子带,而对于高频子带的融合,提出了一种基于直觉模糊集理论的策略;最后,利用逆NSST来重构图像。而在第二部分里,为了达成能量保存,提出了一种亮度增强方法。在43组图像上验证该方法的性能,并把该方法和主成分分析(PCA)、局部拉普拉斯滤波器(LLF)等其他八种传统融合方法进行对比,两种医学图像融合类型(核磁共振图像(MRI)和正电子发射断层图像(PET)、核磁共振图像(MRI)和单光子发射计算机断层图像(SPECT))的实验结果表明,该方法在视觉质量和互信息(MI)、空间频率(SF)、Q值、平均梯度(AG)、信息熵(EI)和标准差(SD)等客观评价指标上均具有优势,能够提高医学图像融合质量。

关键词: 医学图像融合, 非下采样剪切波变换, 能量策略, 直觉模糊集理论, 亮度增强

CLC Number: