Non-rigid multi-modal medical image registration based on multi-channel sparse coding

doi:10.11772/j.issn.1001-9081.2017102392

Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (4): 1127-1133.DOI: 10.11772/j.issn.1001-9081.2017102392

Previous Articles Next Articles

Non-rigid multi-modal medical image registration based on multi-channel sparse coding

WANG Lifang, CHENG Xi, QIN Pinle, GAO Yuan

School of Data Science and Technology, North University of China, Taiyuan Shanxi 030051, China

Received:2017-10-10 Revised:2017-11-18 Online:2018-04-09 Published:2018-04-10
Supported by:
This work is partially supported by the Natural Science Foundation of Shanxi Province (2015011045).

基于多通道稀疏编码的非刚性多模态医学图像配准

王丽芳, 成茜, 秦品乐, 高媛

中北大学大数据学院, 太原 030051

通讯作者: 王丽芳
作者简介:王丽芳(1977-),女,山西长治人,副教授,博士,CCF会员,主要研究方向:大数据处理、医学图像处理、机器视觉;成茜(1993-),女,山西晋中人,硕士研究生,主要研究方向:医学图像配准、机器学习;秦品乐(1978-),男,山西长治人,副教授,博士,主要研究方向:医学影像大数据存储与分析、机器视觉、机器学习;高媛(1972-),女,山西太原人,副教授,硕士,主要研究方向:大数据处理、医学图像处理、三维重建。
基金资助:
山西省自然科学基金资助项目（2015011045）。

Abstract

Abstract: Sparse coding similarity measure has good robustness to gray-scale offset field in non-rigid medical image registration, but it is only suitable for single-modal medical image registration. A non-rigid multi-modal medical image registration method based on multi-channel sparse coding was proposed to solve this problem. In this method, the multi-modal registration was regarded as a multi-channel registration, with each modal running in a separate channel. At first, the two registered images were synthesized and regularized separately, and then they were divided into channels and image blocks. The K-means-based Singular Value Decomposition (K-SVD) algorithm was used to train the image blocks in each channel to get the analytical dictionary and sparse coefficients, and each channel was weightedy summated. The multilayer P-spline free transform model was used to simulate the non-rigid geometric deformation, and the gradient descent method was used to optimize the objective function. The experimental results show that compared with multi-modal similarity measure such as local mutual information, Multi-Channel Local Variance and Residual Complexity (MCLVRC), Multi-Channel Sparse-Induced Similarity Measure (MCSISM) and Multi-Channel Rank Induced Similarity Measure (MCRISM), the root mean square error of the proposed method is decreased by 30.86%, 22.24%, 26.84% and 16.49% respectively. The proposed method can not only effectively overcome the influence of gray-scale offset field on registration in multi-modal medical image registration, but also improve the accuracy and robustness of registration.

Key words: multi-modal image registration, multi-channel, sparse coding, multilayer P-spline, gradient descent method

摘要： 针对稀疏编码相似性测度在非刚性医学图像配准中对灰度偏移场具有较好的鲁棒性，但只适用于单模态医学图像配准的问题，提出基于多通道稀疏编码的非刚性多模态医学图像配准方法。该方法将多模态配准问题视为一个多通道配准问题来解决，每个模态在一个单独的通道下运行；首先对待配准的两幅图像分别进行合成和正则化，然后划分通道和图像块，使用K奇异值分解（K-SVD）算法训练每个通道中的图像块得到分析字典和稀疏系数，并对每个通道进行加权求和，采用多层P样条自由变换模型来模拟非刚性几何形变，结合梯度下降法优化目标函数。实验结果表明，与局部互信息、多通道局部方差和残差复杂性（MCLVRC）、多通道稀疏诱导的相似性测度（MCSISM）、多通道Rank Induced相似性测度（MCRISM）多模态相似性测度相比，均方根误差分别下降了30.86%、22.24%、26.84%和16.49%。所提方法能够有效克服多模态医学图像配准中灰度偏移场对配准的影响，提高配准的精度和鲁棒性。

关键词: 多模态图像配准, 多通道, 稀疏编码, 多层P样条, 梯度下降法

CLC Number:

TP391.41

WANG Lifang, CHENG Xi, QIN Pinle, GAO Yuan. Non-rigid multi-modal medical image registration based on multi-channel sparse coding[J]. Journal of Computer Applications, 2018, 38(4): 1127-1133.

王丽芳, 成茜, 秦品乐, 高媛. 基于多通道稀疏编码的非刚性多模态医学图像配准[J]. 计算机应用, 2018, 38(4): 1127-1133.

References

[1] FRANCISCO P M, MANUEL J O, TAVARES R S. Medical image registration:a review[J]. Computer Methods in Biomechanics and Biomedical Engineering, 2014, 17(2):73-93.
[2] KWON D, ZENG K, BILELLO M, et al. Estimating patient specific templates for pre-operative and follow-up brain tumor registration[C]//MICCAI 2015:Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention, LNCS 9350. Berlin:Springer, 2015:222-229.
[3] BHATTACHARYA M, ARPITA D. Multimodality medical image registration and fusion techniques using mutual information and genetic algorithm-based approaches[J]. Software Tools and Algorithms for Biological Systems, 2011, 696(3):441-449.
[4] 王观英, 许新征, 丁世飞. 基于3D-PCNN和互信息的3D-3D医学图像配准方法[J]. 计算机应用, 2017, 37(增刊1):215-219.(WANG G Y, XU X Z, DING S F. 3D-3D medical image registration method based on 3D-PCNN and mutual information[J]. Journal of Computer Applications, 2017, 37(S1):215-219.)
[5] MYRONENKO A, SONG X. Intensity-based image registration by minimization of residual complexity[J]. IEEE Transactions on Medical Imaging, 2010, 29(11):1882-1891.
[6] 卢振泰, 张娟, 冯前进, 等.基于局部方差与残差复杂性的医学图像配准[J]. 计算机学报, 2015, 38(12):2400-2411.(LU Z T, ZHANG J, FENG Q J, et al. Medical image registration based on local variance and residual complexity[J]. Chinese Journal of Computers, 2015, 38(12):2400-2411.)
[7] GHAFFARI A, FATEMIZADEH E. Sparse-induced similarity measure:mono-modal image registration via sparse-induced similarity measure[J]. IET Image Processing, 2014, 8(12):728-741.
[8] GHAFFARI A, FATEMIZADEH E. RISM:single-modal image registration via rank-induced similarity measure[J]. IEEE Transactions on Image Processing, 2015, 24(12):5567-5580.
[9] CHENG X, ZHANG L, ZHENG Y. Deep similarity learning for multimodal medical images[J]. Computer Methods in Biomechanics and Biomedical Engineering:Imaging & Visualization, 2016, 6(4):1-5.
[10] SIMONOVSKY M, GUTIERREZ-BECKER B, MATEUS D, et al. A deep metric for multimodal registration[C]//MICCAI 2016:Proceedings of the 19th International Conference on Medical Image Computing and Computer-Assisted Intervention, LNCS 9902. Berlin:Springer, 2016:10-18.
[11] LITJENS G, KOOI T, BEJNORDI B E, et al. A survey on deep learning in medical image analysis[J]. Medical Image Analysis, 2017, 42(9):60-88.
[12] JOG A, ROY S, CARASS A, et al. Magnetic resonance image synthesis through patch regression[C]//Proceedings of the 2013 IEEE 10th International Symposium on Biomedical Imaging. Piscataway, NJ:IEEE, 2013:350-353.
[13] CHEN M, JOG A, CARASS A, et al. Using image synthesis for multi-channel registration of different image modalities[C]//Proceedings of SPIE 9413. Bellingham, WA:SPIE Press, 2015:21-26.
[14] FORSBERG D, RATHI Y, BOUIX S, et al. Improving registration using multi-channel diffeomorphic demons combined with certainty maps[C]//MBIA 2011:Proceedings of the First International Conference on Multimodal Brain Image Analysis. Berlin:Springer, 2011:19-26.
[15] 王丽芳,成茜,秦品乐,高媛.基于多层P样条和稀疏编码的非刚性医学图像配准方法[J/OL].计算机应用研究:1-4.[2017-03-27].http://kns.cnki.net/kcms/detail/51.1196.TP.20170727.2121.124.html. (WANG L F, CHENG X, QIN P L, et al. Non-rigid medical image registration method based on multilayer P-spline and sparse coding[J]. Applications Research of Computers:1-4.[2017-03-27].http://kns.cnki.net/kcms/detail/51.1196.TP.20170727.2121.124.html.)
[16] PRADHAN S, PATRA D. RMI based non-rigid image registration using BF-QPSO optimization and P-spline[J]. International Journal of Electronics and Communications, 2015, 69(3):609-621.
[17] COCOSCO C A, KOLLOKIAN V. BrainWeb:simulated brain database[EB/OL].[2018-01-23]. http://brainweb.bic.mni.mcgill.ca/brainweb/.
[18] JOHNSON K A, BECKER J A. The whole brain Atlas[DB/OL].[2017-11-15]. http://www.med.harvard.edu/aanlib/home.html.

Non-rigid multi-modal medical image registration based on multi-channel sparse coding

基于多通道稀疏编码的非刚性多模态医学图像配准

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	Shangbin MO, Wenjun WANG, Ling DONG, Shengxiang GAO, Zhengtao YU. Single-channel speech enhancement based on multi-channel information aggregation and collaborative decoding [J]. Journal of Computer Applications, 2024, 44(8): 2611-2617.
[2]	Hao CHAO, Shuqi FENG, Yongli LIU. Convolutional recurrent neural network optimized by multiple context vectors in EEG-based emotion recognition [J]. Journal of Computer Applications, 2024, 44(7): 2041-2046.
[3]	Sihang CHEN, Aiwen JIANG, Zhaoyang CUI, Mingwen WANG. Multi-channel multi-step integration model for generative visual dialogue [J]. Journal of Computer Applications, 2024, 44(1): 39-46.
[4]	JIANG Kaolin, BAI Wei, ZHANG Lei, CHEN Jun, PAN Zhisong, GUO Shize. Malicious code detection based on multi-channel image deep learning [J]. Journal of Computer Applications, 2021, 41(4): 1142-1147.
[5]	WANG Jinkai, JIA Xu. Vehicle face recognition algorithm based on NMF with weighted and orthogonal constraints [J]. Journal of Computer Applications, 2020, 40(4): 1050-1055.
[6]	LUO Chiwei, QU Tao, DENG Dexiang. Rate adaption algorithm for embedded multi-channel wireless video transmission [J]. Journal of Computer Applications, 2020, 40(4): 1119-1126.
[7]	LIU Yuefeng, YANG Hanxi, CAI Shuang, ZHANG Chenrong. Single image super-resolution reconstruction method based on improved convolutional neural network [J]. Journal of Computer Applications, 2019, 39(5): 1440-1447.
[8]	WAN Yuan, ZHANG Jinghui, CHEN Zhiping, MENG Xiaojing. Non-negative local sparse coding algorithm based on elastic net and histogram intersection [J]. Journal of Computer Applications, 2019, 39(3): 706-711.
[9]	WAN Yuan, ZHANG Jinghui, WU Kefeng, MENG Xiaojing. Image classification based on multi-layer non-negativity and locality Laplacian sparse coding [J]. Journal of Computer Applications, 2018, 38(9): 2489-2494.
[10]	ZUO Xiangmei, JIA Lijiao, HAN Pengcheng. Hierarchical three-dimensional shape ring feature extraction method [J]. Journal of Computer Applications, 2018, 38(6): 1755-1759.
[11]	CHEN Chen, ZHAO Jianwei, CAO Feilong. Image super-resolution reconstruction based on four-channel convolutional sparse coding [J]. Journal of Computer Applications, 2018, 38(6): 1777-1783.
[12]	YANG Xiaoling, LI Zhiqing, LIU Yutong. Automatic image annotation based on multi-label discriminative dictionary learning [J]. Journal of Computer Applications, 2018, 38(5): 1294-1298.
[13]	BAO Xingchuan, PENG Lin. Multi-channel scheduling strategy in smart distribution network [J]. Journal of Computer Applications, 2018, 38(5): 1476-1480.
[14]	JIA Xu, SUN Fuming, LI Haojie, CAO Yudong. Image feature extraction method based on improved nonnegative matrix factorization with universality [J]. Journal of Computer Applications, 2018, 38(1): 233-237.
[15]	WANG Zhiyi, BI Duyan, XIONG Lei, FAN Zunlin, ZHANG Xiaoyu. Text image restoration algorithm based on sparse coding and ridge regression [J]. Journal of Computer Applications, 2017, 37(9): 2648-2651.