Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (1): 71-76.DOI: 10.11772/j.issn.1001-9081.2019061039

• Artificial intelligence • Previous Articles     Next Articles

Optimized convolutional neural network method for classification of pneumonia images

DENG Qi, LEI Yinjie, TIAN Feng   

  1. College of Electronics and Information Engineering, Sichuan University, Chengdu Sichuan 610065, China
  • Received:2019-06-19 Revised:2019-09-25 Online:2020-01-10 Published:2019-10-10
  • Supported by:
    This work is partially supported by the National Natural Science Foundation of China (61602499), the Key Research and Development Program of Sichuan Province (2019YFG0409).

用于肺炎图像分类的优化卷积神经网络方法

邓棋, 雷印杰, 田锋   

  1. 四川大学 电子信息学院, 成都 610065
  • 通讯作者: 邓棋
  • 作者简介:邓棋(1994-),男,四川资阳人,硕士研究生,主要研究方向:计算机视觉、深度学习;雷印杰(1983-),男,四川成都人,副教授,博士,主要研究方向:人工智能、数据挖掘、深度学习、医学影像处理;田锋(1992-),男,湖北恩施人,硕士研究生,主要研究方向:机器学习、计算机视觉。
  • 基金资助:
    国家自然科学基金资助项目(61602499);四川省重点研发计划项目(2019YFG0409)。

Abstract: Currently, Convolutional Neural Network (CNN) is applied in the field of pneumonia classification. Aiming at the hardness to improve the accuracy of pneumonia recognition of convolution network with shallow layers and simple structure, deep learning method was adopted; and concerning the problem that the deep learning method often consumes a lot of system resources, which makes the convolution network difficult to be deployed at user end, an classification method based on optimized convolution neural network was proposed. Firstly, according to the features of pneumonia images, AlexNet and Inception V3 models with good image classification performance were selected. Then, the characteristics of medical images were used to re-train the Inception V3 model with deeper layers and more complex structure. Finally, through knowledge distillation method, the trained "knowledge" (effective information) was extracted into AlexNet model, so as to reduce the occupancy of system resources and improve the accuracy. The experimental data show that after knowledge distillation, AlexNet model has the accuracy, specificity and sensitivity improved by 4.1, 7.45 and 1.97 percentage points respectively, and has the Graphics Processing Unit (GPU) occupation reduced by 51 percentage points compared with InceptionV3 model.

Key words: deep learning, image classification, Convolutional Neural Network (CNN), pneumonia diagnosis, knowledge distillation, network compression

摘要: 目前,卷积神经网络(CNN)开始应用在肺炎分类领域。针对层数较浅、结构较为简单的卷积网络对肺炎识别的准确率难以提高的情况,采用深度学习方法,并针对采用深度学习方法时常常需要消耗大量的系统资源,导致卷积网络难以在用户端部署的问题,提出一种使用优化的卷积神经网络的分类方法。首先,根据肺炎图像的特征,选择具有良好图像分类性能的AlexNet与InceptionV3模型;然后,利用医学影像特点对层次更深、结构更加复杂的InceptionV3模型进行预训练;最后,通过知识蒸馏的方法,将训练好的"知识"(有效信息)提取到AlexNet模型中,从而实现在减少系统资源占用的同时,提高准确率的效果。实验数据表明,使用知识蒸馏后,AlexNet模型的准确率、特异性与灵敏度分别提高了4.1、7.45、1.97个百分点,且对图像处理器(GPU)占用相比InceptionV3模型减小了51个百分点。

关键词: 深度学习, 图像分类, 卷积神经网络, 肺炎诊断, 知识蒸馏, 网络压缩

CLC Number: