Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (11): 3219-3227.DOI: 10.11772/j.issn.1001-9081.2020121924

• Artificial intelligence • Previous Articles     Next Articles

Application of Inception-v3 model integrated with transfer learning in dynasty identification of ancient murals

Jianfang CAO1,2(), Minmin YAN1, Yiming JIA1, Xiaodong TIAN1   

  1. 1.College of Computer Science and Technology,Taiyuan University of Science and Technology,Taiyuan Shanxi 030024,China
    2.Computer Department,Xinzhou Teachers University,Xinzhou Shanxi 034000,China
  • Received:2020-12-09 Revised:2021-07-23 Accepted:2021-08-03 Online:2021-03-07 Published:2021-11-10
  • Contact: Jianfang CAO
  • About author:CAO Jianfang,born in 1976,Ph. D.,professor. Her research interests include digital image understanding,big data
    YAN Minmin, born in 1997, M. S. candidate. Her research interests include intelligent information processing
    JIA Yiming,born in 1996,M. S. candidate. His research interests include digital image processing,machine learning
    TIAN Xiaodong,born in 1996,M. S. candidate.
  • Supported by:
    the Humanities and Social Sciences Key Research Base Project of Shanxi Province Colleges and Universities(20190130)

融合迁移学习的Inception-v3模型在古壁画朝代识别中的应用

曹建芳1,2(), 闫敏敏1, 贾一鸣1, 田晓东1   

  1. 1.太原科技大学 计算机科学与技术学院,太原 030024
    2.忻州师范学院 计算机系,山西 忻州 034000
  • 通讯作者: 曹建芳
  • 作者简介:曹建芳(1976—),女,山西忻州人,教授,博士,CCF高级会员,主要研究方向:数字图像理解、大数据
    闫敏敏(1997—),女,山西 长治人,硕士研究生,主要研究方向:智能信息处理
    贾一鸣(1996—),男,山西太原人,硕士研究生,主要研究方向:数字图像处理、机器学 习
    田晓东(1996—),男,山西朔州人,硕士研究生,主要研究方向:图像处理、深度学习。
  • 基金资助:
    山西省高等学校人文社会科学重点研究基地项目(20190130)

Abstract:

Aiming at the problems of small quantity, poor quality, difficulty in feature extraction, and similarity of mural text and painting style of ancient mural images, an Inception-v3 model integrated with transfer learning was proposed to identify and classify the dynasties of ancient murals. Firstly, the Inception-v3 model was pre-trained on the ImageNet dataset to obtain the migration model. After fine-tuning the parameters of the migration model on the small mural dataset, the high-level features were extracted from the mural images. Then, the feature representation ability was enhanced by adding two fully connected layers, and the color histogram and Local Binary Pattern (LBP) texture histogram were used to extract the artistic features of murals. Finally, the high-level features were combined with the artistic features, and the Softmax classifier was used to perform the dynasty classification of murals. Experimental results show that, the training process of the proposed model was stable. On the constructed small mural dataset, the proposed model has the final accuracy of 88.70%, the recall of 88.62%, and the F1-score of 88.58%. Each evaluation index above of the proposed model is better than those of the classic network models such as AlexNet and Visual Geometry Group Net (VGGNet). Compared with LeNet-5, AlexNet-S6 and other improved convolutional neural network models, the proposed model has the accuracy of each dynasty category improved by at least 7 percentage points on average. It can be seen that the proposed model has strong generalization ability, is not prone to overfitting, and can effectively identify the dynasty to which the murals belong.

Key words: mural classification, dynasty identification, transfer learning, Inception-v3 model, color histogram

摘要:

针对古代壁画图像数量少、质量差、特征提取困难和存在壁画文本与绘画风格相似等问题,提出了一种融合迁移学习的Inception-v3模型来对古代壁画的朝代进行识别与分类。首先,将Inception-v3模型在ImageNet数据集上进行预训练以得到迁移模型;然后,将迁移模型在小型壁画数据集上进行参数微调后对壁画图像提取高层特征;其次,增加两个全连接层来增强特征表达能力,并用颜色直方图与局部二值模式(LBP)纹理直方图提取壁画的艺术特征;最后,将高层特征与艺术特征相融合,用Softmax分类器进行壁画的朝代分类。实验结果表明,所提出的模型训练过程稳定,在构造的小型壁画数据集上,其最终准确率为88.70%,召回率为88.62%,F1值为88.58%,以上各评价指标均优于AlexNet、VGGNet等经典网络模型;与LeNet-5、AlexNet-S6等改进的卷积神经网络模型相比,该模型对各朝代类别准确率平均提升了至少7个百分点。可见,该模型泛化能力强,不易出现过拟合现象,能有效识别壁画所属朝代。

关键词: 壁画分类, 朝代识别, 迁移学习, Inception-v3模型, 颜色直方图

CLC Number: