Journal of Computer Applications ›› 2023, Vol. 43 ›› Issue (3): 692-699.DOI: 10.11772/j.issn.1001-9081.2022010089

• Artificial intelligence • Previous Articles    

Fusion imaging-based recurrent capsule classification network for time series

Rongjun CHEN1,2, Xuanhui YAN1,2(), Chaocheng YANG1,2   

  1. 1.College of Computer and Cyberspace Security,Fujian Normal University,Fuzhou Fujian 350117,China
    2.Digital Fujian Internet-of-Things Laboratory of Environmental Monitoring (Fujian Normal University),Fuzhou Fujian 350117,China
  • Received:2022-01-25 Revised:2022-04-19 Accepted:2022-04-20 Online:2022-04-26 Published:2023-03-10
  • Contact: Xuanhui YAN
  • About author:CHEN Rongjun, born in 1996, M. S. candidate. His research interests include deep learning, time series analysis.
    YANG Chaocheng, born in 1996, M. S. candidate. His research interests include time series analysis, machine learning.
  • Supported by:
    Guiding Project of Fujian Provincial Science and Technology Department(2020H0011)

面向时间序列的混合图像化循环胶囊分类网络

陈容均1,2, 严宣辉1,2(), 杨超城1,2   

  1. 1.福建师范大学 计算机与网络空间安全学院,福州 350117
    2.数字福建环境监测物联网实验室(福建师范大学),福州 350117
  • 通讯作者: 严宣辉
  • 作者简介:陈容均(1996—),男,福建三明人,硕士研究生,主要研究方向:深度学习、时间序列分析
    严宣辉(1968—),男,福建福州人,副教授,博士,主要研究方向:人工智能、深度学习
    杨超城(1996—),男,河南周口人,硕士研究生,主要研究方向:时间序列分析、机器学习。
  • 基金资助:
    福建省科技厅引导性项目(2020H0011)

Abstract:

To address the problem of lack of temporal correlations and spatial location relationships in imaging time series, Fusion-Imaing Recurrent Capsule Neural Network (FIR-Capsnet) for time series was proposed to fuse and extract spatial-temporal information from time series images. Firstly, the multi-level spatial-temporal features of time series images were captured by using Gramian Angular Field (GAF), Markov Transition Field (MTF) and Recurrence Plot (RP). Then, the spatial relationships of time series images were learnt by the rotation invariance of capsule neural network and iterative routing algorithm. Finally, the temporal correlations hidden in the time series data were learnt by the gate mechanism of Long-Short Term Memory (LSTM) network. Experimental results show that FIR-Capsnet achieves 15 wins on 30 UCR public datasets and outperforms Fusion-CNN by 7.2 percentage points in classification accuracy on Human Activity Recognition (HAR) dataset, illustrating the advantages of FIR-Capsnet in processing time series data.

Key words: pattern recognition, time series classification, deep learning, imaging time series, recurrent capsule neural network

摘要:

针对时间序列图像化缺少时间关联关系与空间位置关系的问题,提出面向时间序列的混合图像化循环胶囊神经网络(FIR-Capsnet)以融合并提取时间序列图像的时空信息。首先通过格拉姆角场(GAF)、马尔可夫跃迁场(MTF)与重现图(RP)方法捕获时间序列图像的多水平时空特征;然后利用胶囊神经网络的旋转不变性与路由迭代算法学习时间序列图像的空间关系;最后引入长短时记忆(LSTM)网络的门机制学习时间序列数据隐含的时间关联性。实验结果表明,FIR-Capsnet在30个UCR公开数据集上取得15次胜利;并且在人体活动识别(HAR)数据集上相较于Fusion-CNN、FIR-Capsnet的分类准确率提高7.2个百分点,说明了FIR-Capsnet处理时序数据的优势。

关键词: 模式识别, 时间序列分类, 深度学习, 时间序列图像化, 循环胶囊神经网络

CLC Number: