Journal of Computer Applications ›› 2026, Vol. 46 ›› Issue (9): 3025-3034.DOI: 10.11772/j.issn.1001-9081.2025070908

• Frontier and comprehensive applications • Previous Articles    

CNN-Transformer encoder-based model for depressive state recognition with multidimensional EEG feature fusion

Siyu DONG1, Xin JIA2, Mi ZHANG2, Xinwen CHEN1, Xinying SUN1(), Fangxiao CHENG2()   

  1. 1.School of Public Health,Peking University,Beijing 100191,China
    2.Institute of Medical Technology,Peking University,Beijing 100191,China
  • Received:2025-08-11 Revised:2025-09-08 Accepted:2025-09-11 Online:2025-11-05 Published:2026-09-10
  • Contact: Xinying SUN, Fangxiao CHENG
  • About author:DONG Siyu, born in 2001, Ph. D. candidate. Her research interests include health big data mining, medical artificial intelligence.
    JIA Xin, born in 2001, M. S. candidate. His research interests include neuroelectrophysiological signal processing and feature extraction.
    ZHANG Mi, born in 2001, M. S. candidate. Her research interests include radiomics and machine learning model development.
    CHEN Xinwen, born in 1996, Ph. D. candidate. His research interests include electroencephalogram data analysis.
    SUN Xinying, born in 1973, Ph. D., professor. Her research interests include artificial intelligence, mobile health interventions.
    CHENG Fangxiao, born in 1993, Ph. D., associate research fellow. His research interests include neural information acquisition and processing, detection and regulation of brain ultrastructure (extracellular space of brain cells).
  • Supported by:
    Beijing Natural Science Foundation-Xiaomi Innovation Joint Fund(L243037)

基于CNN-Transformer编码器和多维脑电特征融合的抑郁状态识别模型

董思语1, 贾鑫2, 张密2, 陈新文1, 孙昕霙1(), 程方骁2()   

  1. 1.北京大学 公共卫生学院,北京 100191
    2.北京大学 医学技术研究院,北京 100191
  • 通讯作者: 孙昕霙,程方骁
  • 作者简介:董思语(2001—),女,山东济宁人,博士研究生,主要研究方向:医疗大数据挖掘、医学人工智能
    贾鑫(2001—),男,河北衡水人,硕士研究生,主要研究方向:神经电生理信号处理与特征提取
    张密(2001—),女,重庆人,硕士研究生,主要研究方向:影像组学与机器学习模型开发
    陈新文(1996—),男,江西南昌人,博士研究生,主要研究方向:脑电数据分析
    孙昕霙(1973—),女,吉林吉林人,教授,博士,主要研究方向:人工智能、移动健康干预
    程方骁(1993—),男,辽宁抚顺人,副研究员,博士,主要研究方向:神经信息获取与处理、脑超微结构(脑细胞外间隙)的探测与调控。
  • 基金资助:
    北京市自然科学基金-小米创新联合基金资助项目(L243037)

Abstract:

Considering the challenges of insufficient feature fusion and limited classification granularity in ElectroEncephaloGram (EEG) -based depression recognition task, a CNN-Transformer Encoder-based model for Depressive State Recognition (CTE-DSR) that integrated multidimensional EEG features was proposed. First, One-Dimensional Convolutional Neural Network (1D-CNN) was used to extract local spatial sequential features from EEG. Then, Transformer encoder module was introduced to model global correlations between leads. Simultaneously, Multi-Layer Perceptron (MLP) was used to embed depression-related non-sequential features into a high-dimensional space. Finally, the two features were fused to implement fine-grained classification of depression states through a fully connected layer. Besides, a loss weighting strategy was employed to improve the model's ability to identify minority classes. Experimental results show that compared with other five machine learning models (such as Random Forest (RF) and Adaptive Boosting (AdaBoost)) and two combination models (CNN-LSTM and CNN-RNN), CTE-DSR achieves at least 23.0% and 6.7% higher recall and Area Under Curve (AUC) in binary classification, respectively, and at least 15.6% and 1.0% higher F1-score and macro-average AUC in ternary classification, respectively. It can be seen that the proposed model has performance advantages in identifying depressive states and can be used to assist in early screening and relapse risk assessment of depression.

Key words: ElectroEncephaloGram (EEG) signal, depression multi-state recognition, Convolutional Neural Network (CNN), Transformer encoder, feature fusion, neural biomarker

摘要:

针对脑电(EEG)信号在识别抑郁症任务中存在的特征融合不足和分类粒度有限等问题,提出一种基于CNN-Transformer编码器的多维脑电特征融合抑郁状态识别模型(CTE-DSR)。首先,利用一维卷积神经网络(1D-CNN)提取EEG的局部空间序列特征;其次,引入Transformer编码器建模各导联间的全局相关性,同时,通过多层感知机(MLP)将抑郁相关的非序列特征嵌入高维空间;最后,将2类特征融合并通过全连接层实现对抑郁状态的细粒度分类;此外,采用损失加权策略改善模型对少数类的识别能力。实验结果表明,与其他5类机器学习模型(如随机森林(RF)和自适应提升算法(AdaBoost)等)和2类组合模型(CNN-LSTM和CNN-RNN)相比, CTE-DSR在二分类任务中的召回率和曲线下面积(AUC)分别至少提升了23.0%和6.7%,在三分类中的F1值和宏平均AUC分别至少提升了15.6%和1.0%。可见,所提模型在抑郁状态识别中展现出性能优势,可用于辅助抑郁症早期筛查和复发风险评估。

关键词: 脑电信号, 抑郁症多状态识别, 卷积神经网络, Transformer编码器, 特征融合, 神经生物标志物

CLC Number: