《计算机应用》唯一官方网站

• •    下一篇

基于软白化的无负样本自监督时序预测框架

李栋1,赵苡积1,丁海燕1,1,武浩2   

  1. 1. 云南大学信息学院
    2. 云南大学
  • 收稿日期:2025-07-23 修回日期:2025-10-13 发布日期:2025-11-05 出版日期:2025-11-05
  • 通讯作者: 李栋

Soft whitening inspired non-contrastive SSL framework for time series forecasting

  • Received:2025-07-23 Revised:2025-10-13 Online:2025-11-05 Published:2025-11-05

摘要: 针对现有自监督学习方法在时序领域存在依赖负样本对、数据增强可能破坏时序结构等问题,提出了一种基于软白化的无负样本自监督时序预测框架(SWTF)。该框架旨在无需负样本即可学习到信息密集且具备预测能力的序列表征。其核心方法包含两个协同优化的目标:一是时序软白化(TSW)损失,通过减少表征维度间冗余并维持表征的方差来学习紧凑且信息丰富的表征,从而避免了对负样本对和表征不变性约束的依赖;二是去噪重构任务,通过有针对性的任务设计,引导模型关注并编码具有预测性的时序特征。为实现上述两个目标的联合优化,本研究构建了一个孪生编码器,该编码器利用并行多尺度卷积网络,高效捕捉从微观的局部周期性到宏观的长程依赖关系。在电力、气象和交通等多个基准数据集上,SWTF相较于CoST、PDF等主流时序预测基线,其MAE降幅约为19.6%(13.4%~26.4%),证实了SWTF框架,在学习鲁棒性和预测性较强的时间序列表征方面的有效性。

Abstract: To overcome limitations in existing self-supervised methods for time series, the Soft Whitening inspired non-contrastive self-supervised learning framework for Time-series Forecasting (SWTF) was proposed. Key limitations addressed were the reliance on negative pairs and the disruption of temporal dependencies by data augmentation. The SWTF framework, a negative-sample-free and self-supervised approach, was designed to learn information-dense and predictive representations. Its core methodology was based on two collaboratively optimized objectives. The first was a Temporal Soft Whitening (TSW) loss, which learned compact representations by reducing feature redundancy while preserving variance. This method eliminated the need for negative pairs and representation invariance constraints. The second was a denoising reconstruction task designed to guide the model in encoding predictive temporal features. To jointly optimize these objectives, a Siamese encoder with parallel multi-scale convolutional networks was constructed. This architecture efficiently captured both micro-level local periodicities and macro-level long-range dependencies. On several benchmark datasets (electricity, weather, and traffic), SWTF achieves a Mean Absolute Error (MAE) reduction of approximately 19.6% (13.4% to 26.4%) compared to mainstream baselines like CoST and PDF. These results demonstrate the effectiveness of the SWTF framework in learning robust and highly predictive time series representations.

中图分类号: