Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Long time series prediction based on hybrid self-attention and differentiated normalization
Ruirui SONG, Leichun WANG, Yunping HE, Jinxiang WEI, Xiangfeng LU, Xiaomeng LIU
Journal of Computer Applications    2026, 46 (5): 1499-1506.   DOI: 10.11772/j.issn.1001-9081.2025050628
Abstract30)   HTML0)    PDF (850KB)(15)       Save

Aiming at the problems of error accumulation, modeling difficulty, and low computational efficiency in long time series prediction, a long time series prediction model based on hybrid self-attention and differentiated normalization, namely HSADN (Hybrid Self-Attention and Differentiated Normalization), was proposed. Firstly, the model used a stacked multi-head self-attention mechanism in the encoder to capture long-distance dependencies in time series, thereby reducing computational complexity, and used a multi-layer sparse self-attention mechanism in the decoder to dynamically adjust the generation strategy. Secondly, in the encoder, Batch Channel Normalization (BCN) was used to extract, fuse, and reconstruct the features, while in the decoder, Layer Normalization (LN) was adopted to alleviate the gradient vanishing and improve the training stability, generating predicted sequence values. Experimental results show that compared with CALF (Cross-modAl Large Language Model Fine-tuning) model, HSADN has the Mean Squared Error (MSE) and Mean Absolute Error (MAE) of univariate prediction reduced by 6.2% and 6.9% on ECL-960, respectively, and by 13.1% and 2.9% on ETTh-720, respectively; the MSE and MAE of multivariate prediction reduced by 3.5% and 2.6% on ETTm-672, respectively, and by 1.8% and 0.9% on Weather-720, respectively; the running time for univariate and multivariate predictions reduced by an average of 4.6% and 28.7%, respectively.

Table and Figures | Reference | Related Articles | Metrics
Performance analysis and improvement of forward error correction encoder in G3-PLC
WU Xiaomeng LIU Hongli LI Cheng GU Zhiru
Journal of Computer Applications    2013, 33 (02): 393-396.   DOI: 10.3724/SP.J.1087.2013.00393
Abstract1441)      PDF (595KB)(473)       Save
To solve the problems of single and low rate of convolutional codes and large loss of data rate in the G3 standard, the low voltage power line carrier communication system model based on Orthogonal Frequency Division Multiplexing (OFDM) in the G3 standard was analyzed, and a designing scheme of forward error correction encoder was presented based on RS encoding, convolutional encoding, puncturing and depuncturing, repetition encoding and two dimensional time and frequency interleaving algorithm. Moreover, a method for raising the code rate by puncturing and depuncturing was mainly introduced. The simulation results show that the rate of convolutional codes is raised from 1/2 to 2/3, the data rate is improved without increasing the complexity of decoding, and the effective and reliable communication can be realized, which means the scheme can be widely used in low voltage Power Line Communication (PLC).
Related Articles | Metrics