Abnormal time series data detection of gas station by Seq2Seq model based on bidirectional long short-term memory

doi:10.11772/j.issn.1001-9081.2018081681

Journal of Computer Applications ›› 2019, Vol. 39 ›› Issue (3): 924-929.DOI: 10.11772/j.issn.1001-9081.2018081681

Previous Articles Next Articles

Abnormal time series data detection of gas station by Seq2Seq model based on bidirectional long short-term memory

TAO Tao^1,2,3, ZHOU Xi^1,3, MA Bo^1,3, ZHAO Fan^1,3

1. Xinjiang Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, Urumqi Xinjiang 830011, China;
2. University of Chinese Academy of Sciences, Beijing 100049, China;
3. Xinjiang Laboratory of Minority Speech and Language Information Processing, Xinjiang Technical Institute of Physics and Chemistry, Xinjiang Urumqi 830011, China

Received:2018-08-14 Revised:2018-09-13 Online:2019-03-10 Published:2019-03-11
Supported by:
This work is partially supported by the Program of Introducing High-Level Talents of Xinjiang(Y639401201), the West Light Foundation of Chinese Academy of Sciences (2016-QNXZ-A-3).

基于双向LSTM的Seq2Seq模型在加油站时序数据异常检测中的应用

陶涛^1,2,3, 周喜^1,3, 马博^1,3, 赵凡^1,3

1. 中国科学院新疆理化技术研究所, 乌鲁木齐 830011;
2. 中国科学院大学, 北京 100049;
3. 新疆理化技术研究所新疆民族语音语言信息处理实验室, 乌鲁木齐 830011

通讯作者: 周喜
作者简介:陶涛(1994-),男,贵州毕节人,硕士研究生,主要研究方向:大数据分析、数据挖掘;周喜(1978-),男,湖南双峰人,研究员,博士,CCF会员,主要研究方向:物联网、大数据分析;马博(1984-),男,辽宁鞍山人,副研究员,博士,CCF会员,主要研究方向:数据分析与知识发现、机器学习;赵凡(1980-),男,山西介休人,副研究员,博士研究生,CCF会员,主要研究方向:信息安全、大数据分析。
基金资助:
新疆维吾尔自治区高层次人才引进工程资助项目（Y639401201）；中国科学院西部之光项目（2016-QNXZ-A-3）。

Abstract

Abstract:

Time series data of gas station contains multi-dimensional information of fueling behavior, but the data of specific gas station are sparse. The existing abnormal data detection algorithms are not suitable for gas station time series data, because many pseudo outliers are mined and many real abnormal points are missed. To solve the problems, an abnormal detection method based on deep learning was proposed to detect vehicles with abnormal fueling. Firstly, feature extraction was performed on data collected from the gas station through an automatic encoder. Then, a deep learning model Seq2Seq with embedding Bidirectional Long Short-Term Memory (Bi-LSTM) was used to predict the fueling behavior. Finally, the threshold of outliers was defined by comparing the predicted value and the original value. The experiments on a fueling dataset and a credit card fraud dataset verify the effectiveness of the proposed method. Compared with the existing methods, the Root Mean Squared Error (RMSE) of the proposed method is decreased by 21.1% on the fueling dataset, and abnormal detection accuracy of the proposed method is improved by 1.4% on the credit card fraud dataset. Therefore, the proposed method can be applied to detect vehicles with abnormal fueling behavior, improving the management and operational efficiency of gas station.

Key words: gas station time-serise data, deep learning, Seq2Seq, Bidirectional Long Short-Term Memory (Bi-LSTM), outlier detection

摘要：

加油时序数据包含加油行为的多维信息，但是指定加油站点数据较为稀疏，现有成熟的数据异常检测算法存在挖掘较多假性异常点以及遗漏较多真实异常点的缺陷，并不适用于挖掘加油站时序数据。提出一种基于深度学习的异常检测方法识别加油异常车辆，首先通过自动编码器对加油站点采集到的相关数据进行特征提取，然后采用嵌入双向长短期记忆（Bi-LSTM）的Seq2Seq模型对加油行为进行预测，最后通过比较预测值和原始值来定义异常点的阈值。通过在加油数据集以及信用卡欺诈数据集上的实验验证了该方法的有效性，并且相对于现有方法在加油数据集上均方根误差（RMSE）降低了21.1%，在信用卡欺诈数据集上检测异常的准确率提高了1.4%。因此，提出的模型可以有效应用于加油行为异常的车辆检测，从而提高加油站的管理和运营效率。

关键词: 加油站时序数据, 深度学习, Seq2Seq, 双向长短期记忆, 异常检测

CLC Number:

TP391.4

TAO Tao, ZHOU Xi, MA Bo, ZHAO Fan. Abnormal time series data detection of gas station by Seq2Seq model based on bidirectional long short-term memory[J]. Journal of Computer Applications, 2019, 39(3): 924-929.

陶涛, 周喜, 马博, 赵凡. 基于双向LSTM的Seq2Seq模型在加油站时序数据异常检测中的应用[J]. 计算机应用, 2019, 39(3): 924-929.

References

[1] ROUSSEEUW P J, LEROY A M. Robust Regression and Outlier Detection[M]. New York:John Wiley & Sons, 2005:254-255.
[2] HUANG Z, XU W, YU K. Bidirectional LSTM-CRF models for sequence tagging[EB/OL].[2015-08-09]. https://arxiv.org/pdf/1508.01991.pdf.
[3] SUTSKEVER I, VINYALS O, LE Q V. Sequence to sequence learning with neural networks[C]//NIPS 2014:Proceedings of the 2014 Advances in Neural Information Processing Systems 27. Montréal:[s.n.], 2014:3104-3112.
[4] 严宏,杨波,杨红雨.基于异方差高斯过程的时间序列数据离群点检测[J].计算机应用,2018,38(5):1346-1352.(YAN H, YANG B, YANG H Y. Outlier detection in time series data based on heteroscedastic Gaussian processes[J]. Journal of Computer Applications, 2018, 38(5):1346-1352.)
[5] 陈斌,陈松灿,潘志松,等.异常检测综述[J].山东大学学报(工学版), 2009,39(6):13-23. (CHEN B, CHEN S C, PAN Z S. et al. Survey of outlier detection technologies[J]. Journal of Shandong University (Engineering Science), 2009, 39(6):13-23.)
[6] HUANG T, ZHU Y, WU Y, et al. Anomaly detection and identification scheme for VM live migration in cloud infrastructure[J]. Future Generation Computer Systems, 2016, 56(C):736-745.
[7] WANG T, LI Z. Outlier detection in high-dimensional regression model[J]. Communications in Statistics, 2016, 46(14):6947-6958.
[8] 鲍苏宁,张磊,杨光.基于核主成分分析的异常轨迹检测方法[J].计算机应用,2014,34(7):2107-2110.(BAO S N, ZHANG L, YANG G. Trajectory outlier detection method based on kernel principal component analysis[J]. Journal of Computer Applications, 2014, 34(7):2107-2110.
[9] SHIPMON D T, GUREVITCH J M, PISELLI P M, et al. Time series anomaly detection:detection of anomalous drops with limited features and sparse examples in noisy highly periodic data[EB/OL].[2017-08-11].http://cn.arxiv.org/ftp/arxiv/papers/1708/1708.03665.pdf.
[10] BAHDANAU D, CHO K, BENGIO Y. Neural machine translation by jointly learning to align and translate[EB/OL].[2016-05-19]. https://arxiv.org/pdf/1409.0473.pdf.
[11] FARIAS G, DORMIDO-CANTO S, VEGA J, et al. Automatic feature extraction in large fusion databases by using deep learning approach[J]. Fusion Engineering and Design, 2016, 112:979-983.
[12] SUTSKEVER I, VINYALS O, LE Q V. Sequence to sequence learning with neural networks[EB/OL].[2018-07-10]. https://arxiv.org/pdf/1409.3215.pdf
[13] ZHENG J, XU C, ZHANG Z, et al. Electric load forecasting in smart grids using long-short-term-memory based recurrent neural network[C]//CISS 2017:Proceedings of the 201751st Annual Conference on Information Sciences and Systems. Piscataway, NJ:IEEE, 2017:1-6.
[14] TAI K S, SOCHER R, MANNING C D. Improved semantic representations from tree-structured long short-term memory networks[EB/OL].[2018-05-30]. https://arxiv.org/pdf/1503.00075.pdf.
[15] CHO K, van MERRIENBOER B, GULCEHRE C, et al. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation[EB/OL].[2017-09-03]. https://arxiv.org/pdf/1406.1078.pdf.
[16] MADLENÁK R, MADLENÁKOVÁ L, SVADLENKA L, et al. Analysis of website traffic dependence on use of selected Internet marketing tools[J]. Procedia Economics and Finance, 2015, 23:123-128.
[17] AGNIHOTRI M. Credit card fraud detection[DB/OL].[2017-04-27]. https://www.ushuji.com/financial/296.html.
[18] TSANGARATOS P, ILIA I. Comparison of a logistic regression and Naïve Bayes classifier in landslide susceptibility assessments:the influence of models complexity and training dataset size[J]. Catena, 2016, 145:164-179.
[19] LAPTEV N, AMIZADEH S, FLINT I. Generic and scalable framework for automated time-series anomaly detection[C]//KDD'15:Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York:ACM, 2015:1939-1947.
[20] SHI Y, EBERHART R C. Empirical study of particle swarm optimization[C]//CEC'99:Proceedings of the 1999 Congress on Evolutionary Computation. Piscataway, NJ:IEEE, 1999, 3:1945-1950.
[21] 周志华.机器学习:=Machine learning[M]. 北京:清华大学出版社,2016:33-36.(ZHOU Z H. Machine learning:=Machine learning[M]. Beijing:Tsinghua University Press, 2016:33-36.)

Abnormal time series data detection of gas station by Seq2Seq model based on bidirectional long short-term memory

基于双向LSTM的Seq2Seq模型在加油站时序数据异常检测中的应用

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[2]	XU Jianglang, LI Linyan, WAN Xinjun, HU Fuyuan. Indoor scene recognition method combined with object detection [J]. Journal of Computer Applications, 2021, 41(9): 2720-2725.
[3]	CHEN Chengrui, SUN Ning, HE Shibiao, LIAO Yong. Deep learning-based joint channel estimation and equalization algorithm for C-V2X communications [J]. Journal of Computer Applications, 2021, 41(9): 2687-2693.
[4]	XIE Defeng, JI Jianmin. Syntax-enhanced semantic parsing with syntax-aware representation [J]. Journal of Computer Applications, 2021, 41(9): 2489-2495.
[5]	DAI Yurou, YANG Qing, ZHANG Fengli, ZHOU Fan. Trajectory prediction model of social network users based on self-supervised learning [J]. Journal of Computer Applications, 2021, 41(9): 2545-2551.
[6]	ZHENG Zhiqiang, HU Xin, WENG Zhi, WANG Yuhe, CHENG Xi. Cattle eye image feature extraction method based on improved DenseNet [J]. Journal of Computer Applications, 2021, 41(9): 2780-2784.
[7]	CAO Yuhong, XU Hai, LIU Sun'ao, WANG Zixiao, LI Hongliang. Review of deep learning-based medical image segmentation [J]. Journal of Computer Applications, 2021, 41(8): 2273-2287.
[8]	QIN Binbin, PENG Liangkang, LU Xiangming, QIAN Jiangbo. Research progress on driver distracted driving detection [J]. Journal of Computer Applications, 2021, 41(8): 2330-2337.
[9]	MENG Fan, CHEN Guang, WANG Yong, GAO Yang, GAO Dequn, JIA Wenlong. Multi-granularity temporal structure representation based outlier detection method for prediction of oil reservoir [J]. Journal of Computer Applications, 2021, 41(8): 2453-2459.
[10]	HE Zhenghai, XIAN Yantuan, WANG Meng, YU Zhengtao. Case reading comprehension method combining syntactic guidance and character attention mechanism [J]. Journal of Computer Applications, 2021, 41(8): 2427-2431.
[11]	LI Yafang, LIANG Ye, FENG Weiwei, ZU Baokai, KANG Yujian. Deep network embedding method based on community optimization [J]. Journal of Computer Applications, 2021, 41(7): 1956-1963.
[12]	GAO Qinquan, HUANG Bingcheng, LIU Wenzhe, TONG Tong. Bamboo strip surface defect detection method based on improved CenterNet [J]. Journal of Computer Applications, 2021, 41(7): 1933-1938.
[13]	WANG Yue, JIANG Yiming, LAN Julong. Intrusion detection based on improved triplet network and K-nearest neighbor algorithm [J]. Journal of Computer Applications, 2021, 41(7): 1996-2002.
[14]	HOU Xiaohan, JIN Guodong, TAN Lining, XUE Yuanliang. Synthetic aperture radar ship detection method based on self-adaptive and optimal features [J]. Journal of Computer Applications, 2021, 41(7): 2150-2155.
[15]	DU Yan, LYU Liangfu, JIAO Yichen. Fuzzy prototype network based on fuzzy reasoning [J]. Journal of Computer Applications, 2021, 41(7): 1885-1890.