New traffic classification method for imbalanced network data

doi:10.11772/j.issn.1001-9081.2017071812

Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (1): 20-25.DOI: 10.11772/j.issn.1001-9081.2017071812

Previous Articles Next Articles

New traffic classification method for imbalanced network data

YAN Binghao, HAN Guodong, HUANG Yajing, WANG Xiaolong

National Digital Switching System Engineering & Technological Research Center, Zhengzhou Henan 450002, China

Received:2017-07-24 Revised:2017-08-01 Online:2018-01-10 Published:2018-01-22
Supported by:
This work is partially supported by the National Science Technology Major Project of China (2016ZX01012101), the National Natural Science Foundation of China (61572520), the National Natural Science Foundation Innovation Group Project of China (61521003).

非平衡网络流量识别方法

燕昺昊, 韩国栋, 黄雅静, 王孝龙

国家数字交换系统工程技术研究中心, 郑州 450002

通讯作者: 燕昺昊
作者简介:燕昺昊(1994-),男,山西吕梁人,硕士研究生,CCF会员,主要研究方向:流量识别、入侵检测、协议解析;韩国栋(1964-),男,山东莱西人,副教授,博士,主要研究方向:宽带信息处理与信息安全、芯片设计与应用;黄雅静(1984-),女,湖南长沙人,助理研究员,博士,主要研究方向:芯片设计、信号处理;王孝龙(1993-),男,河南民权人,硕士研究生,主要研究方向:宽带信息网络、协议解析。
基金资助:
国家科技重大专项（2016ZX01012101）；国家自然科学基金面上项目（61572520）；国家自然科学基金创新群体项目（61521003）。

Abstract

Abstract: To solve the problem existing in traffic classification that Peer-to-Peer (P2P) traffic is much more than that of non-P2P, a new traffic classification method for imbalanced network data was presented. By introducing and improving Synthetic Minority Over-sampling Technique (SMOTE) algorithm, a Mean SMOTE (M-SMOTE) algorithm was proposed to realize the balance of traffic data. On the basis of this, three kinds of machine learning classifiers:Random Forest (RF), Support Vector Machine (SVM), Back Propagation Neural Network (BPNN) were used to identify the various types of traffic. The theoretical analysis and simulation results show that, compared with the imbalanced state, the SMOTE algorithm improves the recognition accuracy of non-P2P traffic by 16.5 percentage points and raises the overall recognition rate of network traffic by 9.5 percentage points. Compared with SMOTE algorithm, the M-SMOTE algorithm further improves the recognition rate of non-P2P traffic and the overall recognition rate of network traffic by 3.2 percentage points and 2.6 percentage points respectively. The experimental results show that the way of imbalanced data classification can effectively solve the problem of low P2P traffic recognition rate caused by excessive P2P traffic, and the M-SMOTE algorithm has higher recognition accuracy rate than SMOTE.

Key words: imbalanced data, Peer-to-Peer (P2P) traffic, traffic classification, machine learning, Synthetic Minority Over sampling Technique (SMOTE) algorithm

摘要： 针对网络中存在的对等网络（P2P）流量泛滥导致的流量失衡问题，提出将非平衡数据分类思想应用于流量识别过程。通过引入合成少数类过采样技术（SMOTE）算法并进行改进，提出了均值SMOTE （M-SMOTE）算法，实现对流量数据的平衡化处理。在此基础上分别采用3种机器学习分类器：随机森林（RF）、支持向量机（SVM）、反向传播神经网络（BPNN）对处理后各类流量进行识别。理论分析与仿真结果表明，在不影响P2P流量识别准确率的前提下，与非平衡状态相比，引入SMOTE算法将非P2P流量的识别准确率平均提高了16.5个百分点，将网络流量的整体识别率提高了9.5个百分点；与SMOTE算法相比，M-SMOTE算法将非P2P流量的识别准确率与网络流量的整体识别率分别进一步提高了3.2个百分点和2.6个百分点。实验结果表明，非平衡数据分类思想可有效解决P2P流量过多导致的非P2P流量识别率低的问题，同时所提M-SMOTE算法具有更高的识别准确度。

关键词: 非平衡数据, P2P流量, 流量识别, 机器学习, 合成少数类过采样技术算法

CLC Number:

TP393.02

YAN Binghao, HAN Guodong, HUANG Yajing, WANG Xiaolong. New traffic classification method for imbalanced network data[J]. Journal of Computer Applications, 2018, 38(1): 20-25.

燕昺昊, 韩国栋, 黄雅静, 王孝龙. 非平衡网络流量识别方法[J]. 计算机应用, 2018, 38(1): 20-25.

References

[1] VALENTI S, ROSSI D, DAINOTTI A, et al. Reviewing traffic classification[M]//Data Traffic Monitoring and Analysis. Berlin:Springer, 2013:123-147.
[2] CHEN J, LI J. The research of peer-to-peer network security[C]//Proceedings of the 2015 International Conference on Information Computing and Automation. Singapore:World Scientific, 2015:590-592.
[3] 翟海滨,张鸿,刘欣然,等.最小化出口流量花费的接入级P2P缓存容量设计方法[J].电子学报,2015,43(5):879-887.(ZHAI H B, ZHANG H, LIU X R, et al. A P2P cache capacity design method to minimize the total traffic cost of access ISPs[J]. Acta Electronica Sinica, 2015, 43(5):879-887.)
[4] 张国强,唐明董,程苏琦,等.P2P流量优化[J].中国科学:信息科学,2012,42(1):1-19.(ZHANG G Q, TANG M D, CHENG S Q, et al. P2P traffic optimization[J]. Science in China:Series F, 2012, 42(1):1-19.)
[5] KARIM A, SALLEH R B, SHIRAZ M, et al. Botnet detection techniques:review, future trends, and issues[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(11):943-983.
[6] CAO Z, XIONG G, ZHAO Y, et al. A survey on encrypted traffic classification[C]//Proceedings of the 2014 International Conference on Applications and Techniques in Information Security. Berlin:Springer, 2014:73-81.
[7] GU R, WANG H, JI Y. Early traffic identification using Bayesian networks[C]//Proceedings of the 2010 IEEE International Conference on Network Infrastructure and Digital Content. Piscataway, NJ:IEEE, 2010:564-568.
[8] ZHU A. A P2P network traffic classification method based on C4.5 decision tree algorithm[C]//Proceedings of the 9th International Symposium on Linear Drives for Industry Applications. Berlin:Springer, 2014:373-379.
[9] GONG J, WANG W, WANG P, et al. P2P traffic identification method based on an improvement incremental SVM learning algorithm[C]//Proceedings of the 2015 IEEE International Symposium on Wireless Personal Multimedia Communications. Piscataway, NJ:IEEE, 2015:174-179.
[10] MU C, ZHANG C, HUANG X, et al. The efficiency analysis of the statistical feature in network traffic identification based on BP neural network[C]//Proceedings of the 2014 IEEE International Conference on Broadband Network & Multimedia Technology. Piscataway, NJ:IEEE, 2014:70-74.
[11] 陈虹,万广雪,肖振久.基于优化数据处理的深度信念网络模型的入侵检测方法[J].计算机应用,2017,37(6):1636-1643.(CHEN H, WAN G X, XIAO Z J. Intrusion detection method of deep belief network model based on optimization of data processing[J]. Journal of Computer Applications, 2017, 37(6):1636-1643.)
[12] DEEBA F, MOHAMMED S K, BUI F M, et al. Learning from imbalanced data:a comprehensive comparison of classifier performance for bleeding detection in endoscopic video[C]//Proceedings of the 2016 IEEE International Conference on Informatics, Electronics and Vision. Piscataway, NJ:IEEE, 2016:1006-1009.
[13] 高志鹏,牛琨,刘杰.面向大数据的分析技术[J].北京邮电大学学报,2015,38(3):1-12.(GAO Z P, NIU K, LIU J. Analytics towards big data[J]. Journal of Beijing University of Posts and Telecommunications, 2015, 38(3):1-12.)
[14] APANDI Z F M, MUSTAPHA N, AFFENDEY L S. Evaluating integrated weight linear method to class imbalanced learning in video data[C]//Proceedings of the 2011 IEEE International Conference on Data Mining and Optimization. Piscataway, NJ:IEEE, 2011:243-247.
[15] LIANG J, BAI L, DANG C, et al. The K-means-type algorithms versus imbalanced data distributions[J]. IEEE Transactions on Fuzzy Systems, 2012, 20(4):728-745.
[16] CHAWLA N V, BOWYER K W, HALL L O, et al. SMOTE:synthetic minority over-sampling technique[J]. Journal of Artificial Intelligence Research, 2002, 16(1):321-357.
[17] MOORE A W, ZUEV D. Internet traffic classification using Bayesian analysis techniques[C]//Proceedings of the 2005 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. New York:ACM, 2005:50-60.

New traffic classification method for imbalanced network data

非平衡网络流量识别方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	MAO Mingze, CAO Ruihao, YAN Chungang. Semi-supervised classification algorithm based on weight diversity [J]. Journal of Computer Applications, 2021, 41(9): 2473-2480.
[2]	GUO Mian, ZHANG Jinyou. Computation offloading policy for machine learning in mobile edge computing environments [J]. Journal of Computer Applications, 2021, 41(9): 2639-2645.
[3]	QIN Binbin, PENG Liangkang, LU Xiangming, QIAN Jiangbo. Research progress on driver distracted driving detection [J]. Journal of Computer Applications, 2021, 41(8): 2330-2337.
[4]	XIAO Zhenyuan, WANG Yihan, LUO Jianqiao, XIONG Ying, LI Bailin. RefineDet based on subsection weighted loss function [J]. Journal of Computer Applications, 2021, 41(7): 1928-1932.
[5]	YANG Xian, ZHAO Jisheng, QIANG Baohua, MI Luzhong, PENG Bo, TANG Chenghua, LI Baolian. Wind turbine fault sampling algorithm based on improved BSMOTE and sequential characteristics [J]. Journal of Computer Applications, 2021, 41(6): 1673-1678.
[6]	GUO Shuai, SU Yang. Encrypted traffic classification method based on data stream [J]. Journal of Computer Applications, 2021, 41(5): 1386-1391.
[7]	JIANG Qianyu, WANG Fengying, JIA Lipeng. Malware detection method based on perceptual hash algorithm and feature fusion [J]. Journal of Computer Applications, 2021, 41(3): 780-785.
[8]	QIN Jing, ZUO Changqing, WANG Zumin, JI Changqing, WANG Baofeng. Design of abnormal electrocardiograph monitoring model based on stacking classifier [J]. Journal of Computer Applications, 2021, 41(3): 887-890.
[9]	MENG Xiangrui, YANG Wenzhong, WANG Ting. Survey of sentiment analysis based on image and text fusion [J]. Journal of Computer Applications, 2021, 41(2): 307-317.
[10]	Xiaolong LIU, Shitong WANG. Open set fuzzy domain adaptation algorithm via progressive separation [J]. Journal of Computer Applications, 2021, 41(11): 3127-3131.
[11]	Haojie LOU, Yuanlin ZHENG, Kaiyang LIAO, Hao LEI, Jia LI. Defect target detection for printed matter based on Siamese-YOLOv4 [J]. Journal of Computer Applications, 2021, 41(11): 3206-3212.
[12]	WANG Yahui, QIAN Yuhua, LIU Guoqing. Ordinal decision tree algorithm based on fuzzy advantage complementary mutual information [J]. Journal of Computer Applications, 2021, 41(10): 2785-2792.
[13]	JIANG Yangsheng, WANG Shengnan, TU Jiaqi, LI Sha, WANG Hongjun. Comprehensive prediction of thermal comfort and energy consumption for high-speed railway stations [J]. Journal of Computer Applications, 2021, 41(1): 249-257.
[14]	ZHU Lin, YU Haitao, LEI Xinyu, LIU Jing, WANG Ruofan. Brain network feature identification algorithm for Alzheimer's patients based on MRI image [J]. Journal of Computer Applications, 2020, 40(8): 2455-2459.
[15]	LIU Dan, YAO Lishuang, WANG Yunfeng, PEI Zuofei. Classification model for class imbalanced traffic data [J]. Journal of Computer Applications, 2020, 40(8): 2327-2333.