Quality evaluation model of network operation and maintenance based on correlation analysis

doi:10.11772/j.issn.1001-9081.2018020412

Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (9): 2535-2542.DOI: 10.11772/j.issn.1001-9081.2018020412

Previous Articles Next Articles

Quality evaluation model of network operation and maintenance based on correlation analysis

WU Muyang¹, LIU Zheng¹, WANG Yang², LI Yun¹, LI Tao¹

1. College of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing Jiangsu 210046, China;
2. Network Division, China Mobile Communications Group Shanxi Company Limited, Taiyuan Shanxi 030009, China

Received:2018-03-02 Revised:2018-04-26 Online:2018-09-10 Published:2018-09-06
Contact: 刘峥
Supported by:
This work is partially supported by the Natural Science Foundation of Jiangsu Province (BK20171447), the Natural Science Foundation for Colleges and Universities of Jiangsu Province (17JKB520024), the Ministry of Education-China Mobile Research Fund (MCM20150510), the Introduction of Talent Research Start-up Foundation of Nanjing University of Posts and Telecommunications (NY215045).

基于指标相关性的网络运维质量评估模型

吴沐阳¹, 刘峥¹, 王洋², 李云¹, 李涛¹

1. 南京邮电大学计算机学院, 南京 210046;
2. 中国移动通信集团山西有限公司网络部, 太原 030009

通讯作者: 刘峥
作者简介:吴沐阳(1995—),女,江苏盐城人,硕士研究生,主要研究方向:日志分析、数据挖掘;刘峥(1980—),男,江苏南京人,讲师,博士,CCF会员,主要研究方向:图数据挖掘与查询、网络数据挖掘;王洋(1983—),男,山西太原人,高级工程师,博士,主要研究方向:移动通信大数据分析、集中监控、网络管理系统;李云(1975—),男,安徽合肥人,教授,博士,CCF会员,主要研究方向:机器学习、数据挖掘、分布式计算、模式识别;李涛(1975—2017),男,四川梓潼人,教授,博士,主要研究方向:数据挖掘、机器学习、信息检索。
基金资助:
江苏省自然科学基金资助项目（BK20171447）；江苏省高等学校自然科学研究资助项目（17JKB520024）；教育部-中国移动科研基金资助项目（MCM20150510）；南京邮电大学引进人才科研启动基金资助项目（NY215045）。

Abstract

Abstract: Traditional network operation and maintenance evaluation method has two problems. First, it is too dependent on domain experts' experience in indicator selection and weight assignment, so that it is difficult to obtain accurate and comprehensive assessment results. Second, the network operation and maintenance quality involves data from multiple manufacturers or multiple devices in different formats and types, and a surge of users brings huge amounts of data. To solve the problems mentioned above, an indicator selection method based on correlation was proposed. The method focuses on the steps of indicator selection in the process of evaluation. By comparing the strength of the correlation between the data series of indicators, the original indicators could be classified into different clusters, and then the key indicators in each cluster could be selected to construct a key indicators system. The data processing methods and weight determination methods without human participation were also utilized into the network operation and maintenance quality evaluation model. In the experiments, the indicators selected by the proposed method cover 72.2% of the artificial indicators. The information overlap rate is 31% less than the manual indicators'. The proposed method can effectively reduce human involvement, and has a higher prediction accuracy for the alarm.

Key words: network operation and maintenance, Quality of Service (QoS), quality evaluation, indicator selection, correlation analysis

摘要： 传统网络运维评估方法存在两方面的问题：一是在指标选取、权重指定等关键步骤过于依赖领域专家经验，难以得到精确全面的评估结果；二是通信设备用户数量不断增加带来了海量的数据，数据又来自多个厂家以及多种设备，传统方法处理此类海量异构数据的效率较低。为了解决这些问题，提出基于指标间互相关性的指标选取方法。该方法着眼于评估过程中指标选取步骤，通过比较指标数据序列间的相关性强弱，对原始指标集进行分类，在各个簇中选择代表性指标完成关键指标体系的构建；另外，结合无人工参与的数据处理方法、权重确定方法建立了网络运维质量评估模型。在实验中，所提方法选取的指标对人工指标的覆盖率为72.2%，并且比人工指标的信息重叠率少31%。所提方法能够有效减少人力参与，且评估结果对告警有较好的预测准确率。

关键词: 网络运维, 服务质量, 质量评估, 指标选取, 相关性分析

CLC Number:

TP393

WU Muyang, LIU Zheng, WANG Yang, LI Yun, LI Tao. Quality evaluation model of network operation and maintenance based on correlation analysis[J]. Journal of Computer Applications, 2018, 38(9): 2535-2542.

吴沐阳, 刘峥, 王洋, 李云, 李涛. 基于指标相关性的网络运维质量评估模型[J]. 计算机应用, 2018, 38(9): 2535-2542.

References

[1] ITU. International Telecommunication Union homepage[EB/OL].[2018-01-24]. https://www.itu.int/zh/Pages/default.aspx.
[2] Telecom Management Forum. Telecom Management Forum homepage[EB/OL].[2018-01-24]. https://www.tmforum.org/.
[3] 邓雪,李家铭,曾浩健,等.层次分析法权重计算方法分析及其应用研究[J].数学的实践与认识,2012,42(7):93-100.(DENG X, LI J M, ZENG H J, et al. Research on computation methods of AHP wight vector and its applications[J]. Mathematics in Practice and Theory, 2012, 42(7):93-100.)
[4] ABDI H, WILLIAMS L J. Principal component analysis[J]. Wiley Interdisciplinary Reviews:Computational Statistics, 2010, 2(4):433-459.
[5] 李会志,袁超伟.移动通信网络KPI指标分类方法研究[J].信息网络安全,2014(12):56-60.(LI H Z, YUAN C W. The method of KPI classification of mobile communication network[J]. Netinfo Security, 2014(12):56-60.)
[6] 吴志飞,肖丁,朱建冲.装备保障方案定性评估指标量化处理的方法[J].火力与指挥控制,2014(5):90-93.(WU Z F, XIAO D, ZHU J C. A method to turn treatment for qualitative evaluation index of materiel support plan[J]. Fire Control and Command Control, 2014(5):90-93.)
[7] 马立平.统计数据标准化——无量纲化方法——现代统计分析方法的学与用(三)[J]. 北京统计, 2000(3):34-35. (MA L P. Standardization of statistical data-dimensionless method[J]. Beijing Statistics, 2000(3):34-35.)
[8] 南洋,陈琳.基于客观权重确定的数据中心网络性能评估方法[J].计算机应用,2015,35(11):3055-3058.(NAN Y, CHEN L. Performance evaluation method based on objective weight determination for data center network[J]. Journal of Computer Applications, 2015, 35(11):3055-3058.)
[9] ZOU Z H, YI Y, SUN J N. Entropy method for determination of weight of evaluating indicators in fuzzy synthetic evaluation for water quality assessment[J]. Journal of Environmental Sciences, 2006, 18(5):1020-1023.
[10] 张红涛,毛罕平.四种客观权重确定方法在粮虫可拓分类中的应用比较[J].农业工程学报,2009,25(1):132-136.(ZHANG H T, MAO H P. Comparison of four methods for deciding objective weights of features for classifying stored-grain insects based on extension theory[J]. Transactions of the Chinese Society of Agricultural Engineering, 2009, 25(1):132-136.)
[11] 罗赟骞,夏靖波,陈天平.网络性能评估中客观权重确定方法比较[J].计算机应用,2009,29(10):2624-2626.(LUO Y Q, XIA J B, CHEN T P. Comparison of objective weight determination methods in network performance evaluation[J]. Journal of Computer Applications, 2009, 29(10):2624-2626.)
[12] LIU Z, LI T, WANG J. A survey on event mining for ICT network infrastructure management[J]. ZTE Communications, 2016, 14(2):47-55.
[13] 赵华琼,唐学文.基于模糊层次分析法的网络业务性能评估模型[J].计算机应用,2013,33(11):3035-3038.(ZHAO H Q, TANG X W. Evaluation model of network service performance based on fuzzy analytic hierarchy process[J]. Journal of Computer Applications, 2013, 33(11):3035-3038.)
[14] 钟赟,夏靖波,吴吉祥,等.基于灰色关联的网络性能模糊评估[J].空军工程大学学报(自然科学版),2014,15(3):76-79.(ZHONG Y, XIA J B, WU J X, et al. Network performance fussy evaluation based on grey correlation[J]. Journal of Air Force Engineering University (Natural Science Edition), 2014, 15(3):76-79.)
[15] 夏靖波,柏骏.基于相关向量机的网络运行质量评估方法[J].电子设计工程,2016(2):121-123.(XIA J B, BAI J. Network running quality evaluation method based on relevant vector machine[J]. Electronic Design Engineering, 2016(2):121-123.)
[16] 刘玉军.网络服务质量评估体系研究[J].计算机工程与设计,2005,26(5):1250-1252.(LIU Y J. Study of network service quality evaluation system[J]. Computer Engineering and Design, 2005, 26(5):1250-1252.)
[17] TMF. GB923 wireless service measurements handbook approved version 3.0[S]. Suffolk:TMF, 2004:2-13.
[18] ITU-T. E.800 terms and definitions related to quality of service and network performance including dependability[S]. Geneva:ITU-T, 2008:1-21.
[19] ITU-T. E.803 quality of service parameters for supporting service aspects[S]. Geneva:ITU-T, 2011:5-15.
[20] ITU-T. How to increase QoS/QoE of IP-based platform(s) to regionally agreed standards[S]. Geneva:ITU-T, 2013:1-20.
[21] ITU-T. G.1020 performance parameter definitions for quality of speech and other voiceband applications utilizing IP networks[S]. Geneva:ITU-T, 2006:1-17.
[22] ITU-T. E.802 framework and methodologies for the determination and application of QoS parameters[S]. Geneva:ITU-T, 2007:8-14.
[23] 刘路,刘志民,罗英姿.欧洲MOOC教育质量评价方法及启示[J].开放教育研究,2015,21(5):57-65.(LIU L, LIU Z M, LUO Y Z. Analysis of three European assessment tools for measuring MOOCs' quality in higher education and its implications[J]. Open Education Research, 2015, 21(5):57-65.)
[24] 肖静华,宛小伟,谢康.企业人力资源管理质量评价模型及实证分析[J].管理评论,2011,23(8):143-151.(XIAO J H, WAN X W, XIE K. Human resource management quality evaluation model and empirical analysis[J]. Management Review, 2011, 23(8):143-151.)
[25] 杨阳,汪海涛,姜瑛,等.基于模糊层次分析法的软件质量评价模型的研究[J].计算机与数字工程,2017,45(4):620-623.(YANG Y, WANG H T, JIANG Y, et al. Software quality evaluation model based on fuzzy analytic hierarchy process[J]. Computer and Digital Engineering, 2017, 45(4):620-623.)
[26] 谭跃进.定量分析方法[M].北京:中国人民大学出版社,2012:103-105.(TAN Y J. Method of Quantitative Analysis[M]. Beijing:China Renmin University Press, 2012:103-105.)
[27] 张潮.移动通信网络管理系统质量评价体系和方法的研究与应用[D].北京:北京邮电大学,2011:20-22.(ZHANG C. Study and application of mobile network management quality evaluation system and method[D]. Beijing:Beijing University of Posts and Telecommunications, 2011:20-22.)
[28] 张旭.移动运营商运营质量评估系统的研究[D].北京:北京交通大学,2012:4-5.(ZHANG X. Research on the mobile operator's operation quality assessment system[D]. Beijing:Beijing Jiaotong University, 2012:4-5.)
[29] BRANDES U. A faster algorithm for betweenness centrality[J]. Journal of Mathematical Sociology, 2001, 25(2):163-177.

Quality evaluation model of network operation and maintenance based on correlation analysis

基于指标相关性的网络运维质量评估模型

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	ZHOU Shuo, QIU Runhe, TANG Minjun. Power allocation algorithm for CR-NOMA system based on tabu search and Q-learning [J]. Journal of Computer Applications, 2021, 41(7): 2026-2032.
[2]	RAN Jiamin, NI Zhiwei, PENG Peng, ZHU Xuhui. Task allocation strategy considering service quality of spatial crowdsourcing workers and its glowworm swarm optimization algorithm solution [J]. Journal of Computer Applications, 2021, 41(3): 794-802.
[3]	Ying LEI, Wanbo ZHENG, Wei WEI, Yunni XIA, Xiaobo LI, Chengwu LIU, Hong XIE. Task offloading method based on probabilistic performance awareness and evolutionary game strategy in “cloud + edge” hybrid environment [J]. Journal of Computer Applications, 2021, 41(11): 3302-3308.
[4]	MA Tingting, JI Tianjiao, YANG Guanyu, CHEN Yang, XU Wenbo, LIU Hongtu. Incidence trend prediction of hand-foot-mouth disease based on long short-term memory neural network [J]. Journal of Computer Applications, 2021, 41(1): 265-269.
[5]	WANG Siyu, GAO Weixin, LI Lu. Image quality evaluation model for X-ray circumferential welds [J]. Journal of Computer Applications, 2020, 40(9): 2748-2753.
[6]	CHEN Foji, ZHU Feng, WU Qingxiao, HAO Yingming, WANG Ende. Infrared image data augmentation based on generative adversarial network [J]. Journal of Computer Applications, 2020, 40(7): 2084-2088.
[7]	WANG Lei. Network intrusion detection method based on improved rough set attribute reduction and K-means clustering [J]. Journal of Computer Applications, 2020, 40(7): 1996-2002.
[8]	CAO Yu, WANG Cheng, WANG Xin, GAO Yueer. Urban road short-term traffic flow prediction based on spatio-temporal node selection and deep learning [J]. Journal of Computer Applications, 2020, 40(5): 1488-1493.
[9]	GUO Shujie, LI Zhihua, LIN Kaiqing. Fuzzy membership degree based virtual machine placement algorithmin cloud environment [J]. Journal of Computer Applications, 2020, 40(5): 1374-1381.
[10]	LUO Chiwei, QU Tao, DENG Dexiang. Rate adaption algorithm for embedded multi-channel wireless video transmission [J]. Journal of Computer Applications, 2020, 40(4): 1119-1126.
[11]	WEI Wei, LI Xiaojuan. Patent quality evaluation using deep learning with similar papers as augmented dataset [J]. Journal of Computer Applications, 2020, 40(4): 966-971.
[12]	ZHANG Wu, CHEN Hongmei. Hyperspectral band selection algorithm based on kernelized fuzzy rough set [J]. Journal of Computer Applications, 2020, 40(1): 258-263.
[13]	SUN Tianqi, HU Jianpeng, HUANG Juan, FAN Ying. Bandwidth resource prediction and management of Web applications hosted on cloud [J]. Journal of Computer Applications, 2020, 40(1): 181-187.
[14]	ZHANG Bin, LUO Xiaoqing, ZHANG Zhancheng. Image fusion quality evaluation algorithm based on TV-L¹ structure and texture decomposition [J]. Journal of Computer Applications, 2019, 39(9): 2701-2706.
[15]	WANG Yan, MA Xiurong, SHAN Yunlong. Downlink resource scheduling based on weighted average delay in long term evolution system [J]. Journal of Computer Applications, 2019, 39(5): 1429-1433.