Research and application of dynamic rule extraction algorithm based on rough set and decision tree

doi:10.11772/j.issn.1001-9081.2015.11.3222

Abstract

Abstract: For the shortage of big data and incremental data processing in static algorithm, the dynamic rule extraction algorithm based on rough-decision tree was constructed to diagnose rotating machinery faults. Through the combination of rough set with decision tree, the sample selections were made by the method of incremental sampling. Through dynamic reduction, decision tree construction, rules extraction and selection, matching, four steps of loop iteration process, dynamic rule extraction was achieved, which improved the credibility of the extracted rules. Meanwhile, by applying the algorithm to the dynamic problem: rotating machinery fault diagnosis, the effectiveness of the algorithm was verified. Finally, the efficiency of the algorithm was compared with static algorithm and incremental dynamic algorithm. The result demonstrates that the proposed algorithm can obtain more implied information in the most streamlined way.

Key words: rough set, decision tree, static algorithm, dynamic reduction, dynamic rule

摘要： 针对静态算法对大数据和增量数据处理不足的问题,构造了基于粗决策树的动态规则提取算法,并将其应用于旋转机械故障诊断中.将粗集与决策树结合,用增量方式实现样本抽取;经过动态约简、决策树构造、规则提取与选择、匹配4个步骤的循环迭代过程,实现了数据的动态规则提取,使得提取的规则具有更高的可信度;同时,将算法应用于旋转机械故障诊断这一动态问题中,验证了算法的有效性;最后,将所提算法分别与静态算法和增量式动态算法进行了效率对比分析,实验结果表明,所提算法能够以最精简的规则获得更多数据隐含信息.

关键词: 粗集, 决策树, 静态算法, 动态约简, 动态规则

CLC Number:

TP301.6
O29

CHEN Lifang, WANG Yun, ZHANG Feng. Research and application of dynamic rule extraction algorithm based on rough set and decision tree[J]. Journal of Computer Applications, 2015, 35(11): 3222-3226.

陈丽芳, 王云, 张奉. 粗决策树动态规则提取算法研究及应用[J]. 计算机应用, 2015, 35(11): 3222-3226.

References

[1] ZHANG W, WU W, LIANG J, et al. Rough set theory and method [M]. Beijing: Science Press, 2001:1-39.(张文修,吴伟志,梁吉业,等.粗集理论与方法[M].北京:科学出版社,2001:1-39.)
[2] WU S, LIU S, GU J. A rule extraction method based on rough sets theory [J]. Journal of Xiamen University:Natural Science, 2004,43(5):605-608.(吴顺祥,刘思峰,辜建徳.基于粗集理论的一种规则提取方法[J].厦门大学学报:自然科学版,2004,43(5): 605-608.)
[3] TAN J, WU J. Study of classification algorithm based on the decision tree rules [J]. Computer Engineering and Design, 2010, 31 (5) : 1017-1019.(谭俊璐,吴建华.基于决策树规则的分类算法研究[J].计算机工程与设计,2010,31(5):1017-1019.)
[4] DING C, LI L. A decision tree rule extraction algorithm based on rough set [J]. Computer Technology and Development, 2007, 17(11):111-113.(丁春荣,李龙.一个基于粗集的决策树规则提取算法[J].计算机技术与发展,2007,17(11):111-113.)
[5] SHI K. Attribute reduction based on rough set theory and decision tree classification algorithm research [D]. Dalian: Dalian Maritime University, 2014.(石凯.基于粗集理论的属性约简与决策树分类算法研究[D]. 大连: 大连海事大学,2014.)
[6] HU Y, ZHENG J. Improved ID3 algorithm based on rough set theory and application [J]. Journal of Guiyang College, 2015, 10 (1): 16-20.(胡煜,郑娟.基于粗集理论的ID3算法的改进与应用[J].贵阳学院学报,2015,10(1):16-20.)
[7] YU F, WANG R, ZHU X, et al. Dynamic reduction and rule extraction based on discernibility matrix algorithm[J]. Automation and Instrumentation, 2007,22(6):1-4.(余峰林,王儒敬,朱学昊,等.基于差别矩阵的动态约简及规则提取算法[J].自动化与仪表,2007,22(6):1-4.)
[8] YIN A, XIE L, LONG Y, et al. Dynamic decision tree algorithm study[J]. Computer Engineering and Applications, 2004,40(33):103-105.(尹阿东,谢林銓,龙誉,等.动态决策树算法研究[J]. 计算机工程与应用,2004,40(33):103-105.)
[9] WANG Y, YAN D, ZHANG F. Based on rough set and decision tree rules of incremental reduction algorithm [J]. Computer Engineering and Application, 2007,43(1): 170-172.(王杨,闫得勤,张凤梅.基于粗集和决策树的增量式规则约简算法[J].计算机工程与应用,2007,43(1):170-172.)
[10] ZHOU H. Dynamic reduction based on rough set theory research [D]. Changsha: Central South University, 2004.(周化.基于粗集理论的动态约简研究[D].长沙:中南大学,2004.)
[11] SHU W, SHEN H. Incremental feature selection based on rough set in dynamic incomplete data [J]. Pattern Recognition, 2014, 47(12):3890-3906.
[12] SON C, KIM Y, KIM H, et al. Decision-making model for early diagnosis of congestive heart failure using rough set and decision tree approaches [J]. Journal of Biomedical Informatics, 2012, 45(5):999-1008.
[13] LIAO Q, HAO Z, CHEN Z. Data mining and mathematical modeling [M]. Beijing: National Defense Industry Press, 2010:126-138.(廖芹,郝志峰,陈志宏.数据挖掘与数学建模[M].北京: 国防工业出版社,2010:126-138.)
[14] XIA Y. Extracting rules based on rough set and decision tree method research [D]. Nanchang: Nanchang University, 2008.(夏叶娟.基于粗集和决策树的规则提取方法研究[D]. 南昌: 南昌大学,2008.)

[1]	WANG Xiaorong, ZHANG Yuzhao, ZHANG Zhenjiang. Selection of express freight transportation schemes based on rough set over two universes [J]. Journal of Computer Applications, 2021, 41(5): 1500-1505.
[2]	PENG Li, ZHANG Haiqing, LI Daiwei, TANG Dan, YU Xi, HE Lei. Imputation algorithm for hybrid information system of incomplete data analysis approach based on rough set theory [J]. Journal of Computer Applications, 2021, 41(3): 677-685.
[3]	WANG Yahui, QIAN Yuhua, LIU Guoqing. Ordinal decision tree algorithm based on fuzzy advantage complementary mutual information [J]. Journal of Computer Applications, 2021, 41(10): 2785-2792.
[4]	ZHOU Xiang, ZHAI Junhai, HUANG Yajie, SHEN Ruicai, HOU Yingzhen. Instance selection algorithm for big data based on random forest and voting mechanism [J]. Journal of Computer Applications, 2021, 41(1): 74-80.
[5]	WANG Lei. Network intrusion detection method based on improved rough set attribute reduction and K-means clustering [J]. Journal of Computer Applications, 2020, 40(7): 1996-2002.
[6]	ZHANG Wu, CHEN Hongmei. Hyperspectral band selection based on multi-kernelized fuzzy rough set and grasshopper optimization algorithm [J]. Journal of Computer Applications, 2020, 40(5): 1425-1430.
[7]	ZHAO Yi, DUAN Xing, XIE Shiyi, LIANG Chunlin. Traffic image semantic retrieval method based on specific object self-recognition [J]. Journal of Computer Applications, 2020, 40(2): 553-560.
[8]	ZHANG Xiajie, ZHU Jinghua, CHEN Yang. Distributed rough set attribute reduction algorithm under Spark [J]. Journal of Computer Applications, 2020, 40(2): 518-523.
[9]	OU Binli, ZHONG Xiaru, DAI Jianhua, YANG Tian. Intrusion detection method based on variable precision covering rough set [J]. Journal of Computer Applications, 2020, 40(12): 3465-3470.
[10]	ZHANG Wu, CHEN Hongmei. Hyperspectral band selection algorithm based on kernelized fuzzy rough set [J]. Journal of Computer Applications, 2020, 40(1): 258-263.
[11]	BAO Di, ZHANG Nan, TONG Xiangrong, YUE Xiaodong. Incremental attribute reduction algorithm of positive region in interval-valued decision tables [J]. Journal of Computer Applications, 2019, 39(8): 2288-2296.
[12]	XU Yi, XIAO Peng. Dynamic updating method of approximations in multigranulation rough sets based on tolerance relation [J]. Journal of Computer Applications, 2019, 39(5): 1247-1251.
[13]	KONG Heqing, ZHANG Nan, YUE Xiaodong, TONG Xiangrong, YU Tianyou. Positive region preservation reduction based on multi-specific decision classes in incomplete decision systems [J]. Journal of Computer Applications, 2019, 39(5): 1252-1260.
[14]	WANG Wei, XIE Yaobin, YIN Qing. Decision tree improvement method for imbalanced data [J]. Journal of Computer Applications, 2019, 39(3): 623-628.
[15]	MO Zan, GAI Yanrong, FAN Guanlong. Credit card fraud classification based on GAN-AdaBoost-DT imbalanced classification algorithm [J]. Journal of Computer Applications, 2019, 39(2): 618-622.