基于改进的代价敏感决策树的网络贷款分类

doi:10.11772/j.issn.1001-9081.2019020827

计算机应用 ›› 2019, Vol. 39 ›› Issue (10): 2888-2892.DOI: 10.11772/j.issn.1001-9081.2019020827

基于改进的代价敏感决策树的网络贷款分类

郭冰楠, 吴广潮

华南理工大学数学学院, 广州 510640

收稿日期:2019-03-22 修回日期:2019-05-09 发布日期:2019-06-03 出版日期:2019-10-10
通讯作者: 郭冰楠
作者简介:郭冰楠(1992-),女,河南三门峡人,硕士研究生,主要研究方向:数据挖掘、机器学习;吴广潮(1972-),男,广东汕头人,副教授,博士,主要研究方向:数据挖掘、机器学习。

Classification of online loan based on improved cost-sensitive decision tree

GUO Bingnan, WU Guangchao

College of Mathematics, South China University of Technology, Guangzhou Guangdong 510640, China

Received:2019-03-22 Revised:2019-05-09 Online:2019-06-03 Published:2019-10-10

摘要/Abstract

摘要： 在网络贷款用户数据集中，贷款成功和贷款失败的用户数量存在着严重的不平衡，传统的机器学习算法在解决该类问题时注重整体分类正确率，导致贷款成功用户的预测精度较低。针对此问题，在代价敏感决策树敏感函数的计算中加入类分布，以减弱正负样本数量对误分类代价的影响，构建改进的代价敏感决策树；以该决策树作为基分类器并以分类准确度作为衡量标准选择表现较好的基分类器，将它们与最后阶段生成的分类器集成得到最终的分类器。实验结果表明，与已有的常用于解决此类问题的算法（如MetaCost算法、代价敏感决策树、AdaCost算法等）相比，改进的代价敏感决策树对网络贷款用户分类可以降低总体的误分类错误率，具有更强的泛化能力。

关键词: 不平衡, 代价敏感, 网络贷款, 集成学习, 决策树

Abstract: In the online loan user data set, there is a serious imbalance between the number of successful and failed loan users. The traditional machine learning algorithm pays attention to the overall classification accuracy when solving such problems, which leads to lower prediction accuracy of successful loan users. In order to solve this problem, the class distribution was added to the calculation of cost-sensitive decision tree sensitivity function, in order to weaken the impact of positive and negative samples on the misclassification cost, and an improved cost-sensitive decision tree based on ID3 (ID3cs)was constructed. With the improved cost-sensitive decision tree as the base classifier and the classification accuracy as the criterion, the base classifiers with better performance were selected and integrated with the classifier generated in the last stage to obtain the final classifier. Experimental results show that compared with the existing algorithms to solve such problems (such as MetaCost algorithm, cost-sensitive decision tree, AdaCost algorithm), the improved cost-sensitive decision tree can reduce the overall misclassification rate of online loan users and has stronger generalization ability.

Key words: imbalance, cost-sensitive, online loan, integrated learning, decision tree

中图分类号:

TP181

郭冰楠, 吴广潮. 基于改进的代价敏感决策树的网络贷款分类[J]. 计算机应用, 2019, 39(10): 2888-2892.

GUO Bingnan, WU Guangchao. Classification of online loan based on improved cost-sensitive decision tree[J]. Journal of Computer Applications, 2019, 39(10): 2888-2892.

参考文献

[1] GUO Y, ZHOU W, LUO C, et al. Instance-based credit risk assessment for investment decisions in P2P lending[J]. European Journal of Operational Research, 2016, 249(2):417-426.
[2] ANGELINI E, CAMBA-MENDEZ G, GIANNONE D, et al. Short term forecasts of euro area GDP growth[J]. The Econometrics Journal, 2011, 14(1):25-44.
[3] ZHOU Z, LIU X. Training cost-sensitive neural networks with methods addressing the class imbalance problem[J]. IEEE Transactions on Knowledge and Data Engineering, 2006, 18(1):63-77.
[4] LIU A, GHOSH J, MARTIN C E. Generative oversampling for mining imbalanced datasets[EB/OL].[2018-12-10]. http://wwwmath1.uni-muenster.de/u/lammers/EDU/ws07/Softcomputing/Literatur/4-DMI5467.pdf.
[5] JAPKOWICZ N. Concept-learning in the presence of between-class and within-class imbalances[C]//Proceedings of the 14th Biennial Conference of the Canadian Society for Computational Studies of Intelligence, LNCS 2056. Berlin:Springer, 2001:67-77.
[6] CHAWLA N V, BOWYER K W, HALL L O, et al. SMOTE:synthetic minority over-sampling technique[J]. Journal of Artificial Intelligence Research, 2002, 16:321-357.
[7] DRUMMOND C, HOLTE R C. Exploiting the cost (in) sensitivity of decision tree splitting criteria[C]//Proceedings of the 17th International Conference on Machine Learning. San Francisco:Morgan Kaufmann, 2000:239-246.
[8] FAN W, STOLFO S J, ZHANG J, et al. AdaCost:misclassification cost-sensitive boosting[C]//Proceedings of the 16th International Conference on Machine Learning. San Francisco, CA:Morgan Kaufmann, 1999:97-105.
[9] DOMINGOS P. MetaCost:a general method for making classifiers cost-sensitive[C]//Proceedings of the 5th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York:ACM, 1999:155-164.
[10] 周宇航, 周志华. 价敏感大间隔分布学习机[J]. 计算机研究与发展, 2016, 53(9):1964-1970. (ZHOU Y H, ZHOU Z H. Cost-sensitive large margin distribution machine[J]. Journal of Computer Research and Development, 2016, 53(9):1964-1970.)
[11] 李航. 统计学习方法[M]. 北京:清华大学出版社, 2012:22-24. (LI H. Statistical Learning Methods[M]. Beijing:Tsinghua University Press, 2012:22-24.)
[12] BANBURA M, MODUGNO M. Maximum likelihood estimation of factor models on datasets with arbitrary pattern of missing data[J]. Journal of Applied Econometrics, 2014, 29(1):133-160.
[13] 邹鹏, 莫佳卉, 江亦华, 等.基于代价敏感决策树的客户价值细分[J]. 管理科学, 2011, 24(2):20-29. (ZOU P, MO J H, KIANG M, et al. A cost-sensitive decision tree learning model-an application to customer-value based segmentation[J]. Journal of Management Science, 2011, 24(2):20-29.)
[14] 李秋洁, 赵雅琴, 顾洲. 代价敏感学习中的损失函数设计[J]. 控制理论与应用, 2015, 32(5):689-694. (LI Q J, ZHAO Y Q, GU Z. Design of loss function for cost-sensitive learning[J]. Control Theory & Applications, 2015, 32(5):689-694.)
[15] 周志华. 机器学习[M]. 北京:清华大学出版社, 2016:86-128. (ZHOU Z H. Machine Learning[M]. Beijing:Tsinghua University Press, 2016:86-128.)
[16] 付忠良. 不平衡多分类问题的连续AdaBoost算法研究[J]. 计算机研究与发展, 2011, 48(12):2326-2333. (FU Z L. Real AdaBoost algorithm for multi-class and imbalanced classification problems[J]. Journal of Computer Research and Development, 2011, 48(12):2326-2333.)

基于改进的代价敏感决策树的网络贷款分类

Classification of online loan based on improved cost-sensitive decision tree

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	毛铭泽, 曹芮浩, 闫春钢. 基于权值多样性的半监督分类算法[J]. 计算机应用, 2021, 41(9): 2473-2480.
[2]	孟凡, 陈广, 王勇, 高阳, 高德群, 贾文龙. 基于多粒度时序结构表示的异常检测算法在储层含油性检测中应用[J]. 计算机应用, 2021, 41(8): 2453-2459.
[3]	肖振远, 王逸涵, 罗建桥, 熊鹰, 李柏林. 基于部分加权损失函数的RefineDet[J]. 计算机应用, 2021, 41(7): 1928-1932.
[4]	王垚, 孙国梓. 基于聚类和实例硬度的入侵检测过采样方法[J]. 计算机应用, 2021, 41(6): 1709-1714.
[5]	余东昌, 赵文芳, 聂凯, 张舸. 基于LightGBM算法的能见度预测模型[J]. 计算机应用, 2021, 41(4): 1035-1041.
[6]	周美玲, 陈淮莉. 基于负荷平衡的电动汽车模糊多目标充电调度算法[J]. 计算机应用, 2021, 41(4): 1192-1198.
[7]	曹阳, 闫秋艳, 吴鑫. 不平衡时间序列集成分类算法[J]. 计算机应用, 2021, 41(3): 651-656.
[8]	秦静, 左长青, 汪祖民, 季长清, 王宝凤. 基于堆叠分类器的心电异常监测模型设计[J]. 计算机应用, 2021, 41(3): 887-890.
[9]	罗长银, 陈学斌, 马春地, 王君宇. 面向区块链的在线联邦增量学习算法[J]. 计算机应用, 2021, 41(2): 363-371.
[10]	王雅辉, 钱宇华, 刘郭庆. 基于模糊优势互补互信息的有序决策树算法[J]. 计算机应用, 2021, 41(10): 2785-2792.
[11]	周翔, 翟俊海, 黄雅婕, 申瑞彩, 侯璎真. 基于随机森林和投票机制的大数据样例选择算法[J]. 计算机应用, 2021, 41(1): 74-80.
[12]	周超然, 赵建平, 马太, 周欣. 基于注意力机制和集成学习的网页黑名单判别方法[J]. 计算机应用, 2021, 41(1): 133-138.
[13]	王俊红, 闫家荣. 基于欠采样和代价敏感的不平衡数据分类算法[J]. 计算机应用, 2021, 41(1): 48-52.
[14]	顾桐, 许国良, 李万林, 李家浩, 王志愿, 雒江涛. 基于集成LightGBM和贝叶斯优化策略的房价智能评估模型[J]. 计算机应用, 2020, 40(9): 2762-2767.
[15]	刘丹, 姚立霜, 王云锋, 裴作飞. 面向类不平衡流量数据的分类模型[J]. 计算机应用, 2020, 40(8): 2327-2333.