基于奇异值分解—偏最小二乘回归的多标签分类算法

doi:10.11772/j.issn.1001-9081.2014.07.2058

计算机应用 ›› 2014, Vol. 34 ›› Issue (7): 2058-2060.DOI: 10.11772/j.issn.1001-9081.2014.07.2058

基于奇异值分解—偏最小二乘回归的多标签分类算法

马宗杰¹,刘华文¹,²

1. 浙江师范大学数理与信息工程学院，浙江金华 321004
2. 中国科学院数学与系统科学研究院，北京 100055

收稿日期:2013-12-10 修回日期:2014-01-30 出版日期:2014-07-01 发布日期:2014-08-01
通讯作者: 刘华文
作者简介:马宗杰(1986-),男,河北石家庄人,硕士研究生,主要研究方向:多标签分类、模式识别;刘华文(1977-),男,江西抚州人,副教授,博士,主要研究方向:特征选择、模式识别、多标签分类。
基金资助:
国家自然科学基金资助项目;中国博士后科学基金资助项目;模式识别国家重点实验室开放基金资助项目;浙江省自然科学基金资助项目

Multi-label classification based on singular value decomposition-partial least squares regression

MA Zongjie¹,LIU Huawen¹,²

1. College of Mathematics, Physics and Information Engineering, Zhejiang Normal University, Jinhua Zhejiang 321004, China;
2. Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100055, China

Received:2013-12-10 Revised:2014-01-30 Online:2014-07-01 Published:2014-08-01
Contact: LIU Huawen

摘要/Abstract

摘要：

针对多标签数据的标签相关性和高维问题，提出一种基于奇异值分解—偏最小二乘回归的多标签分类算法，该算法可以对多标签数据进行维数约简和回归分析。首先，将类别标签集合作为整体处理,对标签相关性进行考察; 其次，利用奇异值分解(SVD)技术得到样本和标签空间的得分向量，实施降维; 最后，在偏最小二乘回归(PLSR)的基础上构建多标签分类模型。实验结果表明，在四种维数较高的真实数据集上，该算法可以获得有效的分类结果。

Abstract:

To tackle multi-label data with high dimensionality and label correlations, a multi-label classification approach based on Singular Value Decomposition (SVD)-Partial Least Squares Regression (PLSR) was proposed, which aimed at performing dimensionality reduction and regression analysis. Firstly, the label space was taken into a whole so as to exploit the label correlations. After that, the score vectors of both the instance space and label space were obtained by SVD, which was used for dimensionality reduction. Finally, the model of multi-label classification was established based on PLSR. The experiments performed on four real data sets with higher dimensionality verify the effectiveness of the proposed method.

中图分类号:

TP181

马宗杰刘华文. 基于奇异值分解—偏最小二乘回归的多标签分类算法[J]. 计算机应用, 2014, 34(7): 2058-2060.

MA Zongjie LIU Huawen. Multi-label classification based on singular value decomposition-partial least squares regression[J]. Journal of Computer Applications, 2014, 34(7): 2058-2060.

参考文献

［1］NGUYEN C T, ZHAN D C, ZHOU Z H. Multi-modal image annotation with multi-instance multi-label LDA［C］// Proceedings of the 23rd International Joint Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2013: 1558-1564.
［2］AGRAWAL R, GUPTA A, PRABHU Y, et al. Multi-label learning with millions of labels: recommending advertiser bid phrases for Web pages［C］// Proceedings of the 22nd International Conference on World Wide Web. Berlin: Springer, 2013:13-24.
［3］BARUTCUOGLU Z, SCHAPIRE R E, TROYANSKAY O G. Hierarchical multi-label prediction of gene function［J］. Bioinformatics, 2006, 22(7): 830-836.
［4］YANG S J, JIANG Y, ZHOU Z H. Multi-instance multi-label learning with weak label［C］// Proceedings of the 23rd International Joint Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2013: 1862-1868.
［5］XU M, LI Y, ZHOU Z. Multi-label learning with PRO loss［C］// Proceedings of the 27th AAAI Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2013: 998-1004.
［6］XU M, JIN R, ZHOU Z H. Speedup matrix completion with side information: Application to multi-label learning ［C］// Advances in Neural Information Processing Systems 26. Cambridge: MIT Press, 2013: 2301-2309.
［7］ZHANG Y, ZHOU Z. Multilabel dimensionality reduction via dependence maximization ［J］. ACM Transactions on Knowledge Discovery from Data, 2010, 4(3):1-21.
［8］WANG H, DING C, HUANG H. Multi-label linear discriminant analysis［C］// Proceedings of the 11th European Conference on Computer Vision. Berlin: Springer Press, 2010: 126-139.
［9］TAI F, LIN H T. Multi-label classification with principle label space transformation［J］. Neural Computation, 2012, 24(9): 2508-2542.
［10］TSOUMAKAS G, KATAKIS I, VLAHAVAS I. Random k-labelsets for multi-label classification［J］.IEEE Transactions on Knowledge and Data Engineering, 2011, 23(7):1079-1089.
［11］TSOUMAKAS G, DIMOU A, SPYROMITROS E, et al. Correlation-based pruning of stacked binary relevance models for multi-label learning ［C］// Proceedings of the 2009 Workshop on Learning from Multi-Label Data. Berlin: Springer, 2009: 101-116.
［12］READ J, PFAHRINGER B, HOLMES G, et al. Classifier chains for multi-label classification ［J］. Machine Learning, 2011, 85(3): 333-359.
［13］HUANG S J, ZHOU Z. Multi-label learning by exploiting label correlations locally［C］// Proceedings of the 26th AAAI Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2012: 949-955.
［14］HOSKULDSSON A. PLS regression methods［J］.Journal of Chemometrics, 1988, 2(3): 211-228.
［15］ZHANG M, ZHOU Z. A review on multi-label learning algorithms［J］. IEEE Transactions on Knowledge and Data Engineering, 2013, 99(99): 1.
［16］ZHANG M L, ZHOU Z. ML-kNN: A lazy learning approach to multi-label learning ［J］. Pattern Recognition, 2007, 40(7): 2038-2048.
［17］CHENG W, HULLERMEIER E. Combining instance-based learning and logistic regression for multilabel classification ［J］. Machine Learning, 2009, 76(2/3): 211-225.
［18］TSOUMAKAS G, KATAKIS I, VLAHAVAS I. Effective and efficient multilabel classification in domains with large number of labels ［C］// Proceedings of ECML/PKDD 2008 Workshop on Mining Multidimensional Data. Berlin: Springer, 2008: 30-44.

[1]	陈露张晓霞于洪. 基于先验知识的非负矩阵半可解释三因子分解算法[J]. 计算机应用, 0, (): 0-0.
[2]	李晓杰崔超然宋广乐苏雅茜吴天泽张春云. 基于时序超图卷积神经网络的股票趋势预测方法[J]. 计算机应用, 0, (): 0-0.
[3]	李宗正周恺卿丁雷欧云. 基于基因交换的自适应人工鱼群算法[J]. 计算机应用, 0, (): 0-0.
[4]	刘清华廖士中. 基于随机素描方法的在线核回归[J]. 计算机应用, 0, (): 0-0.
[5]	刘忠慧王梓宥闵帆. 近似概念的遗传生成算法及其推荐应用[J]. 计算机应用, 0, (): 0-0.
[6]	汪敏冯婷婷闵帆唐洪明闫建平廖纪佳. 页岩气储层预测的多标签主动学习算法[J]. 计算机应用, 0, (): 0-0.
[7]	王雅辉, 钱宇华, 刘郭庆. 基于模糊优势互补互信息的有序决策树算法[J]. 计算机应用, 2021, 41(10): 2785-2792.
[8]	任柯舟, 彭甫镕, 郭鑫, 王喆, 张晓静. 动态融合社交信息的社会化推荐[J]. 计算机应用, 2021, 41(10): 2806-2812.
[9]	张志浩, 林耀进, 卢舜, 郭晨, 王晨曦. 缺失标记下基于类属属性的多标记特征选择[J]. 计算机应用, 2021, 41(10): 2849-2857.
[10]	顾军华樊帅李宁宁张素琪. 基于知识图偏好注意力网络的长短期推荐模型及其更新方法[J]. 计算机应用, 0, (): 0-0.
[11]	王海起王志海李留珂孔浩然王琼徐建波. 基于网格划分的城市短时交通流量时空预测模型[J]. 计算机应用, 0, (): 0-0.
[12]	陈恒王思懿李正光李冠宇刘鑫. 基于关系记忆的胶囊网络知识图谱嵌入模型[J]. 计算机应用, 0, (): 0-0.
[13]	张成, 万源, 强浩鹏. 基于知识蒸馏的深度无监督离散跨模态哈希[J]. 计算机应用, 2021, 41(9): 2523-2531.
[14]	孙浩艺, 王传美, 丁义明. 基于隐藏层输出矩阵的极限学习机算法优化[J]. 计算机应用, 2021, 41(9): 2481-2488.
[15]	卞凌志, 王直杰. 基于增强多维多粒度级联森林的信用评分模型[J]. 计算机应用, 2021, 41(9): 2539-2544.

基于奇异值分解—偏最小二乘回归的多标签分类算法

Multi-label classification based on singular value decomposition-partial least squares regression

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics