基于奇异值分解—偏最小二乘回归的多标签分类算法

doi:10.11772/j.issn.1001-9081.2014.07.2058

计算机应用 ›› 2014, Vol. 34 ›› Issue (7): 2058-2060.DOI: 10.11772/j.issn.1001-9081.2014.07.2058

基于奇异值分解—偏最小二乘回归的多标签分类算法

马宗杰¹,刘华文¹,²

1. 浙江师范大学数理与信息工程学院，浙江金华 321004
2. 中国科学院数学与系统科学研究院，北京 100055

收稿日期:2013-12-10 修回日期:2014-01-30 发布日期:2014-08-01 出版日期:2014-07-01
通讯作者: 刘华文
作者简介:马宗杰(1986-),男,河北石家庄人,硕士研究生,主要研究方向:多标签分类、模式识别;刘华文(1977-),男,江西抚州人,副教授,博士,主要研究方向:特征选择、模式识别、多标签分类。
基金资助:
国家自然科学基金资助项目;中国博士后科学基金资助项目;模式识别国家重点实验室开放基金资助项目;浙江省自然科学基金资助项目

Multi-label classification based on singular value decomposition-partial least squares regression

MA Zongjie¹,LIU Huawen¹,²

1. College of Mathematics, Physics and Information Engineering, Zhejiang Normal University, Jinhua Zhejiang 321004, China;
2. Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100055, China

Received:2013-12-10 Revised:2014-01-30 Online:2014-08-01 Published:2014-07-01
Contact: LIU Huawen

摘要/Abstract

摘要：

针对多标签数据的标签相关性和高维问题，提出一种基于奇异值分解—偏最小二乘回归的多标签分类算法，该算法可以对多标签数据进行维数约简和回归分析。首先，将类别标签集合作为整体处理,对标签相关性进行考察; 其次，利用奇异值分解(SVD)技术得到样本和标签空间的得分向量，实施降维; 最后，在偏最小二乘回归(PLSR)的基础上构建多标签分类模型。实验结果表明，在四种维数较高的真实数据集上，该算法可以获得有效的分类结果。

Abstract:

To tackle multi-label data with high dimensionality and label correlations, a multi-label classification approach based on Singular Value Decomposition (SVD)-Partial Least Squares Regression (PLSR) was proposed, which aimed at performing dimensionality reduction and regression analysis. Firstly, the label space was taken into a whole so as to exploit the label correlations. After that, the score vectors of both the instance space and label space were obtained by SVD, which was used for dimensionality reduction. Finally, the model of multi-label classification was established based on PLSR. The experiments performed on four real data sets with higher dimensionality verify the effectiveness of the proposed method.

中图分类号:

TP181

马宗杰刘华文. 基于奇异值分解—偏最小二乘回归的多标签分类算法[J]. 计算机应用, 2014, 34(7): 2058-2060.

MA Zongjie LIU Huawen. Multi-label classification based on singular value decomposition-partial least squares regression[J]. Journal of Computer Applications, 2014, 34(7): 2058-2060.

参考文献

［1］NGUYEN C T, ZHAN D C, ZHOU Z H. Multi-modal image annotation with multi-instance multi-label LDA［C］// Proceedings of the 23rd International Joint Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2013: 1558-1564.
［2］AGRAWAL R, GUPTA A, PRABHU Y, et al. Multi-label learning with millions of labels: recommending advertiser bid phrases for Web pages［C］// Proceedings of the 22nd International Conference on World Wide Web. Berlin: Springer, 2013:13-24.
［3］BARUTCUOGLU Z, SCHAPIRE R E, TROYANSKAY O G. Hierarchical multi-label prediction of gene function［J］. Bioinformatics, 2006, 22(7): 830-836.
［4］YANG S J, JIANG Y, ZHOU Z H. Multi-instance multi-label learning with weak label［C］// Proceedings of the 23rd International Joint Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2013: 1862-1868.
［5］XU M, LI Y, ZHOU Z. Multi-label learning with PRO loss［C］// Proceedings of the 27th AAAI Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2013: 998-1004.
［6］XU M, JIN R, ZHOU Z H. Speedup matrix completion with side information: Application to multi-label learning ［C］// Advances in Neural Information Processing Systems 26. Cambridge: MIT Press, 2013: 2301-2309.
［7］ZHANG Y, ZHOU Z. Multilabel dimensionality reduction via dependence maximization ［J］. ACM Transactions on Knowledge Discovery from Data, 2010, 4(3):1-21.
［8］WANG H, DING C, HUANG H. Multi-label linear discriminant analysis［C］// Proceedings of the 11th European Conference on Computer Vision. Berlin: Springer Press, 2010: 126-139.
［9］TAI F, LIN H T. Multi-label classification with principle label space transformation［J］. Neural Computation, 2012, 24(9): 2508-2542.
［10］TSOUMAKAS G, KATAKIS I, VLAHAVAS I. Random k-labelsets for multi-label classification［J］.IEEE Transactions on Knowledge and Data Engineering, 2011, 23(7):1079-1089.
［11］TSOUMAKAS G, DIMOU A, SPYROMITROS E, et al. Correlation-based pruning of stacked binary relevance models for multi-label learning ［C］// Proceedings of the 2009 Workshop on Learning from Multi-Label Data. Berlin: Springer, 2009: 101-116.
［12］READ J, PFAHRINGER B, HOLMES G, et al. Classifier chains for multi-label classification ［J］. Machine Learning, 2011, 85(3): 333-359.
［13］HUANG S J, ZHOU Z. Multi-label learning by exploiting label correlations locally［C］// Proceedings of the 26th AAAI Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2012: 949-955.
［14］HOSKULDSSON A. PLS regression methods［J］.Journal of Chemometrics, 1988, 2(3): 211-228.
［15］ZHANG M, ZHOU Z. A review on multi-label learning algorithms［J］. IEEE Transactions on Knowledge and Data Engineering, 2013, 99(99): 1.
［16］ZHANG M L, ZHOU Z. ML-kNN: A lazy learning approach to multi-label learning ［J］. Pattern Recognition, 2007, 40(7): 2038-2048.
［17］CHENG W, HULLERMEIER E. Combining instance-based learning and logistic regression for multilabel classification ［J］. Machine Learning, 2009, 76(2/3): 211-225.
［18］TSOUMAKAS G, KATAKIS I, VLAHAVAS I. Effective and efficient multilabel classification in domains with large number of labels ［C］// Proceedings of ECML/PKDD 2008 Workshop on Mining Multidimensional Data. Berlin: Springer, 2008: 30-44.

[1]	宫智宇王士同. 面向重尾噪声图像分类的残差网络学习方法[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[2]	王虎王晓峰李可马云洁. 融合多头自注意力的标签语义嵌入联邦类增量学习方法[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[3]	刘晶鑫, 黄雯静, 徐亮胜, 黄冲, 吴建生. 字典学习与样本关联保持结合的无监督特征选择模型[J]. 《计算机应用》唯一官方网站, 2024, 44(12): 3766-3775.
[4]	宋逸飞, 柳毅. 基于数据增强和标签噪声的快速对抗训练方法[J]. 《计算机应用》唯一官方网站, 2024, 44(12): 3798-3807.
[5]	赵小阳许新征李仲年. 物联网应用中的可解释人工智能研究综述[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[6]	余家宸, 杨晔. 基于裁剪近端策略优化算法的软机械臂不规则物体抓取[J]. 《计算机应用》唯一官方网站, 2024, 44(11): 3629-3638.
[7]	李志杰, 廖旭红, 李元香, 李青蓝. 基于基因关联分析的贝叶斯网络疾病样本分类算法[J]. 《计算机应用》唯一官方网站, 2024, 44(11): 3449-3458.
[8]	黄雨鑫, 黄贻望, 黄辉. 基于浅层网络预测的元标签校正方法[J]. 《计算机应用》唯一官方网站, 2024, 44(11): 3364-3370.
[9]	胡婕郑启扬孙军张龑. 基于多关系标签图和局部动态重构学习的多标签分类模型[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[10]	柴汶泽, 范菁, 孙书魁, 梁一鸣, 刘竟锋. 深度度量学习综述[J]. 《计算机应用》唯一官方网站, 2024, 44(10): 2995-3010.
[11]	尹春勇, 周永成. 双端聚类的自动调整聚类联邦学习[J]. 《计算机应用》唯一官方网站, 2024, 44(10): 3011-3020.
[12]	曹锋, 杨小玲, 易见兵, 李俊. 矛盾体分离超演绎方法及应用[J]. 《计算机应用》唯一官方网站, 2024, 44(10): 3074-3080.
[13]	许鹏程何磊李川钱炜祺赵暾. 基于Transformer的深度符号回归方法[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[14]	颜文婧王瑞东左敏张青川. 基于风味嵌入异构图层次学习的食谱推荐模型[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.
[15]	郭书剑余节约尹学松. 图正则化弹性网子空间聚类[J]. 《计算机应用》唯一官方网站, 0, (): 0-0.

基于奇异值分解—偏最小二乘回归的多标签分类算法

Multi-label classification based on singular value decomposition-partial least squares regression

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics